-- Logs begin at Mon 2022-08-29 21:53:26 UTC, end at Mon 2022-08-29 23:06:04 UTC. -- Aug 29 22:29:04.078373 dv-cinder-854269-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 22:29:04.087513 dv-cinder-854269-4-smb devstack@keystone.service[82224]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 22:29:04.090133 dv-cinder-854269-4-smb devstack@keystone.service[82224]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 22:29:04 2022] *** Aug 29 22:29:04.090290 dv-cinder-854269-4-smb devstack@keystone.service[82224]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 22:29:04.090407 dv-cinder-854269-4-smb devstack@keystone.service[82224]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 22:29:04.090514 dv-cinder-854269-4-smb devstack@keystone.service[82224]: nodename: dv-cinder-854269-4-smb Aug 29 22:29:04.090618 dv-cinder-854269-4-smb devstack@keystone.service[82224]: machine: x86_64 Aug 29 22:29:04.090730 dv-cinder-854269-4-smb devstack@keystone.service[82224]: clock source: unix Aug 29 22:29:04.090832 dv-cinder-854269-4-smb devstack@keystone.service[82224]: pcre jit disabled Aug 29 22:29:04.090927 dv-cinder-854269-4-smb devstack@keystone.service[82224]: detected number of CPU cores: 4 Aug 29 22:29:04.091034 dv-cinder-854269-4-smb devstack@keystone.service[82224]: current working directory: / Aug 29 22:29:04.091137 dv-cinder-854269-4-smb devstack@keystone.service[82224]: detected binary path: /usr/bin/uwsgi-core Aug 29 22:29:04.091244 dv-cinder-854269-4-smb devstack@keystone.service[82224]: your processes number limit is 47680 Aug 29 22:29:04.091349 dv-cinder-854269-4-smb devstack@keystone.service[82224]: your memory page size is 4096 bytes Aug 29 22:29:04.091452 dv-cinder-854269-4-smb devstack@keystone.service[82224]: detected max file descriptor number: 2048 Aug 29 22:29:04.091563 dv-cinder-854269-4-smb devstack@keystone.service[82224]: lock engine: pthread robust mutexes Aug 29 22:29:04.091820 dv-cinder-854269-4-smb devstack@keystone.service[82224]: thunder lock: enabled Aug 29 22:29:04.092144 dv-cinder-854269-4-smb devstack@keystone.service[82224]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 22:29:04.092324 dv-cinder-854269-4-smb devstack@keystone.service[82224]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 22:29:04.131574 dv-cinder-854269-4-smb devstack@keystone.service[82224]: Python main interpreter initialized at 0x5613ae6129c0 Aug 29 22:29:04.131574 dv-cinder-854269-4-smb devstack@keystone.service[82224]: python threads support enabled Aug 29 22:29:04.131574 dv-cinder-854269-4-smb devstack@keystone.service[82224]: your server socket listen backlog is limited to 100 connections Aug 29 22:29:04.131574 dv-cinder-854269-4-smb devstack@keystone.service[82224]: your mercy for graceful operations on workers is 90 seconds Aug 29 22:29:04.132010 dv-cinder-854269-4-smb devstack@keystone.service[82224]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 22:29:04.132010 dv-cinder-854269-4-smb devstack@keystone.service[82224]: *** Operational MODE: preforking *** Aug 29 22:29:04.132285 dv-cinder-854269-4-smb devstack@keystone.service[82224]: *** uWSGI is running in multiple interpreter mode *** Aug 29 22:29:04.132285 dv-cinder-854269-4-smb devstack@keystone.service[82224]: spawned uWSGI master process (pid: 82224) Aug 29 22:29:04.132508 dv-cinder-854269-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 22:29:04.133603 dv-cinder-854269-4-smb devstack@keystone.service[82224]: spawned uWSGI worker 1 (pid: 82236, cores: 1) Aug 29 22:29:04.133603 dv-cinder-854269-4-smb devstack@keystone.service[82224]: spawned uWSGI worker 2 (pid: 82237, cores: 1) Aug 29 22:29:04.133603 dv-cinder-854269-4-smb devstack@keystone.service[82224]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 22:29:08.518656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:29:08.518656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: from cryptography.utils import int_from_bytes Aug 29 22:29:08.548788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:29:08.548788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: from cryptography.utils import int_from_bytes Aug 29 22:29:08.548930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:29:08.548930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: from cryptography.utils import int_from_bytes Aug 29 22:29:08.548930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:29:08.548930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: from cryptography.utils import int_from_bytes Aug 29 22:29:08.569841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:29:08.570036 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:29:08.570228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] command line args: [] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:29:08.570494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:29:08.570672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ================================================================================ {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:29:08.570929 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] admin_token = **** {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.571180 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] config_dir = [] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.571360 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.571542 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] config_source = [] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.571724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] debug = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.571921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.572205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:29:08.572279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:29:08.572349 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.572485 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.572568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] command line args: [] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:29:08.572722 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.572820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:29:08.572889 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ================================================================================ {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:29:08.572953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.573155 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] admin_token = **** {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.573249 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] list_limit = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.573361 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] log_config_append = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.573468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] config_dir = [] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.573572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.573674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.573783 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] log_dir = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.573891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] config_source = [] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.573994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] log_file = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.574101 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] debug = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.574203 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.574293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.574396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.574472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.574472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.574667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.574747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.574866 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.574949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.575029 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.575156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.575240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] list_limit = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.575312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.575433 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] log_config_append = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.575515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.575597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.575724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] log_dir = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.575807 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.575879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] log_file = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.576001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.576077 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.576219 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.576325 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.576456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.576573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.576699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.576823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.576941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.577026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.577173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.577311 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.577417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.577663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.577750 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.577843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] publish_errors = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.577932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.578076 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.578171 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.578326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.578415 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.578488 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.578614 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.578739 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.578837 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.578972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.579094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.579210 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] standard_threads = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.579322 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.579455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.579645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.579798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.579920 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.580007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] use_journal = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.580080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] publish_errors = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.580186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] use_json = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.580259 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.580336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] use_stderr = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.580449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.580536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] use_syslog = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.580615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.580708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.580863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.580949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.581101 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.581187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.581337 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] standard_threads = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.581423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.581570 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.581656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.581814 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.581901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.581974 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.582113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.582236 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] use_journal = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.582358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] use_json = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.582555 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.582669 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] use_stderr = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.582766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.582869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] use_syslog = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.582966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.583060 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:29:08.583164 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.583263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.583364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.583466 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.583578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.583682 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.583787 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.583884 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.583984 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.584116 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.584234 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.584342 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.584445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.584549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.584645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.584766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.584878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.585015 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.585123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.585247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.585365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.585514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.585631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.585754 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.585870 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.585983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.586096 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.586218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.586344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.586468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.586583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.586697 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.586817 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.586932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.587046 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.587170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.587286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.587406 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.587521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.587634 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.587747 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.587939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.588552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.588632 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.588704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.588704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.588843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.588916 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.588994 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.589066 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.589142 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.589220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.589301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.589373 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.589445 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.589515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.589585 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.589655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.589734 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.589871 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.589958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.590099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.590184 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.590327 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.590415 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.590556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.590641 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.590784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.590864 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.591023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.591114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.591270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.591356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.591499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.591609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.591733 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.591853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.591958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.592056 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.592214 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.592328 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.592439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.592539 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.592668 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.592776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.592898 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.592979 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.593111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.593199 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.593355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.593446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.593585 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.593666 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.593819 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.594427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.594567 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.594649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.594796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.594920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.595036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.595123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.595268 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.595348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.595519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.595607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.595732 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.595825 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.595972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.596052 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.596235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.596327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.596464 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.596546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.596698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.596781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.596931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.597012 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.597162 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.597267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.597414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.597538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.597653 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.597734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.597892 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.597978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.598122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.598202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.598354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.598443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.598586 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.598666 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.598828 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.598916 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.599062 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.599141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.599294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.599374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.599522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.599592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.599757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.599844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.600001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.600100 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.600269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.600353 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.600502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.600589 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.600734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.600821 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.600967 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.601062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.601198 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.601278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.601442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.601526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.601680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.601769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.601924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.602003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.602160 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.602238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.602393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.602480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.602633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.602714 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.602867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.602946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.603099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.603186 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.603331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.603411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.603559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.603646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.603787 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.603879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.604013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.604521 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.604644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.604743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.604841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.604952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.605053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.605149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.605247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.605343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.605440 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.605545 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.605644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.605741 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.605837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.605933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.606029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.606134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.606233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.606331 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.606434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] auth.external = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.606537 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.606635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.606740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.606859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.606967 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.607065 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.607160 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.607257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.607387 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] auth.password = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.607498 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] auth.token = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.607606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.607706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.607809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.607908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.608004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.608139 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.608290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.608420 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.608538 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.608661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.608787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] auth.external = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.608903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.609027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.609145 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.609260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.609380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] credential.caching = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.609496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.609652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.610298 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] auth.password = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.610461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.610545 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] auth.token = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.610711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.610801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.610954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.611048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.611196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.611279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.611431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.611513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.611679 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.611762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.611931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.612013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.612188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.612271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.612428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] credential.caching = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.612511 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.612679 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.612762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.612931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.613020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.613182 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.613265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.613423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.613503 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.613666 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.613747 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.613901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] federation.caching = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.613986 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.614119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.614201 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.614364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.614449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.614609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.614700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.614834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.614915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.615080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.615169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.615316 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.615398 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.615567 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.615649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.615802 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.615901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.616054 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.616195 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.616312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.616395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] federation.caching = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.616557 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.616639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.616791 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity.caching = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.616875 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.617035 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.617117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.617278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.617359 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.617510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.617592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.617743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.617825 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.617990 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.618072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.618219 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.618302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.618454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.618535 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.618703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.618785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.618951 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.619032 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.619178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.619260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity.caching = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.619409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.619490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.619639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.619722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.619881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.619963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.620137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.620226 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.620384 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.620468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.620618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.620699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.620858 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.620941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.621126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.621251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.621362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.621512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.621593 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.621752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.621835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.621991 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.622072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.622228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.622316 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.622478 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.622560 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.622714 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.622795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.622950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.623032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.623194 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.623277 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.623423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.623504 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.623665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.623753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.623910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.623993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.624165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.624251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.624413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.624504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.624656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.624739 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.624881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.624962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.625114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.625196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.625392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.625480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.625628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.625709 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.625862 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.625944 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.626100 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.626187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.626333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.626419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.626567 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.626650 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.626812 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.626893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.627057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.627190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.627328 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.627460 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.627599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.627727 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.627857 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.627985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.627985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.628274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.628274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.628544 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.628672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.628799 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.628927 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.629054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.629190 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.629319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.629500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.629646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.629772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.629899 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.629990 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.630068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.630149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.630225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.630299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.630372 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.630453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.630534 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.630609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.630682 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.630756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.630829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.630910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.630985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.631115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.631197 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.631349 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.631432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.631581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.631664 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.631825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.631914 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.632069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.632172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.632335 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.632419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.632578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.632662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.632822 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.632904 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.633051 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.633134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.633280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.633361 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.633516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.633597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.633749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.633831 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.633979 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.634060 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.634209 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.634297 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.634449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.634530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.634692 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.634773 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.634924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.635013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.635173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.635253 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.635400 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.635480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.635638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.635731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.635868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.635948 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.636116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.636202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.636354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.636512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.636591 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.636719 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.636801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.636961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.637044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.637195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.637281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.637430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.637511 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.637669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] resource.caching = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.637751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.637919 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.638002 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.638165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.638311 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.638394 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.638469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.638635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.638720 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.638876 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.638956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.639108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.639188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.639353 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.639437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.639585 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.639672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.639822 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.639902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.640056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] role.caching = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.640190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] resource.caching = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.640328 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] role.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.640409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.640557 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.640639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.640822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.640910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.641069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.641150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.641318 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.641399 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.641552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.641632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.641795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.641877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.642030 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.642110 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.642271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.642353 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.642508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] role.caching = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.642589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.642736 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.642817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] role.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.642976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.643057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.643216 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.643297 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.643460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.643541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.643703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.643786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.643949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.644140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.644227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.644379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.644474 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.644629 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.644711 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.644878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.644960 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.645126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.645210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.645373 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.645457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.645604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.645693 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.645853 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.645936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.646101 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.646182 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.646338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.646516 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.646606 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.646756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.646837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.647006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.647087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.647256 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.647348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.647509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.647590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.647751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.647831 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.647983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.648073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.648240 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.648321 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.648472 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.648553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.648707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] token.caching = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.648801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.648943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.649024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.649179 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.649260 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.649413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.649503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.649664 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.649745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.649907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.649987 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.650141 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.650231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.650383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.650466 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.650618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.650697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.650851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.650941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.651082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.651163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] token.caching = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.651318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.651398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.651548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.651637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.651790 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.651872 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.652047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.652184 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.652306 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.652404 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.652545 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.652629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.652978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.653052 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.653126 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.653199 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.connection = **** {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.653281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.653356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.653479 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.653561 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.653720 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.653801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.653956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.654039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.654197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.654278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.654434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.654516 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.654669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.654752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.654904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.654995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.655147 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.655230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.655381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.655538 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.connection = **** {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.655617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.655691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.655843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.655926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.656107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.656206 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.656346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.656915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.657103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.657185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.657333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.657423 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.657571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.657653 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.657804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.657886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.657960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:29:08.658094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.658336 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.658589 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.658827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.659079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.659319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.659567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.659800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.660041 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.660302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:29:08.660475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:29:08.687545 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.687797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.688024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.689256 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.689491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.689718 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.696352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.698073 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.725188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.725399 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.726255 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.726492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.779303 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.779641 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.831369 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.831646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.833847 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.834084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.989244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.989534 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.989673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.989877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.990095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.990310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.990498 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.990728 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.990950 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.991171 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.991391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:08.991607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.013209 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.013339 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.013488 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.013577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.013654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.013730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.013875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.013961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.014091 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.014180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.014305 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.014392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.014519 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.014614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.026178 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.026303 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.039532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.039708 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.039817 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.039934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.040023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.040178 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.040266 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.040396 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.040497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.040610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.040712 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.040881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82237) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.041044 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.041044 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82236) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:29:09.057715 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.057923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:29:09.058270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.058404 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.058556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:29:09.058704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:29:09.058839 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.058972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.059109 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.059236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:29:09.059378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.059509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.059639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.059768 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.059898 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.060069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.069150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.069431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.069655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.069785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.069919 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.070068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.070199 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.070461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.076935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.077414 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.080364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.080655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.080830 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.080981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.081108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.081249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.081379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.081507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.081661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.081792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.081946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.082084 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.082227 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.082358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.082485 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.082634 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.082771 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.082900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.083029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.083157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.083285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.083479 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.106280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.106628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.107752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.108036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.108194 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.108385 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.113185 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.113343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.113480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.113612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.113760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.113910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.120196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.120346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.120495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.120648 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.124473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.124611 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.124774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.124905 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.125061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.125221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.125363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.125492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.125621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.125749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.125978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.126253 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.126530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.127642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.127944 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.128259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.144778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.145073 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.147030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.147318 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.148979 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.151199 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.152663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.152927 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.154445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.154974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.157778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.160987 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.163512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.164239 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.164544 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.164836 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.165136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.165432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.165730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.166701 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.169890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.170187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.170476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.170761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.171040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.171428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.181927 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.182221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.182496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.182776 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.187487 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.188308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.188578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.188840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.190224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.191760 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.193359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.193640 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.195544 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.196319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.196612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.197015 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.197248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.197334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.197597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.198793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.199071 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.201724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.202027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.202306 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.202584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.202875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.209566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.209858 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.210243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.210532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.210823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.211109 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.211406 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.214728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.215014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.215306 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.215586 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.215869 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.216169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.216462 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.226902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.229853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.231829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.232769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.234209 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.234896 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.235915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.236227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.236523 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.237799 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.239227 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.240733 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.241025 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.241322 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.242906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.244423 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.247436 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.247735 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.247822 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.248023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.248329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.249275 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.252737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.253039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.253366 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.253601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.256710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.257001 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.257287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.261580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.261872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.262154 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.264230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82237) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.264519 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.264806 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.265090 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.265365 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.265649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.266465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.266972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.267263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.267562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.267837 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.268118 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.268391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.268668 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82237) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.269584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82236) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:29:09.269870 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.270154 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.270428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.270697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.270973 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.271248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.271523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.271801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.272107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.272380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.272639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.272901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.273173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82236) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:29:09.303107 dv-cinder-854269-4-smb devstack@keystone.service[82237]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5613ae6129c0 pid: 82237 (default app) Aug 29 22:29:09.306359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53118686-4305-437a-a76d-16aa05f48ace None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:09.306644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53118686-4305-437a-a76d-16aa05f48ace None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:09.306920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53118686-4305-437a-a76d-16aa05f48ace None None] PATH_INFO: `/v3` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:09.307021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5613ae6129c0 pid: 82236 (default app) Aug 29 22:29:09.311191 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Mon Aug 29 22:29:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:16.727202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd923-6e4c-4b0c-8382-b142bd1da3b7 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:16.727714 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd923-6e4c-4b0c-8382-b142bd1da3b7 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:16.727825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd923-6e4c-4b0c-8382-b142bd1da3b7 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:16.731973 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:16.737454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c27f3-1f57-4542-9b22-7032dc167c7f None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:16.737909 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c27f3-1f57-4542-9b22-7032dc167c7f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:16.738004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c27f3-1f57-4542-9b22-7032dc167c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:16.808977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: INFO dbcounter [None req-732c27f3-1f57-4542-9b22-7032dc167c7f None None] Registered counter for database keystone Aug 29 22:29:16.829213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG oslo_db.sqlalchemy.engines [None req-732c27f3-1f57-4542-9b22-7032dc167c7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82237) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:29:16.835458 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writer thread running {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:29:17.013878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG passlib.handlers.bcrypt [None req-732c27f3-1f57-4542-9b22-7032dc167c7f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82237) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 22:29:17.014160 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG passlib.handlers.bcrypt [None req-732c27f3-1f57-4542-9b22-7032dc167c7f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82237) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 22:29:17.076775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-732c27f3-1f57-4542-9b22-7032dc167c7f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:17.084941 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-732c27f3-1f57-4542-9b22-7032dc167c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:17.207194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 22:29:17.700275 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dd923-6e4c-4b0c-8382-b142bd1da3b7 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:17.770889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: INFO dbcounter [None req-770dd923-6e4c-4b0c-8382-b142bd1da3b7 None None] Registered counter for database keystone Aug 29 22:29:17.792787 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG oslo_db.sqlalchemy.engines [None req-770dd923-6e4c-4b0c-8382-b142bd1da3b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82236) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:29:17.799883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writer thread running {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:29:17.920205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dd923-6e4c-4b0c-8382-b142bd1da3b7 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:17.925284 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e01be-025a-4518-972a-d3b0b2ff5dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:17.925925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e01be-025a-4518-972a-d3b0b2ff5dbe admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:17.926206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e01be-025a-4518-972a-d3b0b2ff5dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:17.927284 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e01be-025a-4518-972a-d3b0b2ff5dbe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:17.935043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e01be-025a-4518-972a-d3b0b2ff5dbe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:17.987103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b65e01be-025a-4518-972a-d3b0b2ff5dbe admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 22:29:17.987445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e01be-025a-4518-972a-d3b0b2ff5dbe admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:17.997713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Aug 29 22:29:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:29:18.004364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c27f3-1f57-4542-9b22-7032dc167c7f None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:18.020079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c27f3-1f57-4542-9b22-7032dc167c7f None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:18.024623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545df98-02f8-400b-a8f8-f595e699549c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:18.025714 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545df98-02f8-400b-a8f8-f595e699549c admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:18.025998 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545df98-02f8-400b-a8f8-f595e699549c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:18.026275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545df98-02f8-400b-a8f8-f595e699549c admin admin] PATH_INFO: `/v3/projects/acc9b26755b04e9387ec6536e491c79d` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:18.027993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545df98-02f8-400b-a8f8-f595e699549c admin admin] RBAC: Authorizing `identity:get_project(project_id=acc9b26755b04e9387ec6536e491c79d)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:18.081756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2545df98-02f8-400b-a8f8-f595e699549c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 22:29:18.082096 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545df98-02f8-400b-a8f8-f595e699549c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:18.086686 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 3/5] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Aug 29 22:29:18 2022] GET /identity/v3/projects/acc9b26755b04e9387ec6536e491c79d => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:29:19.972183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555bb2f-9032-4c57-a3e5-d937e443d3af None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:19.972671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555bb2f-9032-4c57-a3e5-d937e443d3af None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:19.972671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555bb2f-9032-4c57-a3e5-d937e443d3af None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:19.976754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 3/6] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:29:19.982292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef2a0d-0a63-4bc8-845d-32bca0b7f73f None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:19.982703 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef2a0d-0a63-4bc8-845d-32bca0b7f73f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:19.982880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef2a0d-0a63-4bc8-845d-32bca0b7f73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:20.003875 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-8eef2a0d-0a63-4bc8-845d-32bca0b7f73f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:20.005472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8eef2a0d-0a63-4bc8-845d-32bca0b7f73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:20.013362 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 29 22:29:20.280982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555bb2f-9032-4c57-a3e5-d937e443d3af None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:20.292952 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555bb2f-9032-4c57-a3e5-d937e443d3af None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:20.297099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718925f-1375-41be-9a4b-dedb9b36cea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:20.297699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718925f-1375-41be-9a4b-dedb9b36cea9 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:20.298000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718925f-1375-41be-9a4b-dedb9b36cea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:20.298274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718925f-1375-41be-9a4b-dedb9b36cea9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:20.306165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718925f-1375-41be-9a4b-dedb9b36cea9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:20.307933 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718925f-1375-41be-9a4b-dedb9b36cea9 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:20.317721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Aug 29 22:29:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:29:20.324344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef2a0d-0a63-4bc8-845d-32bca0b7f73f None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:20.338204 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef2a0d-0a63-4bc8-845d-32bca0b7f73f None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:20.342604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84316af3-b64f-4496-83ae-fd8087633de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:20.343244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84316af3-b64f-4496-83ae-fd8087633de1 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:20.343523 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84316af3-b64f-4496-83ae-fd8087633de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:20.343797 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84316af3-b64f-4496-83ae-fd8087633de1 admin admin] PATH_INFO: `/v3/users/2047940dbd8547dfbf3a3e01e9cedc83` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:20.345153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84316af3-b64f-4496-83ae-fd8087633de1 admin admin] RBAC: Authorizing `identity:get_user(user_id=2047940dbd8547dfbf3a3e01e9cedc83)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:20.346989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84316af3-b64f-4496-83ae-fd8087633de1 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:20.348592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 5/9] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Aug 29 22:29:20 2022] GET /identity/v3/users/2047940dbd8547dfbf3a3e01e9cedc83 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:22.324711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d9b56-ecd4-4a66-a8df-82c52b903539 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:22.325325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d9b56-ecd4-4a66-a8df-82c52b903539 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:22.325325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d9b56-ecd4-4a66-a8df-82c52b903539 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:22.326606 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:22.332359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b980de-6fc7-4798-a074-91340f17b882 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:22.333114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b980de-6fc7-4798-a074-91340f17b882 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:22.333114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b980de-6fc7-4798-a074-91340f17b882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:22.351363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-53b980de-6fc7-4798-a074-91340f17b882 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:22.352571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-53b980de-6fc7-4798-a074-91340f17b882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:22.403057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0ec5-7f86-4ad1-88b9-7e452e557fbe None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:22.403465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0ec5-7f86-4ad1-88b9-7e452e557fbe None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:22.403752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0ec5-7f86-4ad1-88b9-7e452e557fbe None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:22.405114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 6/11] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:29:22.410936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649d73a-b114-4e2d-8251-0be09b9dcfbe None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:22.411297 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649d73a-b114-4e2d-8251-0be09b9dcfbe None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:22.411651 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649d73a-b114-4e2d-8251-0be09b9dcfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:22.432822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 6/12] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:22.453909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG passlib.handlers.bcrypt [None req-9649d73a-b114-4e2d-8251-0be09b9dcfbe None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82236) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 22:29:22.454921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG passlib.handlers.bcrypt [None req-9649d73a-b114-4e2d-8251-0be09b9dcfbe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82236) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 22:29:22.503881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-9649d73a-b114-4e2d-8251-0be09b9dcfbe None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:22.505508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9649d73a-b114-4e2d-8251-0be09b9dcfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:22.608130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 7/13] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:29:22.701223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b980de-6fc7-4798-a074-91340f17b882 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:22.725624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:22.812592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b980de-6fc7-4798-a074-91340f17b882 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:22.847478 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b01f4-1029-4be0-b978-01785f0913b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:22.848037 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b01f4-1029-4be0-b978-01785f0913b0 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:22.848363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b01f4-1029-4be0-b978-01785f0913b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:22.848641 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b01f4-1029-4be0-b978-01785f0913b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:22.860196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b01f4-1029-4be0-b978-01785f0913b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-789b01f4-1029-4be0-b978-01785f0913b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:22.868730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:22.869795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:22.870744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:22.870744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:22.870744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:22.870744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:22.870744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:22.870744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:22.870744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:22.870744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:22.870744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:22.870744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:22.870744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:22.870744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:29:22.870744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 7/14] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:29:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:22.875743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649d73a-b114-4e2d-8251-0be09b9dcfbe None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:22.878033 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b01f4-1029-4be0-b978-01785f0913b0 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:22.959630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:22.977287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b01f4-1029-4be0-b978-01785f0913b0 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:22.979385 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649d73a-b114-4e2d-8251-0be09b9dcfbe None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:22.981750 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:23.013856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df233493-c433-46ce-8ef4-54532716d9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:23.014755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df233493-c433-46ce-8ef4-54532716d9f0 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:23.015038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df233493-c433-46ce-8ef4-54532716d9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:23.015315 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df233493-c433-46ce-8ef4-54532716d9f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:23.018919 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29311a-046a-41fa-80f3-0bf80028311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:23.019783 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29311a-046a-41fa-80f3-0bf80028311e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:23.020067 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29311a-046a-41fa-80f3-0bf80028311e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:23.020366 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29311a-046a-41fa-80f3-0bf80028311e None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:23.021194 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29311a-046a-41fa-80f3-0bf80028311e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:23.021495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29311a-046a-41fa-80f3-0bf80028311e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:23.023027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29311a-046a-41fa-80f3-0bf80028311e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:23.035974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 8/15] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:23.041522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29311a-046a-41fa-80f3-0bf80028311e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:23.084752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df233493-c433-46ce-8ef4-54532716d9f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:23.086247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df233493-c433-46ce-8ef4-54532716d9f0 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:23.142090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29311a-046a-41fa-80f3-0bf80028311e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:23.170005 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:23.177533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d26521-723d-468e-ac4f-49fa08b28364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:23.178394 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d26521-723d-468e-ac4f-49fa08b28364 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:23.178676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d26521-723d-468e-ac4f-49fa08b28364 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:23.178958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d26521-723d-468e-ac4f-49fa08b28364 None admin] PATH_INFO: `/v3/users/2047940dbd8547dfbf3a3e01e9cedc83` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:23.180538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d26521-723d-468e-ac4f-49fa08b28364 None admin] RBAC: Authorizing `identity:get_user(user_id=2047940dbd8547dfbf3a3e01e9cedc83)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:23.188197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d26521-723d-468e-ac4f-49fa08b28364 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:23.188197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 9/16] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:23 2022] GET /identity/v3/users/2047940dbd8547dfbf3a3e01e9cedc83 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:29:23.192120 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 8/17] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:29:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 22:29:23.192280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d26521-723d-468e-ac4f-49fa08b28364 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:23.194521 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df233493-c433-46ce-8ef4-54532716d9f0 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:23.223822 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:23.288826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d26521-723d-468e-ac4f-49fa08b28364 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:23.293995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df233493-c433-46ce-8ef4-54532716d9f0 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:23.322930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd7e03-9b20-4c13-801f-9128b1a9a870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:23.323569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd7e03-9b20-4c13-801f-9128b1a9a870 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:23.323848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd7e03-9b20-4c13-801f-9128b1a9a870 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:23.324158 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd7e03-9b20-4c13-801f-9128b1a9a870 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:23.325330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd7e03-9b20-4c13-801f-9128b1a9a870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:23.326755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd7e03-9b20-4c13-801f-9128b1a9a870 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:23.328463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 10/18] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:29:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:29:23.329815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91f2a2-08fb-49d8-8b94-3c9097be47e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:23.330462 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91f2a2-08fb-49d8-8b94-3c9097be47e0 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:23.330744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91f2a2-08fb-49d8-8b94-3c9097be47e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:23.331022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91f2a2-08fb-49d8-8b94-3c9097be47e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:23.336447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd7e03-9b20-4c13-801f-9128b1a9a870 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:23.341742 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91f2a2-08fb-49d8-8b94-3c9097be47e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:23.343218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91f2a2-08fb-49d8-8b94-3c9097be47e0 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-be91f2a2-08fb-49d8-8b94-3c9097be47e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:29:23.359691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:23.360970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:29:23.361926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:29:23.361926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:29:23.361926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:29:23.361926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 9/19] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:29:23.366610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91f2a2-08fb-49d8-8b94-3c9097be47e0 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:23.403693 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:23.438783 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd7e03-9b20-4c13-801f-9128b1a9a870 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:23.440309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:23.468923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91f2a2-08fb-49d8-8b94-3c9097be47e0 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:23.474273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62476b1d-783e-4e29-ac30-249d18bc72cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:23.475199 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62476b1d-783e-4e29-ac30-249d18bc72cd None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:23.475481 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62476b1d-783e-4e29-ac30-249d18bc72cd None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:23.475979 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62476b1d-783e-4e29-ac30-249d18bc72cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:23.478123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62476b1d-783e-4e29-ac30-249d18bc72cd None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.domain.id=default, user.id=2047940dbd8547dfbf3a3e01e9cedc83) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:23.478437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62476b1d-783e-4e29-ac30-249d18bc72cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:23.479922 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62476b1d-783e-4e29-ac30-249d18bc72cd None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:23.490975 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 11/20] 10.222.0.62 () {56 vars in 1322 bytes} [Mon Aug 29 22:29:23 2022] GET /identity/v3/role_assignments?user.id=2047940dbd8547dfbf3a3e01e9cedc83&scope.domain.id=default&role.id=a7d59d2982de4bfeb758dce70808029f => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:29:23.509111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331de55-859d-4d3b-bcbb-1094e4e420cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:23.509925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331de55-859d-4d3b-bcbb-1094e4e420cc None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:23.510205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331de55-859d-4d3b-bcbb-1094e4e420cc None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:23.510479 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331de55-859d-4d3b-bcbb-1094e4e420cc None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:23.511150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331de55-859d-4d3b-bcbb-1094e4e420cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:23.511451 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331de55-859d-4d3b-bcbb-1094e4e420cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:23.512929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331de55-859d-4d3b-bcbb-1094e4e420cc None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:23.534086 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 10/21] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:29:25.665105 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dafe6-b8e7-4a4e-8713-033e4ed8fc61 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:25.666076 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dafe6-b8e7-4a4e-8713-033e4ed8fc61 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:25.666566 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dafe6-b8e7-4a4e-8713-033e4ed8fc61 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:25.668170 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 12/22] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:25.674508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f658d-b6e9-4ef4-bde3-471f4b7092ce None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:25.675366 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f658d-b6e9-4ef4-bde3-471f4b7092ce None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:25.675841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f658d-b6e9-4ef4-bde3-471f4b7092ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:25.697136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-5c4f658d-b6e9-4ef4-bde3-471f4b7092ce None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:25.698345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-5c4f658d-b6e9-4ef4-bde3-471f4b7092ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:25.787165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 11/23] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:25.847855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d679f-ccbf-4e1f-a5cb-bd5b54a17c8b None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:25.848512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d679f-ccbf-4e1f-a5cb-bd5b54a17c8b None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:25.849016 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d679f-ccbf-4e1f-a5cb-bd5b54a17c8b None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:25.850929 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:25.863103 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d64952-501f-4d6c-b558-90e03d7dac2f None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:25.863396 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d64952-501f-4d6c-b558-90e03d7dac2f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:25.863681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d64952-501f-4d6c-b558-90e03d7dac2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:25.893847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-61d64952-501f-4d6c-b558-90e03d7dac2f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:25.895047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-61d64952-501f-4d6c-b558-90e03d7dac2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:25.920464 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:25.995728 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 12/25] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:26.208265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb2c77-8690-44ce-8411-2c544e6f2334 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:26.208912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb2c77-8690-44ce-8411-2c544e6f2334 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:26.209417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb2c77-8690-44ce-8411-2c544e6f2334 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:26.211296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 14/26] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:26.217056 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c8e08-5ed7-4e56-a729-a5d01082f43d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:26.217342 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c8e08-5ed7-4e56-a729-a5d01082f43d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:26.217613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c8e08-5ed7-4e56-a729-a5d01082f43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:26.245271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-664c8e08-5ed7-4e56-a729-a5d01082f43d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:26.246516 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-664c8e08-5ed7-4e56-a729-a5d01082f43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:26.263390 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb2c77-8690-44ce-8411-2c544e6f2334 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:26.341372 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 13/27] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:26.363115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f22e9-1f40-4817-ac4b-678a6334250e None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:26.363409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f22e9-1f40-4817-ac4b-678a6334250e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:26.363656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f22e9-1f40-4817-ac4b-678a6334250e None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:26.365377 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 14/28] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:26.370681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab791e18-eb9a-4b1b-8cc7-01f7c42206b7 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:26.370966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab791e18-eb9a-4b1b-8cc7-01f7c42206b7 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:26.371241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab791e18-eb9a-4b1b-8cc7-01f7c42206b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:26.406143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ab791e18-eb9a-4b1b-8cc7-01f7c42206b7 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:26.408223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ab791e18-eb9a-4b1b-8cc7-01f7c42206b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:26.474173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb2c77-8690-44ce-8411-2c544e6f2334 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:26.536965 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4df5bf-eecd-4b2c-bc9c-db3f75796a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:26.537998 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4df5bf-eecd-4b2c-bc9c-db3f75796a49 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:26.538479 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4df5bf-eecd-4b2c-bc9c-db3f75796a49 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:26.538992 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4df5bf-eecd-4b2c-bc9c-db3f75796a49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:26.547444 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 15/29] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:29:26.564618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4df5bf-eecd-4b2c-bc9c-db3f75796a49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-5c4df5bf-eecd-4b2c-bc9c-db3f75796a49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:26.573654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:26.574504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:26.575369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:26.575369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:26.575369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:26.575369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:26.575369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:26.575369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:26.575369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:26.575369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:26.575369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:26.575369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:26.575369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:26.575369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:29:26.577706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 15/30] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:29:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:26.585054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab791e18-eb9a-4b1b-8cc7-01f7c42206b7 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:26.616009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:26.720627 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4df5bf-eecd-4b2c-bc9c-db3f75796a49 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:26.772689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:26.806607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab791e18-eb9a-4b1b-8cc7-01f7c42206b7 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:26.858236 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643819c-bcbe-4b77-9197-709dfb51228e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:26.858856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643819c-bcbe-4b77-9197-709dfb51228e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:26.859138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643819c-bcbe-4b77-9197-709dfb51228e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:26.859414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643819c-bcbe-4b77-9197-709dfb51228e None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:26.860188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643819c-bcbe-4b77-9197-709dfb51228e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:26.860504 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643819c-bcbe-4b77-9197-709dfb51228e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:26.861905 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643819c-bcbe-4b77-9197-709dfb51228e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:26.887867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 16/31] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:26.888740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643819c-bcbe-4b77-9197-709dfb51228e None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:26.897547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4df5bf-eecd-4b2c-bc9c-db3f75796a49 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:26.960594 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d450141-0f38-4b91-9c75-48f6d9cfc970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:26.961640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d450141-0f38-4b91-9c75-48f6d9cfc970 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:26.962134 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d450141-0f38-4b91-9c75-48f6d9cfc970 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:26.962610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d450141-0f38-4b91-9c75-48f6d9cfc970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:26.984609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d450141-0f38-4b91-9c75-48f6d9cfc970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:26.986555 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d450141-0f38-4b91-9c75-48f6d9cfc970 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:27.004277 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-6d450141-0f38-4b91-9c75-48f6d9cfc970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:29:27.005794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:27.006631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:29:27.007452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:29:27.007452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:29:27.007452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:29:27.009510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 16/32] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:29:27.010727 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d450141-0f38-4b91-9c75-48f6d9cfc970 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:27.031287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643819c-bcbe-4b77-9197-709dfb51228e None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:27.069254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff4a9d-0f4d-40ec-8e3e-1227a35d43bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:27.070189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff4a9d-0f4d-40ec-8e3e-1227a35d43bd None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:27.070680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff4a9d-0f4d-40ec-8e3e-1227a35d43bd None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:27.071150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff4a9d-0f4d-40ec-8e3e-1227a35d43bd None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:27.071996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff4a9d-0f4d-40ec-8e3e-1227a35d43bd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:27.073585 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff4a9d-0f4d-40ec-8e3e-1227a35d43bd None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:27.105215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:27.129958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d450141-0f38-4b91-9c75-48f6d9cfc970 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:27.170179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cbd4e-78b7-4862-af09-16cd5bdbccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:27.171177 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cbd4e-78b7-4862-af09-16cd5bdbccbc None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:27.171683 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cbd4e-78b7-4862-af09-16cd5bdbccbc None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:27.172215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cbd4e-78b7-4862-af09-16cd5bdbccbc None admin] PATH_INFO: `/v3/users/2047940dbd8547dfbf3a3e01e9cedc83` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:27.173656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757cbd4e-78b7-4862-af09-16cd5bdbccbc None admin] RBAC: Authorizing `identity:get_user(user_id=2047940dbd8547dfbf3a3e01e9cedc83)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:27.182817 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757cbd4e-78b7-4862-af09-16cd5bdbccbc None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:27.182817 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 17/33] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:27 2022] GET /identity/v3/users/2047940dbd8547dfbf3a3e01e9cedc83 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:27.182817 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cbd4e-78b7-4862-af09-16cd5bdbccbc None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:27.272122 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 17/34] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Aug 29 22:29:26 2022] POST /identity/v3/roles => generated 225 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:27.272122 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff4a9d-0f4d-40ec-8e3e-1227a35d43bd None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:27.297174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cbd4e-78b7-4862-af09-16cd5bdbccbc None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:27.352148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fe893-502b-41f0-bd08-8aac08f39c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:27.353147 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fe893-502b-41f0-bd08-8aac08f39c24 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:27.353439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fe893-502b-41f0-bd08-8aac08f39c24 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:27.353718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fe893-502b-41f0-bd08-8aac08f39c24 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:27.354678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fe893-502b-41f0-bd08-8aac08f39c24 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:27.357237 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fe893-502b-41f0-bd08-8aac08f39c24 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:27.389804 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff4a9d-0f4d-40ec-8e3e-1227a35d43bd None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:27.429740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3d412-9524-4eab-aa3e-eb2c86e7e7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:27.430813 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3d412-9524-4eab-aa3e-eb2c86e7e7bf None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:27.431318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3d412-9524-4eab-aa3e-eb2c86e7e7bf None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:27.431804 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3d412-9524-4eab-aa3e-eb2c86e7e7bf None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:27.432700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3d412-9524-4eab-aa3e-eb2c86e7e7bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:27.433221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3d412-9524-4eab-aa3e-eb2c86e7e7bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:27.434893 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3d412-9524-4eab-aa3e-eb2c86e7e7bf None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:27.439935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:27.453140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 18/35] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:27.453140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3d412-9524-4eab-aa3e-eb2c86e7e7bf None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:27.546964 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 18/36] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Aug 29 22:29:27 2022] POST /identity/v3/roles => generated 219 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:27.567215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadef11a-b6b9-4518-a019-6daf18390559 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:27.567215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadef11a-b6b9-4518-a019-6daf18390559 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:27.567215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadef11a-b6b9-4518-a019-6daf18390559 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:27.567215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 19/37] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:27.567215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadef11a-b6b9-4518-a019-6daf18390559 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:27.567215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:27.574686 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3d412-9524-4eab-aa3e-eb2c86e7e7bf None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:27.623106 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74c764-3d74-47f8-b7bb-25a1ec289e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:27.623770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c764-3d74-47f8-b7bb-25a1ec289e88 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:27.624048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c764-3d74-47f8-b7bb-25a1ec289e88 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:27.624355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c764-3d74-47f8-b7bb-25a1ec289e88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:27.625682 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74c764-3d74-47f8-b7bb-25a1ec289e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:27.627149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74c764-3d74-47f8-b7bb-25a1ec289e88 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:27.628864 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 19/38] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:29:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:27.633903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146605b-4ed0-4a6a-9bc0-bd661196c609 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:27.634203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146605b-4ed0-4a6a-9bc0-bd661196c609 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:27.634752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146605b-4ed0-4a6a-9bc0-bd661196c609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:27.691049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadef11a-b6b9-4518-a019-6daf18390559 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:27.731720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5608909-f08e-4091-966e-c10bf3a4fa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:27.732469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5608909-f08e-4091-966e-c10bf3a4fa80 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:27.732708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5608909-f08e-4091-966e-c10bf3a4fa80 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:27.732946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5608909-f08e-4091-966e-c10bf3a4fa80 None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:27.733589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5608909-f08e-4091-966e-c10bf3a4fa80 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:27.735774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5608909-f08e-4091-966e-c10bf3a4fa80 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:27.771666 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-2146605b-4ed0-4a6a-9bc0-bd661196c609 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:27.773265 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2146605b-4ed0-4a6a-9bc0-bd661196c609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:27.830972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 20/39] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 29 22:29:27 2022] POST /identity/v3/projects => generated 301 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:27.832282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f974d6a-249a-40ae-89f3-0926ab83e628 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:27.832589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f974d6a-249a-40ae-89f3-0926ab83e628 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:27.832874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f974d6a-249a-40ae-89f3-0926ab83e628 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:27.834108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 21/40] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:27.834818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f974d6a-249a-40ae-89f3-0926ab83e628 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:27.843527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:27.853806 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 20/41] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:27.855111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6156750-50ea-4b67-8be5-67b69f5172e5 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:27.855409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6156750-50ea-4b67-8be5-67b69f5172e5 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:27.855696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6156750-50ea-4b67-8be5-67b69f5172e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:27.883158 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-a6156750-50ea-4b67-8be5-67b69f5172e5 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:27.884419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a6156750-50ea-4b67-8be5-67b69f5172e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:27.933278 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:27.971228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 21/42] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:27.987765 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f974d6a-249a-40ae-89f3-0926ab83e628 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:28.027129 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ac94c-46e5-441c-954d-226a9a277fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:28.027864 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ac94c-46e5-441c-954d-226a9a277fc0 None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:28.028183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ac94c-46e5-441c-954d-226a9a277fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:28.028476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ac94c-46e5-441c-954d-226a9a277fc0 None admin] PATH_INFO: `/v3/domains/default/users/2047940dbd8547dfbf3a3e01e9cedc83/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:28.032594 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ac94c-46e5-441c-954d-226a9a277fc0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2047940dbd8547dfbf3a3e01e9cedc83, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:28.034061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ac94c-46e5-441c-954d-226a9a277fc0 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:28.130887 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6156750-50ea-4b67-8be5-67b69f5172e5 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:28.144224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 22/43] 10.222.0.62 () {58 vars in 1361 bytes} [Mon Aug 29 22:29:27 2022] PUT /identity/v3/domains/default/users/2047940dbd8547dfbf3a3e01e9cedc83/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:28.244489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ac94c-46e5-441c-954d-226a9a277fc0 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:28.252792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6156750-50ea-4b67-8be5-67b69f5172e5 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:28.283628 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:28.296306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd10a3-dd64-488a-b951-303f7d7ecb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:28.296934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd10a3-dd64-488a-b951-303f7d7ecb81 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:28.297267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd10a3-dd64-488a-b951-303f7d7ecb81 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:28.297586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd10a3-dd64-488a-b951-303f7d7ecb81 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:28.298262 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd10a3-dd64-488a-b951-303f7d7ecb81 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:28.299938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd10a3-dd64-488a-b951-303f7d7ecb81 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:28.361326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ac94c-46e5-441c-954d-226a9a277fc0 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:28.368257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 22/44] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Aug 29 22:29:28 2022] POST /identity/v3/roles => generated 223 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:29:28.384657 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:28.405026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce71d0-dfdc-4ff1-8211-a806c6b398b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:28.405850 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce71d0-dfdc-4ff1-8211-a806c6b398b1 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:28.406372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce71d0-dfdc-4ff1-8211-a806c6b398b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:28.406723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce71d0-dfdc-4ff1-8211-a806c6b398b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:28.408070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce71d0-dfdc-4ff1-8211-a806c6b398b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:28.409711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce71d0-dfdc-4ff1-8211-a806c6b398b1 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:28.411757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 23/45] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:29:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:28.417410 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd10a3-dd64-488a-b951-303f7d7ecb81 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:28.540386 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd10a3-dd64-488a-b951-303f7d7ecb81 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:28.577588 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d5b9b-9cca-4faf-bdbe-cedcb7817281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:28.578217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d5b9b-9cca-4faf-bdbe-cedcb7817281 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:28.578497 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d5b9b-9cca-4faf-bdbe-cedcb7817281 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:28.578775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d5b9b-9cca-4faf-bdbe-cedcb7817281 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:28.579447 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d5b9b-9cca-4faf-bdbe-cedcb7817281 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:28.580951 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d5b9b-9cca-4faf-bdbe-cedcb7817281 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:28.671426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 23/46] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 29 22:29:28 2022] POST /identity/v3/projects => generated 312 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:30.065155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59730d3-b700-44a3-9c7c-bce7575a32a5 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:30.065647 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59730d3-b700-44a3-9c7c-bce7575a32a5 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:30.065729 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59730d3-b700-44a3-9c7c-bce7575a32a5 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:30.067056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 24/47] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:30.072323 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b001e-821b-451c-ab73-115e4c11f441 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:30.072743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b001e-821b-451c-ab73-115e4c11f441 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:30.072965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b001e-821b-451c-ab73-115e4c11f441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:30.091012 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-7a4b001e-821b-451c-ab73-115e4c11f441 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:30.092253 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-7a4b001e-821b-451c-ab73-115e4c11f441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:30.122103 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:30.163227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 24/48] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:30.428523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59730d3-b700-44a3-9c7c-bce7575a32a5 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:30.532645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59730d3-b700-44a3-9c7c-bce7575a32a5 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:30.566612 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88645f8d-1ee8-4751-964b-772c62745a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:30.567246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88645f8d-1ee8-4751-964b-772c62745a4f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:30.567531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88645f8d-1ee8-4751-964b-772c62745a4f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:30.567811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88645f8d-1ee8-4751-964b-772c62745a4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:30.577833 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88645f8d-1ee8-4751-964b-772c62745a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-88645f8d-1ee8-4751-964b-772c62745a4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:30.583700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:30.584672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:30.585516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:30.585516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:30.585516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:30.585516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:30.585516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:30.585516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:30.585516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:30.585516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:30.585516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:30.585516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:30.585516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:30.585516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:29:30.585516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 25/49] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:29:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:30.590620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b001e-821b-451c-ab73-115e4c11f441 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:30.602433 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f83f4-5ac0-416e-9506-d78ef95e97f8 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:30.602720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f83f4-5ac0-416e-9506-d78ef95e97f8 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:30.602996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f83f4-5ac0-416e-9506-d78ef95e97f8 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:30.604585 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 26/50] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:30.609377 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319c2c1-891f-40a3-b0b5-b656a9e2872f None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:30.609661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319c2c1-891f-40a3-b0b5-b656a9e2872f None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:30.610125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319c2c1-891f-40a3-b0b5-b656a9e2872f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:30.629226 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-b319c2c1-891f-40a3-b0b5-b656a9e2872f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:30.631429 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b319c2c1-891f-40a3-b0b5-b656a9e2872f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:30.675949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:30.700434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 27/51] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:29:30.700930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b001e-821b-451c-ab73-115e4c11f441 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:30.737083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cdf61-c3bb-4077-9ac9-79ce8cc32233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:30.737701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cdf61-c3bb-4077-9ac9-79ce8cc32233 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:30.737986 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cdf61-c3bb-4077-9ac9-79ce8cc32233 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:30.738263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cdf61-c3bb-4077-9ac9-79ce8cc32233 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:30.738935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cdf61-c3bb-4077-9ac9-79ce8cc32233 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:30.739242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cdf61-c3bb-4077-9ac9-79ce8cc32233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:30.740707 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cdf61-c3bb-4077-9ac9-79ce8cc32233 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:30.749041 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 25/52] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:30.754619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319c2c1-891f-40a3-b0b5-b656a9e2872f None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:30.854484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319c2c1-891f-40a3-b0b5-b656a9e2872f None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:30.893158 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703b73c-2bc5-4369-8315-e87f236523f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:30.893792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703b73c-2bc5-4369-8315-e87f236523f4 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:30.894072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703b73c-2bc5-4369-8315-e87f236523f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:30.894347 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703b73c-2bc5-4369-8315-e87f236523f4 None admin] PATH_INFO: `/v3/users/2047940dbd8547dfbf3a3e01e9cedc83` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:30.895502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703b73c-2bc5-4369-8315-e87f236523f4 None admin] RBAC: Authorizing `identity:get_user(user_id=2047940dbd8547dfbf3a3e01e9cedc83)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:30.896978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703b73c-2bc5-4369-8315-e87f236523f4 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:30.898542 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 28/53] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:30 2022] GET /identity/v3/users/2047940dbd8547dfbf3a3e01e9cedc83 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:30.904080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cdf61-c3bb-4077-9ac9-79ce8cc32233 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:30.932930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:30.971367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703b73c-2bc5-4369-8315-e87f236523f4 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:31.007813 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cdf61-c3bb-4077-9ac9-79ce8cc32233 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:31.019654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:31.041230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ac502-ce57-4b88-b24d-05f56349116f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:31.041869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ac502-ce57-4b88-b24d-05f56349116f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:31.042215 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ac502-ce57-4b88-b24d-05f56349116f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:31.042499 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ac502-ce57-4b88-b24d-05f56349116f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:31.043632 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ac502-ce57-4b88-b24d-05f56349116f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:31.045123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ac502-ce57-4b88-b24d-05f56349116f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:31.046704 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 26/54] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:29:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:31.053286 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ac502-ce57-4b88-b24d-05f56349116f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:31.074632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703b73c-2bc5-4369-8315-e87f236523f4 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:31.107523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdca96-e905-4672-8aa6-0a62e671849f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:31.108195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdca96-e905-4672-8aa6-0a62e671849f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:31.108474 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdca96-e905-4672-8aa6-0a62e671849f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:31.108746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdca96-e905-4672-8aa6-0a62e671849f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:31.110528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdca96-e905-4672-8aa6-0a62e671849f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:31.111878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdca96-e905-4672-8aa6-0a62e671849f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:31.113435 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 29/55] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:29:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:29:31.118886 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdca96-e905-4672-8aa6-0a62e671849f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:31.150381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:31.156400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ac502-ce57-4b88-b24d-05f56349116f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:31.192223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5c058-c6e9-41a4-b1a3-93327fb5d1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:31.192836 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5c058-c6e9-41a4-b1a3-93327fb5d1f0 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:31.193119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5c058-c6e9-41a4-b1a3-93327fb5d1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:31.193393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5c058-c6e9-41a4-b1a3-93327fb5d1f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:31.194125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5c058-c6e9-41a4-b1a3-93327fb5d1f0 None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.domain.id=default, user.id=2047940dbd8547dfbf3a3e01e9cedc83) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:31.194496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5c058-c6e9-41a4-b1a3-93327fb5d1f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:31.195977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5c058-c6e9-41a4-b1a3-93327fb5d1f0 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:31.203166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 27/56] 10.222.0.62 () {56 vars in 1322 bytes} [Mon Aug 29 22:29:31 2022] GET /identity/v3/role_assignments?user.id=2047940dbd8547dfbf3a3e01e9cedc83&scope.domain.id=default&role.id=a7d59d2982de4bfeb758dce70808029f => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:29:31.222834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdca96-e905-4672-8aa6-0a62e671849f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:31.238494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:31.261834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f163ce-3674-4482-9954-1cb220c633ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:31.262460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f163ce-3674-4482-9954-1cb220c633ae None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:31.262742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f163ce-3674-4482-9954-1cb220c633ae None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:31.263013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f163ce-3674-4482-9954-1cb220c633ae None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:31.263670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f163ce-3674-4482-9954-1cb220c633ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:31.265192 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f163ce-3674-4482-9954-1cb220c633ae None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:31.390879 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 30/57] 10.222.0.62 () {60 vars in 1140 bytes} [Mon Aug 29 22:29:31 2022] POST /identity/v3/projects => generated 298 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:29:33.315840 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc92dc-a167-49df-8590-c81f2ecf975b None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:33.316421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc92dc-a167-49df-8590-c81f2ecf975b None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:33.316421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc92dc-a167-49df-8590-c81f2ecf975b None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:33.317779 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 28/58] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:33.322970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ecfe0-03e2-4d18-954b-4da27989b29c None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:33.323370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ecfe0-03e2-4d18-954b-4da27989b29c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:33.323579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ecfe0-03e2-4d18-954b-4da27989b29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:33.342737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d70ecfe0-03e2-4d18-954b-4da27989b29c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:33.343914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d70ecfe0-03e2-4d18-954b-4da27989b29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:33.512946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 31/59] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:33.781207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc92dc-a167-49df-8590-c81f2ecf975b None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:33.883373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc92dc-a167-49df-8590-c81f2ecf975b None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:33.916324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f049b-e065-42b3-8162-d1ac42c1d47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:33.916957 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f049b-e065-42b3-8162-d1ac42c1d47f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:33.917243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f049b-e065-42b3-8162-d1ac42c1d47f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:33.917524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f049b-e065-42b3-8162-d1ac42c1d47f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:33.918644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f049b-e065-42b3-8162-d1ac42c1d47f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:33.920136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f049b-e065-42b3-8162-d1ac42c1d47f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:33.921693 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 29/60] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:29:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:33.928272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ecfe0-03e2-4d18-954b-4da27989b29c None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:34.019129 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:34.026036 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ecfe0-03e2-4d18-954b-4da27989b29c None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:34.060583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df082610-cc98-4e84-92ce-695f23fecb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:34.061195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df082610-cc98-4e84-92ce-695f23fecb4c None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:34.061480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df082610-cc98-4e84-92ce-695f23fecb4c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:34.061758 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df082610-cc98-4e84-92ce-695f23fecb4c None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:34.062400 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df082610-cc98-4e84-92ce-695f23fecb4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:34.063878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df082610-cc98-4e84-92ce-695f23fecb4c None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:34.149102 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 32/61] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:29:33 2022] POST /identity/v3/users => generated 275 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:37.285722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995719ed-dad7-4d08-bb56-c23815c58573 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:37.286236 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995719ed-dad7-4d08-bb56-c23815c58573 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:37.286308 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995719ed-dad7-4d08-bb56-c23815c58573 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.287608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 30/62] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:37.293207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfcb0e-672c-4c2d-88ad-1e5dffbd83a9 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:37.293714 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfcb0e-672c-4c2d-88ad-1e5dffbd83a9 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:37.293791 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfcb0e-672c-4c2d-88ad-1e5dffbd83a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.316884 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58859b-381a-4bd0-8405-87994ae6e81a None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:37.317165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58859b-381a-4bd0-8405-87994ae6e81a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:37.317629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58859b-381a-4bd0-8405-87994ae6e81a None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.319109 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:29:37.320044 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-8ecfcb0e-672c-4c2d-88ad-1e5dffbd83a9 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:37.321559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8ecfcb0e-672c-4c2d-88ad-1e5dffbd83a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:37.324320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ead3d-b08d-4543-9bab-c08820640884 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:37.324810 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ead3d-b08d-4543-9bab-c08820640884 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:37.325292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ead3d-b08d-4543-9bab-c08820640884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.346448 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ad8ead3d-b08d-4543-9bab-c08820640884 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:37.347772 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ad8ead3d-b08d-4543-9bab-c08820640884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:37.374324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:37.423173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 32/64] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:29:37.425179 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c423a-c798-4c9c-bb1b-cf5a661bc0ae None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:37.425687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c423a-c798-4c9c-bb1b-cf5a661bc0ae None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:37.426148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c423a-c798-4c9c-bb1b-cf5a661bc0ae None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.427597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 33/65] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:37.429381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 33/66] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:37.444954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc6a74-0771-424b-9d6a-98b59b15f099 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:37.445746 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc6a74-0771-424b-9d6a-98b59b15f099 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:37.446097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc6a74-0771-424b-9d6a-98b59b15f099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.469665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-70cc6a74-0771-424b-9d6a-98b59b15f099 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:37.471240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-70cc6a74-0771-424b-9d6a-98b59b15f099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:37.547340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933e8ba-ed20-4a9c-af69-8b9b28aa2e68 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:37.547639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933e8ba-ed20-4a9c-af69-8b9b28aa2e68 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:37.547824 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933e8ba-ed20-4a9c-af69-8b9b28aa2e68 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.549218 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 34/67] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:29:37.554641 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543bedb-b5f6-4709-a891-cb1db5c930ea None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:37.554930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543bedb-b5f6-4709-a891-cb1db5c930ea None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:37.555206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543bedb-b5f6-4709-a891-cb1db5c930ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.559349 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 34/68] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:37.584480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-f543bedb-b5f6-4709-a891-cb1db5c930ea None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:37.585734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-f543bedb-b5f6-4709-a891-cb1db5c930ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:37.677019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 35/69] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:37.777918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc6a74-0771-424b-9d6a-98b59b15f099 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:37.792940 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543bedb-b5f6-4709-a891-cb1db5c930ea None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:37.807763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:37.928863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:37.936817 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543bedb-b5f6-4709-a891-cb1db5c930ea None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:37.950961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc6a74-0771-424b-9d6a-98b59b15f099 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:37.978740 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e52d6-b0e8-4ac3-a204-06bb32635394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:37.979734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e52d6-b0e8-4ac3-a204-06bb32635394 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:37.980341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e52d6-b0e8-4ac3-a204-06bb32635394 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:37.980822 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e52d6-b0e8-4ac3-a204-06bb32635394 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.992844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e52d6-b0e8-4ac3-a204-06bb32635394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:37.993492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58691929-b50b-461a-b4d4-c89a0a611041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:37.994129 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58691929-b50b-461a-b4d4-c89a0a611041 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:37.994411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58691929-b50b-461a-b4d4-c89a0a611041 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:37.994685 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58691929-b50b-461a-b4d4-c89a0a611041 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-309e52d6-b0e8-4ac3-a204-06bb32635394 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:37.997997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:37.998843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:37.999601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:37.999601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:37.999601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:37.999601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:37.999601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:37.999601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:37.999601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:37.999601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:37.999601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:37.999601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:37.999601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:29:37.999601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:29:37.999601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 36/70] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:29:38.001405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e52d6-b0e8-4ac3-a204-06bb32635394 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:38.008122 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58691929-b50b-461a-b4d4-c89a0a611041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-58691929-b50b-461a-b4d4-c89a0a611041 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:38.013392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:38.014269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:38.015028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:38.015028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:38.015028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:38.015028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:38.015028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:38.015028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:38.015028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:38.015028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:38.015028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:38.015028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:38.015028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:38.015028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:29:38.015616 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 35/71] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:29:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:38.016805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58691929-b50b-461a-b4d4-c89a0a611041 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:38.073955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:38.108411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e52d6-b0e8-4ac3-a204-06bb32635394 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:38.131583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58691929-b50b-461a-b4d4-c89a0a611041 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:38.145931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0d554-7929-4a94-a6b3-72bb85f7cabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:38.146578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0d554-7929-4a94-a6b3-72bb85f7cabb None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.146866 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0d554-7929-4a94-a6b3-72bb85f7cabb None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.147145 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0d554-7929-4a94-a6b3-72bb85f7cabb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.157932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0d554-7929-4a94-a6b3-72bb85f7cabb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-0db0d554-7929-4a94-a6b3-72bb85f7cabb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:38.163186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:38.164293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:38.165070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:38.165070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:38.165070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:38.165070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:38.165070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:38.165070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:38.165070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:38.165070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:38.165070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:38.165070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:38.165070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:29:38.165070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:29:38.165070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 37/72] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:29:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:38.165070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0d554-7929-4a94-a6b3-72bb85f7cabb None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:38.172005 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3db4d-3369-48ff-b193-04db801b5486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:38.172769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3db4d-3369-48ff-b193-04db801b5486 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.173048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3db4d-3369-48ff-b193-04db801b5486 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.173739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3db4d-3369-48ff-b193-04db801b5486 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.184229 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3db4d-3369-48ff-b193-04db801b5486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-73e3db4d-3369-48ff-b193-04db801b5486 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:38.189032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:38.189873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:38.190672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:38.190672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:38.190672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:38.190672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:38.190672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:38.190672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:38.190672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:38.190672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:38.190672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:38.190672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:38.190672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:29:38.190672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:29:38.190672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 36/73] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:38.191877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3db4d-3369-48ff-b193-04db801b5486 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:38.202864 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:38.266976 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0d554-7929-4a94-a6b3-72bb85f7cabb None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:38.292033 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3db4d-3369-48ff-b193-04db801b5486 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:38.299112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:38.305867 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7405b97-6de3-47f2-a7f0-3ea9a15f27d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:38.306487 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7405b97-6de3-47f2-a7f0-3ea9a15f27d0 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.306775 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7405b97-6de3-47f2-a7f0-3ea9a15f27d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.307062 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7405b97-6de3-47f2-a7f0-3ea9a15f27d0 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.307744 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7405b97-6de3-47f2-a7f0-3ea9a15f27d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:38.308063 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7405b97-6de3-47f2-a7f0-3ea9a15f27d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:38.309491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7405b97-6de3-47f2-a7f0-3ea9a15f27d0 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:38.327798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 38/74] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:29:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:38.327798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a58f10-b2fd-410f-b3c0-92ae1afa7f43 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.327798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a58f10-b2fd-410f-b3c0-92ae1afa7f43 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.327798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a58f10-b2fd-410f-b3c0-92ae1afa7f43 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.327798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 39/75] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:38.327798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a58f10-b2fd-410f-b3c0-92ae1afa7f43 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:38.332169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351780ee-e893-42bf-b45c-8b639d096ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:38.332809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351780ee-e893-42bf-b45c-8b639d096ef1 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.333096 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351780ee-e893-42bf-b45c-8b639d096ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.333375 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351780ee-e893-42bf-b45c-8b639d096ef1 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.334061 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351780ee-e893-42bf-b45c-8b639d096ef1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:38.334375 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351780ee-e893-42bf-b45c-8b639d096ef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:38.335780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351780ee-e893-42bf-b45c-8b639d096ef1 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:38.345376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 37/76] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:38.346216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351780ee-e893-42bf-b45c-8b639d096ef1 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:38.418103 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:38.435809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a58f10-b2fd-410f-b3c0-92ae1afa7f43 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:38.449780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351780ee-e893-42bf-b45c-8b639d096ef1 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:38.471557 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650eda2-102d-4575-be29-ce8dae96f957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:38.472211 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650eda2-102d-4575-be29-ce8dae96f957 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.472497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650eda2-102d-4575-be29-ce8dae96f957 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.472780 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650eda2-102d-4575-be29-ce8dae96f957 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.473464 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650eda2-102d-4575-be29-ce8dae96f957 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:38.473773 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650eda2-102d-4575-be29-ce8dae96f957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:38.475174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650eda2-102d-4575-be29-ce8dae96f957 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:38.488558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 40/77] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:29:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:38.488558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650eda2-102d-4575-be29-ce8dae96f957 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:38.488821 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb2cd0-c645-4cf9-9059-9fa9297044ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:38.488821 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb2cd0-c645-4cf9-9059-9fa9297044ad None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.488821 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb2cd0-c645-4cf9-9059-9fa9297044ad None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.488821 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb2cd0-c645-4cf9-9059-9fa9297044ad None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.489081 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb2cd0-c645-4cf9-9059-9fa9297044ad None admin] RBAC: Adding query filter params (name=member) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:38.489081 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb2cd0-c645-4cf9-9059-9fa9297044ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:38.489745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb2cd0-c645-4cf9-9059-9fa9297044ad None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:38.498333 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 38/78] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:29:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:38.500766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d961145-5805-4d8a-8ed4-e483bf5bd7c1 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.500766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d961145-5805-4d8a-8ed4-e483bf5bd7c1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.500766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d961145-5805-4d8a-8ed4-e483bf5bd7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.518853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-1d961145-5805-4d8a-8ed4-e483bf5bd7c1 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:38.520123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-1d961145-5805-4d8a-8ed4-e483bf5bd7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:38.549560 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:38.593170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 39/79] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:38.594129 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d961145-5805-4d8a-8ed4-e483bf5bd7c1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:38.600369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650eda2-102d-4575-be29-ce8dae96f957 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:38.639820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d5514-9157-4df3-b117-8d1e632eb144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:38.640493 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d5514-9157-4df3-b117-8d1e632eb144 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.640780 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d5514-9157-4df3-b117-8d1e632eb144 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.641606 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d5514-9157-4df3-b117-8d1e632eb144 None admin] PATH_INFO: `/v3/users/342fd70c02c34a39b525655b3d8d3e46` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.657123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d5514-9157-4df3-b117-8d1e632eb144 None admin] RBAC: Authorizing `identity:get_user(user_id=342fd70c02c34a39b525655b3d8d3e46)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:38.658600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d5514-9157-4df3-b117-8d1e632eb144 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:38.664930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 41/80] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:38 2022] GET /identity/v3/users/342fd70c02c34a39b525655b3d8d3e46 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:38.664930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d5514-9157-4df3-b117-8d1e632eb144 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:38.669530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:38.710424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d961145-5805-4d8a-8ed4-e483bf5bd7c1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:38.751511 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91f34c-7baa-4a32-8163-9174e4649916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:38.752215 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91f34c-7baa-4a32-8163-9174e4649916 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.752505 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91f34c-7baa-4a32-8163-9174e4649916 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.752836 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91f34c-7baa-4a32-8163-9174e4649916 None admin] PATH_INFO: `/v3/users/2047940dbd8547dfbf3a3e01e9cedc83` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.754047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91f34c-7baa-4a32-8163-9174e4649916 None admin] RBAC: Authorizing `identity:get_user(user_id=2047940dbd8547dfbf3a3e01e9cedc83)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:38.755530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91f34c-7baa-4a32-8163-9174e4649916 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:38.757387 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 40/81] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:38 2022] GET /identity/v3/users/2047940dbd8547dfbf3a3e01e9cedc83 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:38.762837 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91f34c-7baa-4a32-8163-9174e4649916 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:38.771552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d5514-9157-4df3-b117-8d1e632eb144 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:38.788229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:38.824192 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aabe7-915e-4797-afec-bc1a996dbd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:38.825802 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aabe7-915e-4797-afec-bc1a996dbd6d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.826308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aabe7-915e-4797-afec-bc1a996dbd6d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.826860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aabe7-915e-4797-afec-bc1a996dbd6d None admin] PATH_INFO: `/v3/users/342fd70c02c34a39b525655b3d8d3e46` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.829338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9aabe7-915e-4797-afec-bc1a996dbd6d None admin] RBAC: Authorizing `identity:get_user(user_id=342fd70c02c34a39b525655b3d8d3e46)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:38.832508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9aabe7-915e-4797-afec-bc1a996dbd6d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:38.835559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 42/82] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:38 2022] GET /identity/v3/users/342fd70c02c34a39b525655b3d8d3e46 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:38.836840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aabe7-915e-4797-afec-bc1a996dbd6d None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:38.883653 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91f34c-7baa-4a32-8163-9174e4649916 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:38.914933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:38.923662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be60390-9839-4b99-b700-33ac40e68945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:38.924944 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be60390-9839-4b99-b700-33ac40e68945 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.928829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be60390-9839-4b99-b700-33ac40e68945 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.928829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be60390-9839-4b99-b700-33ac40e68945 None admin] PATH_INFO: `/v3/users/342fd70c02c34a39b525655b3d8d3e46` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:38.928829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be60390-9839-4b99-b700-33ac40e68945 None admin] RBAC: Authorizing `identity:get_user(user_id=342fd70c02c34a39b525655b3d8d3e46)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:38.928829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be60390-9839-4b99-b700-33ac40e68945 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:38.930014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 41/83] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:38 2022] GET /identity/v3/users/342fd70c02c34a39b525655b3d8d3e46 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:38.930810 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be60390-9839-4b99-b700-33ac40e68945 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:38.961940 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aabe7-915e-4797-afec-bc1a996dbd6d None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:38.996829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d964e2-d872-40b3-9782-9a0ad9b6d919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:38.997446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d964e2-d872-40b3-9782-9a0ad9b6d919 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:38.997728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d964e2-d872-40b3-9782-9a0ad9b6d919 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:38.998013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d964e2-d872-40b3-9782-9a0ad9b6d919 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:39.049566 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:39.049846 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be60390-9839-4b99-b700-33ac40e68945 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:39.069009 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d964e2-d872-40b3-9782-9a0ad9b6d919 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:39.070492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d964e2-d872-40b3-9782-9a0ad9b6d919 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:39.086510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a79a3-6630-4771-ab06-469dcdf4074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:39.087188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a79a3-6630-4771-ab06-469dcdf4074b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:39.087418 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a79a3-6630-4771-ab06-469dcdf4074b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:39.087692 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a79a3-6630-4771-ab06-469dcdf4074b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:39.153814 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:39.157769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a79a3-6630-4771-ab06-469dcdf4074b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:39.159232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a79a3-6630-4771-ab06-469dcdf4074b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:39.172700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 43/84] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:29:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:29:39.173563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d964e2-d872-40b3-9782-9a0ad9b6d919 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:39.261598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:39.268721 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 42/85] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:29:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:29:39.269574 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a79a3-6630-4771-ab06-469dcdf4074b None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:39.281831 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d964e2-d872-40b3-9782-9a0ad9b6d919 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:39.322396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba648f-90e9-4b4e-9c6a-b86925047f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:39.323074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba648f-90e9-4b4e-9c6a-b86925047f4a None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:39.323289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba648f-90e9-4b4e-9c6a-b86925047f4a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:39.323572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba648f-90e9-4b4e-9c6a-b86925047f4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:39.373894 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:39.378069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a79a3-6630-4771-ab06-469dcdf4074b None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:39.392264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba648f-90e9-4b4e-9c6a-b86925047f4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:39.393885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba648f-90e9-4b4e-9c6a-b86925047f4a None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:39.413284 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb2036-8dad-4a9a-9c18-c1ecc9cf5c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:39.413921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb2036-8dad-4a9a-9c18-c1ecc9cf5c61 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:39.414206 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb2036-8dad-4a9a-9c18-c1ecc9cf5c61 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:39.414512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb2036-8dad-4a9a-9c18-c1ecc9cf5c61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:39.415632 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb2036-8dad-4a9a-9c18-c1ecc9cf5c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:39.417139 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb2036-8dad-4a9a-9c18-c1ecc9cf5c61 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:39.418713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 43/86] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:29:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:39.423387 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb2036-8dad-4a9a-9c18-c1ecc9cf5c61 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:39.476377 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:39.495424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 44/87] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:29:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:29:39.496369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba648f-90e9-4b4e-9c6a-b86925047f4a None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:39.524354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb2036-8dad-4a9a-9c18-c1ecc9cf5c61 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:39.559610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65719b-ae7e-4f2e-b218-4ceecdbcdf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:39.560262 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65719b-ae7e-4f2e-b218-4ceecdbcdf65 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:39.560549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65719b-ae7e-4f2e-b218-4ceecdbcdf65 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:39.560828 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65719b-ae7e-4f2e-b218-4ceecdbcdf65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:39.601449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:39.614540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba648f-90e9-4b4e-9c6a-b86925047f4a None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:39.640952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65719b-ae7e-4f2e-b218-4ceecdbcdf65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:39.642373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65719b-ae7e-4f2e-b218-4ceecdbcdf65 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:39.650925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d62d2-11e5-4cd5-a407-d533376ebf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:39.651563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d62d2-11e5-4cd5-a407-d533376ebf56 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:39.651852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d62d2-11e5-4cd5-a407-d533376ebf56 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:39.652156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d62d2-11e5-4cd5-a407-d533376ebf56 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:39.653292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d62d2-11e5-4cd5-a407-d533376ebf56 None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:39.654743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d62d2-11e5-4cd5-a407-d533376ebf56 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:39.656508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 45/88] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:39 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:39.657273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d62d2-11e5-4cd5-a407-d533376ebf56 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:39.706017 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:39.742695 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 44/89] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:29:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:29:39.743679 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65719b-ae7e-4f2e-b218-4ceecdbcdf65 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:39.758683 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d62d2-11e5-4cd5-a407-d533376ebf56 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:39.792345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db3059-fa88-4cb2-a37e-625b3919f0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:39.792963 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db3059-fa88-4cb2-a37e-625b3919f0c4 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:39.793244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db3059-fa88-4cb2-a37e-625b3919f0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:39.793519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db3059-fa88-4cb2-a37e-625b3919f0c4 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:39.794648 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db3059-fa88-4cb2-a37e-625b3919f0c4 None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:39.796136 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db3059-fa88-4cb2-a37e-625b3919f0c4 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:39.798251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 46/90] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:39 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:39.798999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db3059-fa88-4cb2-a37e-625b3919f0c4 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:39.817609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:39.851791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65719b-ae7e-4f2e-b218-4ceecdbcdf65 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:39.887843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482796a-567c-4b87-ad23-9cbf4ebfac83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:39.888490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482796a-567c-4b87-ad23-9cbf4ebfac83 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:39.888772 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482796a-567c-4b87-ad23-9cbf4ebfac83 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:39.889051 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482796a-567c-4b87-ad23-9cbf4ebfac83 None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:39.889707 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482796a-567c-4b87-ad23-9cbf4ebfac83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:39.891288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482796a-567c-4b87-ad23-9cbf4ebfac83 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:39.898671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db3059-fa88-4cb2-a37e-625b3919f0c4 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:39.915938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:39.934779 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2659476-2807-415d-a5ea-cbd8a171cb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:39.935423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2659476-2807-415d-a5ea-cbd8a171cb36 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:39.935788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2659476-2807-415d-a5ea-cbd8a171cb36 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:39.935987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2659476-2807-415d-a5ea-cbd8a171cb36 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:39.937163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2659476-2807-415d-a5ea-cbd8a171cb36 None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:39.939222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2659476-2807-415d-a5ea-cbd8a171cb36 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:39.940906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 47/91] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:39 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:39.941672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2659476-2807-415d-a5ea-cbd8a171cb36 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:40.012378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 45/92] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:29:39 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:40.013233 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482796a-567c-4b87-ad23-9cbf4ebfac83 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:40.043819 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2659476-2807-415d-a5ea-cbd8a171cb36 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:40.088043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60666b-e18a-42bf-b794-69741e1f3767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:40.088704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60666b-e18a-42bf-b794-69741e1f3767 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:40.088995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60666b-e18a-42bf-b794-69741e1f3767 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:40.089278 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60666b-e18a-42bf-b794-69741e1f3767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:40.090062 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60666b-e18a-42bf-b794-69741e1f3767 None admin] RBAC: Adding query filter params (role.id=7cca4e8860b3437e801ffbf8429da7dd, scope.project.id=71ed3cc8b5a141bda65164dab60ee555, user.id=342fd70c02c34a39b525655b3d8d3e46) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:40.090379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60666b-e18a-42bf-b794-69741e1f3767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:40.091869 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60666b-e18a-42bf-b794-69741e1f3767 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:40.098793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 48/93] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:29:39 2022] GET /identity/v3/role_assignments?user.id=342fd70c02c34a39b525655b3d8d3e46&scope.project.id=71ed3cc8b5a141bda65164dab60ee555&role.id=7cca4e8860b3437e801ffbf8429da7dd => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:40.098793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60666b-e18a-42bf-b794-69741e1f3767 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:40.144887 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482796a-567c-4b87-ad23-9cbf4ebfac83 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:40.182777 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:40.184359 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:40.201823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdb587-48f6-4d6b-8e5f-3483a90f47b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:40.202833 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb587-48f6-4d6b-8e5f-3483a90f47b9 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:40.203206 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb587-48f6-4d6b-8e5f-3483a90f47b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:40.203620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb587-48f6-4d6b-8e5f-3483a90f47b9 None admin] PATH_INFO: `/v3/projects/00a7fa2bed024e4bb40b766c05f019ae` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:40.206152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdb587-48f6-4d6b-8e5f-3483a90f47b9 None admin] RBAC: Authorizing `identity:get_project(project_id=00a7fa2bed024e4bb40b766c05f019ae)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:40.209929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdb587-48f6-4d6b-8e5f-3483a90f47b9 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:40.210104 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 46/94] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:40 2022] GET /identity/v3/projects/00a7fa2bed024e4bb40b766c05f019ae => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:40.210854 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdb587-48f6-4d6b-8e5f-3483a90f47b9 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:40.275010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60666b-e18a-42bf-b794-69741e1f3767 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:40.326923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef4323-649c-49a8-8783-71c603abd964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:40.328901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef4323-649c-49a8-8783-71c603abd964 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:40.329409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef4323-649c-49a8-8783-71c603abd964 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:40.329977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef4323-649c-49a8-8783-71c603abd964 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:40.331008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef4323-649c-49a8-8783-71c603abd964 None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=71ed3cc8b5a141bda65164dab60ee555, user.id=2047940dbd8547dfbf3a3e01e9cedc83) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:40.331008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef4323-649c-49a8-8783-71c603abd964 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:40.332673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef4323-649c-49a8-8783-71c603abd964 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:40.338946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 49/95] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:29:40 2022] GET /identity/v3/role_assignments?user.id=2047940dbd8547dfbf3a3e01e9cedc83&scope.project.id=71ed3cc8b5a141bda65164dab60ee555&role.id=a7d59d2982de4bfeb758dce70808029f => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:40.339789 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef4323-649c-49a8-8783-71c603abd964 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:40.376672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdb587-48f6-4d6b-8e5f-3483a90f47b9 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:40.424223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693aa017-9e02-4543-b2f1-d91851e826c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:40.425032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aa017-9e02-4543-b2f1-d91851e826c7 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:40.425636 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aa017-9e02-4543-b2f1-d91851e826c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:40.425940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aa017-9e02-4543-b2f1-d91851e826c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:40.426818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693aa017-9e02-4543-b2f1-d91851e826c7 None admin] RBAC: Adding query filter params (role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1, scope.project.id=71ed3cc8b5a141bda65164dab60ee555, user.id=342fd70c02c34a39b525655b3d8d3e46) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:40.427139 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693aa017-9e02-4543-b2f1-d91851e826c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:40.429728 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693aa017-9e02-4543-b2f1-d91851e826c7 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:40.436784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 47/96] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:29:40 2022] GET /identity/v3/role_assignments?user.id=342fd70c02c34a39b525655b3d8d3e46&scope.project.id=71ed3cc8b5a141bda65164dab60ee555&role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:40.476183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef4323-649c-49a8-8783-71c603abd964 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:40.491642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:40.517670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebeba1-470e-4f30-a2b9-1900a831922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:40.518671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebeba1-470e-4f30-a2b9-1900a831922c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:40.519181 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebeba1-470e-4f30-a2b9-1900a831922c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:40.519655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebeba1-470e-4f30-a2b9-1900a831922c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:40.520791 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebeba1-470e-4f30-a2b9-1900a831922c None admin] RBAC: Adding query filter params (role.id=7cca4e8860b3437e801ffbf8429da7dd, scope.project.id=00a7fa2bed024e4bb40b766c05f019ae, user.id=342fd70c02c34a39b525655b3d8d3e46) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:40.521391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebeba1-470e-4f30-a2b9-1900a831922c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:40.523310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebeba1-470e-4f30-a2b9-1900a831922c None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:40.530085 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 50/97] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:29:40 2022] GET /identity/v3/role_assignments?user.id=342fd70c02c34a39b525655b3d8d3e46&scope.project.id=00a7fa2bed024e4bb40b766c05f019ae&role.id=7cca4e8860b3437e801ffbf8429da7dd => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:42.623191 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7f739-a73d-4a98-af0b-fb7186ef9988 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:42.624203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7f739-a73d-4a98-af0b-fb7186ef9988 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:42.624776 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7f739-a73d-4a98-af0b-fb7186ef9988 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:42.627117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 48/98] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:42.632772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea89d8-e19e-4143-a912-cd190e11bc5d None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:42.633683 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea89d8-e19e-4143-a912-cd190e11bc5d None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:42.634164 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea89d8-e19e-4143-a912-cd190e11bc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:42.652865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-f4ea89d8-e19e-4143-a912-cd190e11bc5d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:42.654383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-f4ea89d8-e19e-4143-a912-cd190e11bc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:42.742235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 51/99] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:42.938343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc53f9-634e-4d10-bfe0-be86e8a2fbd1 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:42.938679 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc53f9-634e-4d10-bfe0-be86e8a2fbd1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:42.938869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc53f9-634e-4d10-bfe0-be86e8a2fbd1 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:42.940371 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 49/100] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:42.945696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edffd2-d6ab-4064-be23-438410754c50 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:42.945988 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edffd2-d6ab-4064-be23-438410754c50 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:42.946269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edffd2-d6ab-4064-be23-438410754c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:42.977115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-75edffd2-d6ab-4064-be23-438410754c50 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:42.978338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-75edffd2-d6ab-4064-be23-438410754c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:43.073058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 52/101] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:43.257424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc53f9-634e-4d10-bfe0-be86e8a2fbd1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:43.333154 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:43.375663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58b1ec-3c0a-42ff-b7fe-1e47fdc445b8 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:43.376252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58b1ec-3c0a-42ff-b7fe-1e47fdc445b8 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:43.376535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58b1ec-3c0a-42ff-b7fe-1e47fdc445b8 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:43.378021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 53/102] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:29:43.384099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef097607-facc-4ebb-a904-c5483388e93b None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:43.384413 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef097607-facc-4ebb-a904-c5483388e93b None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:43.384682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef097607-facc-4ebb-a904-c5483388e93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:43.385024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc53f9-634e-4d10-bfe0-be86e8a2fbd1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:43.404169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-ef097607-facc-4ebb-a904-c5483388e93b None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:43.405366 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ef097607-facc-4ebb-a904-c5483388e93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:43.435768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:43.450237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653aef3-17d5-408e-8a0a-ae356fec5336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:43.450889 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653aef3-17d5-408e-8a0a-ae356fec5336 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:43.451175 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653aef3-17d5-408e-8a0a-ae356fec5336 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:43.451456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653aef3-17d5-408e-8a0a-ae356fec5336 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:43.467301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653aef3-17d5-408e-8a0a-ae356fec5336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-c653aef3-17d5-408e-8a0a-ae356fec5336 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:43.475553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:43.476427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:43.477228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:43.477228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:43.477228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:43.477228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:43.477228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:43.477228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:43.477228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:43.477228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:43.477228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:43.477228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:43.477228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:29:43.477228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:29:43.477228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 50/103] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:43.478289 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95823505-fdf4-41cc-890f-b0819fad12d9 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:43.480174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95823505-fdf4-41cc-890f-b0819fad12d9 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:43.480174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95823505-fdf4-41cc-890f-b0819fad12d9 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:43.480174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 51/104] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:43.480764 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95823505-fdf4-41cc-890f-b0819fad12d9 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:43.489741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 54/105] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:29:43.492954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef097607-facc-4ebb-a904-c5483388e93b None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:43.653895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef097607-facc-4ebb-a904-c5483388e93b None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:43.664189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95823505-fdf4-41cc-890f-b0819fad12d9 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:43.680239 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:43.694855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298b236-e1ac-4502-938c-8c74c21891aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:43.695482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298b236-e1ac-4502-938c-8c74c21891aa None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:43.701301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298b236-e1ac-4502-938c-8c74c21891aa None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:43.701301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298b236-e1ac-4502-938c-8c74c21891aa None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:43.701301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298b236-e1ac-4502-938c-8c74c21891aa None admin] RBAC: Adding query filter params (name=member) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:43.701301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298b236-e1ac-4502-938c-8c74c21891aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:43.701301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298b236-e1ac-4502-938c-8c74c21891aa None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:43.702955 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1522d-7692-4af6-882c-2e483bf69a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:43.703656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1522d-7692-4af6-882c-2e483bf69a6e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:43.703959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1522d-7692-4af6-882c-2e483bf69a6e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:43.704248 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1522d-7692-4af6-882c-2e483bf69a6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:43.705372 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1522d-7692-4af6-882c-2e483bf69a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:43.706826 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1522d-7692-4af6-882c-2e483bf69a6e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:43.708656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 52/106] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:29:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:43.709297 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 55/107] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:29:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:43.714233 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966be57-21d2-4313-b16b-403a3f337e5a None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:43.714525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966be57-21d2-4313-b16b-403a3f337e5a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:43.714811 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966be57-21d2-4313-b16b-403a3f337e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:43.715127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7ba9-235a-470d-8c20-8c40c898623e None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:43.715427 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7ba9-235a-470d-8c20-8c40c898623e None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:43.715715 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7ba9-235a-470d-8c20-8c40c898623e None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:43.717456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 56/108] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:43.718441 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca24ea-2040-441b-a072-c43d81702f02 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:43.718653 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca24ea-2040-441b-a072-c43d81702f02 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:43.718962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca24ea-2040-441b-a072-c43d81702f02 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:43.724469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 57/109] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:43.724469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca24ea-2040-441b-a072-c43d81702f02 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:43.736968 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-c966be57-21d2-4313-b16b-403a3f337e5a None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:43.738188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c966be57-21d2-4313-b16b-403a3f337e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:43.755290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:43.810498 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 53/110] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:43.817765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966be57-21d2-4313-b16b-403a3f337e5a None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:43.841209 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca24ea-2040-441b-a072-c43d81702f02 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:43.878012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c2221-603d-4002-b8bf-9467c34b56fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:43.878890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c2221-603d-4002-b8bf-9467c34b56fd None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:43.878890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c2221-603d-4002-b8bf-9467c34b56fd None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:43.879192 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c2221-603d-4002-b8bf-9467c34b56fd None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:43.879845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c2221-603d-4002-b8bf-9467c34b56fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:43.881397 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c2221-603d-4002-b8bf-9467c34b56fd None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:43.923013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966be57-21d2-4313-b16b-403a3f337e5a None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:43.937019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:43.958487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3fa19-8832-4934-b5c4-36baa0f061d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:43.959127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3fa19-8832-4934-b5c4-36baa0f061d6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:43.959441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3fa19-8832-4934-b5c4-36baa0f061d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:43.959737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3fa19-8832-4934-b5c4-36baa0f061d6 None admin] PATH_INFO: `/v3/users/342fd70c02c34a39b525655b3d8d3e46` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:43.960973 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3fa19-8832-4934-b5c4-36baa0f061d6 None admin] RBAC: Authorizing `identity:get_user(user_id=342fd70c02c34a39b525655b3d8d3e46)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:43.962441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3fa19-8832-4934-b5c4-36baa0f061d6 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:43.964025 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 54/111] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:43 2022] GET /identity/v3/users/342fd70c02c34a39b525655b3d8d3e46 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:43.965215 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b031-56d4-43b3-af85-f414445083b8 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:43.965501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b031-56d4-43b3-af85-f414445083b8 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:43.965775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b031-56d4-43b3-af85-f414445083b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:43.978026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 58/112] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 29 22:29:43 2022] POST /identity/v3/projects => generated 302 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:43.979537 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1ec4b-38b7-48be-ae58-dce597b68fdb None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:43.979897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1ec4b-38b7-48be-ae58-dce597b68fdb None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:43.983948 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1ec4b-38b7-48be-ae58-dce597b68fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:44.002086 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-dbb8b031-56d4-43b3-af85-f414445083b8 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:44.002688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-a8a1ec4b-38b7-48be-ae58-dce597b68fdb None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:44.003988 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a8a1ec4b-38b7-48be-ae58-dce597b68fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:44.004122 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-dbb8b031-56d4-43b3-af85-f414445083b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:44.086751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 59/113] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:44.087749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1ec4b-38b7-48be-ae58-dce597b68fdb None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:44.103427 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:44.111770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 55/114] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:44.113078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8b031-56d4-43b3-af85-f414445083b8 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:44.230058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1ec4b-38b7-48be-ae58-dce597b68fdb None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:44.247221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8b031-56d4-43b3-af85-f414445083b8 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:44.262878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:44.274643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba4b7a-390f-4892-9fda-2e5168dbc688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:44.275567 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba4b7a-390f-4892-9fda-2e5168dbc688 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:44.276017 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba4b7a-390f-4892-9fda-2e5168dbc688 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:44.276518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba4b7a-390f-4892-9fda-2e5168dbc688 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:44.288798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba4b7a-390f-4892-9fda-2e5168dbc688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:44.292530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6bb95-97c5-4f90-9c85-118bf3d5fdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:44.293614 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6bb95-97c5-4f90-9c85-118bf3d5fdd0 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:44.294349 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6bb95-97c5-4f90-9c85-118bf3d5fdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:44.294695 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6bb95-97c5-4f90-9c85-118bf3d5fdd0 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:44.295948 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6bb95-97c5-4f90-9c85-118bf3d5fdd0 None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-52ba4b7a-390f-4892-9fda-2e5168dbc688 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:44.296956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:44.298468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:44.299499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:44.299499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:44.299499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:44.299499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:44.299499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:44.299499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:44.299499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:44.299499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:44.299499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:44.299499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:44.299499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:29:44.299499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:29:44.300196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6bb95-97c5-4f90-9c85-118bf3d5fdd0 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:44.300948 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 56/115] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:44 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:44.302308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 60/116] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:29:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:44.303852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6bb95-97c5-4f90-9c85-118bf3d5fdd0 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:44.307756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba4b7a-390f-4892-9fda-2e5168dbc688 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:44.391992 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:44.425032 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba4b7a-390f-4892-9fda-2e5168dbc688 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:44.441228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6bb95-97c5-4f90-9c85-118bf3d5fdd0 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:44.464035 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45081892-bdc0-4ad7-84f0-d50b53a9427e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:44.465068 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45081892-bdc0-4ad7-84f0-d50b53a9427e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:44.465573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45081892-bdc0-4ad7-84f0-d50b53a9427e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:44.466074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45081892-bdc0-4ad7-84f0-d50b53a9427e None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:44.466961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45081892-bdc0-4ad7-84f0-d50b53a9427e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:44.467342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45081892-bdc0-4ad7-84f0-d50b53a9427e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:44.468820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45081892-bdc0-4ad7-84f0-d50b53a9427e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:44.477422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 61/117] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:29:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:29:44.478221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45081892-bdc0-4ad7-84f0-d50b53a9427e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:44.487378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f806d6-d45d-4f16-8fc9-71e39d9dbadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:44.488023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f806d6-d45d-4f16-8fc9-71e39d9dbadd None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:44.488347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f806d6-d45d-4f16-8fc9-71e39d9dbadd None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:44.488630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f806d6-d45d-4f16-8fc9-71e39d9dbadd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:44.499385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f806d6-d45d-4f16-8fc9-71e39d9dbadd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-75f806d6-d45d-4f16-8fc9-71e39d9dbadd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:44.505027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:44.505900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:44.508980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:44.508980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:44.508980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:44.508980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:44.508980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:44.508980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:44.508980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:44.508980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:44.508980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:44.508980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:44.508980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:29:44.508980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:29:44.508980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 57/118] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:44.508980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f806d6-d45d-4f16-8fc9-71e39d9dbadd None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:44.554165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:44.599741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45081892-bdc0-4ad7-84f0-d50b53a9427e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:44.630417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f806d6-d45d-4f16-8fc9-71e39d9dbadd None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:44.636268 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:44.643840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8068a-7db6-4c30-b5bf-38c148c3d874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:44.644486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8068a-7db6-4c30-b5bf-38c148c3d874 None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:44.644734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8068a-7db6-4c30-b5bf-38c148c3d874 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:44.645021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8068a-7db6-4c30-b5bf-38c148c3d874 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555/users/342fd70c02c34a39b525655b3d8d3e46/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:44.647094 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8068a-7db6-4c30-b5bf-38c148c3d874 None admin] RBAC: Authorizing `identity:create_grant(project_id=71ed3cc8b5a141bda65164dab60ee555, user_id=342fd70c02c34a39b525655b3d8d3e46, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:44.648585 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8068a-7db6-4c30-b5bf-38c148c3d874 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:44.667687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d714a-5b28-4250-ac20-834bd76257b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:44.668977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d714a-5b28-4250-ac20-834bd76257b8 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:44.669266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d714a-5b28-4250-ac20-834bd76257b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:44.670728 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d714a-5b28-4250-ac20-834bd76257b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:44.681711 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d714a-5b28-4250-ac20-834bd76257b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-977d714a-5b28-4250-ac20-834bd76257b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:44.686571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:44.692457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:44.694124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:44.694124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:44.694124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:44.694124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:44.694124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:44.694124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:44.694124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:44.694124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:44.694124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:44.694124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:44.694124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:29:44.694124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:29:44.694124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 58/119] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:44.694124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d714a-5b28-4250-ac20-834bd76257b8 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:44.728447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 62/120] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:29:44 2022] PUT /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555/users/342fd70c02c34a39b525655b3d8d3e46/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:44.728447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8068a-7db6-4c30-b5bf-38c148c3d874 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:44.813772 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:44.819035 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d714a-5b28-4250-ac20-834bd76257b8 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:44.862913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8068a-7db6-4c30-b5bf-38c148c3d874 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:44.863159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f0dcc-2acb-41cd-a1a9-2452e187971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:44.863827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f0dcc-2acb-41cd-a1a9-2452e187971e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:44.864136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f0dcc-2acb-41cd-a1a9-2452e187971e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:44.864442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f0dcc-2acb-41cd-a1a9-2452e187971e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:44.878753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f0dcc-2acb-41cd-a1a9-2452e187971e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-8a5f0dcc-2acb-41cd-a1a9-2452e187971e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:44.883762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:44.884672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:44.885442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:44.885442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:44.885442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:44.885442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:44.885442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:44.885442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:44.885442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:44.885442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:44.885442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:44.885442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:44.885442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:44.885442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:29:44.885442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 59/121] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:29:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:44.886071 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f0dcc-2acb-41cd-a1a9-2452e187971e None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:44.910494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccb530-c15c-4ede-ac21-5efa9ea60252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:44.911510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccb530-c15c-4ede-ac21-5efa9ea60252 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:44.911864 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccb530-c15c-4ede-ac21-5efa9ea60252 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:44.912895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccb530-c15c-4ede-ac21-5efa9ea60252 None admin] PATH_INFO: `/v3/users/342fd70c02c34a39b525655b3d8d3e46` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:44.913495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccb530-c15c-4ede-ac21-5efa9ea60252 None admin] RBAC: Authorizing `identity:get_user(user_id=342fd70c02c34a39b525655b3d8d3e46)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:44.914944 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccb530-c15c-4ede-ac21-5efa9ea60252 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:44.916672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 63/122] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:44 2022] GET /identity/v3/users/342fd70c02c34a39b525655b3d8d3e46 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:44.917447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccb530-c15c-4ede-ac21-5efa9ea60252 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:44.997893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:45.019370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f0dcc-2acb-41cd-a1a9-2452e187971e None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:45.042178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccb530-c15c-4ede-ac21-5efa9ea60252 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:45.059962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20a2ea-623e-4fb5-9a41-5e35665e1ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:45.060894 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20a2ea-623e-4fb5-9a41-5e35665e1ae6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:45.061358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20a2ea-623e-4fb5-9a41-5e35665e1ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:45.061843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20a2ea-623e-4fb5-9a41-5e35665e1ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:45.062912 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20a2ea-623e-4fb5-9a41-5e35665e1ae6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:45.063401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20a2ea-623e-4fb5-9a41-5e35665e1ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:45.066081 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20a2ea-623e-4fb5-9a41-5e35665e1ae6 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:45.076615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 60/123] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:29:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:45.077870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20a2ea-623e-4fb5-9a41-5e35665e1ae6 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:45.078937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b82647-d25c-4f40-8237-6dfff7489654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:45.079614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b82647-d25c-4f40-8237-6dfff7489654 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:45.079975 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b82647-d25c-4f40-8237-6dfff7489654 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:45.080340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b82647-d25c-4f40-8237-6dfff7489654 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:45.081081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b82647-d25c-4f40-8237-6dfff7489654 None admin] RBAC: Adding query filter params (name=member) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:45.081455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b82647-d25c-4f40-8237-6dfff7489654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:45.082939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b82647-d25c-4f40-8237-6dfff7489654 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:45.091881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 64/124] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:29:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:45.097506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b82647-d25c-4f40-8237-6dfff7489654 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:45.105318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:45.197879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20a2ea-623e-4fb5-9a41-5e35665e1ae6 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:45.201565 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b82647-d25c-4f40-8237-6dfff7489654 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:45.226718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:45.237292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec313772-3409-4271-9b64-bbb2e4481e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:45.237921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec313772-3409-4271-9b64-bbb2e4481e91 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:45.238351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec313772-3409-4271-9b64-bbb2e4481e91 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:45.238641 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec313772-3409-4271-9b64-bbb2e4481e91 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:45.238902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93caf23-1103-47ed-9c0d-0d5035c1af5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:45.239334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec313772-3409-4271-9b64-bbb2e4481e91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:45.239539 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93caf23-1103-47ed-9c0d-0d5035c1af5e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:45.239635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec313772-3409-4271-9b64-bbb2e4481e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:45.239820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93caf23-1103-47ed-9c0d-0d5035c1af5e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:45.240113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93caf23-1103-47ed-9c0d-0d5035c1af5e None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:45.246909 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec313772-3409-4271-9b64-bbb2e4481e91 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:45.247030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93caf23-1103-47ed-9c0d-0d5035c1af5e None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:45.247030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93caf23-1103-47ed-9c0d-0d5035c1af5e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:45.247030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 65/125] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:45 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:45.250228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93caf23-1103-47ed-9c0d-0d5035c1af5e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:45.255003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 61/126] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:45.256189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec313772-3409-4271-9b64-bbb2e4481e91 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:45.349816 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:45.369750 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec313772-3409-4271-9b64-bbb2e4481e91 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:45.371101 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93caf23-1103-47ed-9c0d-0d5035c1af5e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:45.407570 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec186cb2-dbf3-4ada-91c1-60234b1d4b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:45.408256 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec186cb2-dbf3-4ada-91c1-60234b1d4b38 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:45.408546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec186cb2-dbf3-4ada-91c1-60234b1d4b38 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:45.408829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec186cb2-dbf3-4ada-91c1-60234b1d4b38 None admin] PATH_INFO: `/v3/users/342fd70c02c34a39b525655b3d8d3e46` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:45.409159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71d21b-5499-4ac0-a075-7a74d3b23809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:45.410001 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec186cb2-dbf3-4ada-91c1-60234b1d4b38 None admin] RBAC: Authorizing `identity:get_user(user_id=342fd70c02c34a39b525655b3d8d3e46)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:45.410105 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71d21b-5499-4ac0-a075-7a74d3b23809 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:45.410581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71d21b-5499-4ac0-a075-7a74d3b23809 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:45.411097 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71d21b-5499-4ac0-a075-7a74d3b23809 None admin] PATH_INFO: `/v3/users/45d7dd3085b44590b16bc189308ac94e` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:45.411450 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec186cb2-dbf3-4ada-91c1-60234b1d4b38 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:45.414066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 62/127] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:45 2022] GET /identity/v3/users/342fd70c02c34a39b525655b3d8d3e46 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:45.415553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec186cb2-dbf3-4ada-91c1-60234b1d4b38 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:45.428264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71d21b-5499-4ac0-a075-7a74d3b23809 None admin] RBAC: Authorizing `identity:get_user(user_id=45d7dd3085b44590b16bc189308ac94e)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:45.430043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71d21b-5499-4ac0-a075-7a74d3b23809 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:45.432362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 66/128] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:45 2022] GET /identity/v3/users/45d7dd3085b44590b16bc189308ac94e => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:45.433442 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71d21b-5499-4ac0-a075-7a74d3b23809 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:45.487415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:45.522909 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec186cb2-dbf3-4ada-91c1-60234b1d4b38 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:45.543216 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71d21b-5499-4ac0-a075-7a74d3b23809 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:45.559181 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812ff72-8908-4134-9271-f17446bc4d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:45.559912 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812ff72-8908-4134-9271-f17446bc4d8b None admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:45.560161 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812ff72-8908-4134-9271-f17446bc4d8b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:45.560468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812ff72-8908-4134-9271-f17446bc4d8b None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555/users/342fd70c02c34a39b525655b3d8d3e46/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:45.562772 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812ff72-8908-4134-9271-f17446bc4d8b None admin] RBAC: Authorizing `identity:create_grant(project_id=71ed3cc8b5a141bda65164dab60ee555, user_id=342fd70c02c34a39b525655b3d8d3e46, role_id=dcd0c9dbe86e4660b3d7ab1bce4762b1)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:45.564268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812ff72-8908-4134-9271-f17446bc4d8b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:45.581658 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19edbe5-9251-4d06-93f8-2ddb9c7414b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:45.582321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19edbe5-9251-4d06-93f8-2ddb9c7414b8 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:45.584381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19edbe5-9251-4d06-93f8-2ddb9c7414b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:45.584381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19edbe5-9251-4d06-93f8-2ddb9c7414b8 None admin] PATH_INFO: `/v3/users/2047940dbd8547dfbf3a3e01e9cedc83` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:45.584381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19edbe5-9251-4d06-93f8-2ddb9c7414b8 None admin] RBAC: Authorizing `identity:get_user(user_id=2047940dbd8547dfbf3a3e01e9cedc83)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:45.585644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19edbe5-9251-4d06-93f8-2ddb9c7414b8 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:45.587247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 67/129] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:45 2022] GET /identity/v3/users/2047940dbd8547dfbf3a3e01e9cedc83 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:45.588023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19edbe5-9251-4d06-93f8-2ddb9c7414b8 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:45.650761 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 63/130] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:29:45 2022] PUT /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555/users/342fd70c02c34a39b525655b3d8d3e46/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:45.651733 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812ff72-8908-4134-9271-f17446bc4d8b None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:45.672469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:45.738301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19edbe5-9251-4d06-93f8-2ddb9c7414b8 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:45.784491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:45.790981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812ff72-8908-4134-9271-f17446bc4d8b None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:45.835163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829cea4-a6b4-4475-951d-111720b771e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:45.835653 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b4d32-2da7-43e1-9ebf-25656e051a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:45.835796 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829cea4-a6b4-4475-951d-111720b771e0 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:45.836064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829cea4-a6b4-4475-951d-111720b771e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:45.836374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829cea4-a6b4-4475-951d-111720b771e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:45.840535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b4d32-2da7-43e1-9ebf-25656e051a31 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:45.840850 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b4d32-2da7-43e1-9ebf-25656e051a31 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:45.841137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b4d32-2da7-43e1-9ebf-25656e051a31 None admin] PATH_INFO: `/v3/projects/00a7fa2bed024e4bb40b766c05f019ae` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:45.842458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b4d32-2da7-43e1-9ebf-25656e051a31 None admin] RBAC: Authorizing `identity:get_project(project_id=00a7fa2bed024e4bb40b766c05f019ae)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:45.845584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b4d32-2da7-43e1-9ebf-25656e051a31 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:45.850747 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 68/131] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:45 2022] GET /identity/v3/projects/00a7fa2bed024e4bb40b766c05f019ae => generated 312 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:45.851769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b4d32-2da7-43e1-9ebf-25656e051a31 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:45.931725 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829cea4-a6b4-4475-951d-111720b771e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:45.933765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829cea4-a6b4-4475-951d-111720b771e0 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:45.949823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:46.001163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b4d32-2da7-43e1-9ebf-25656e051a31 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:46.051748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b899c53-b17c-4e96-a5a6-a56dc9309c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:46.052413 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b899c53-b17c-4e96-a5a6-a56dc9309c50 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:46.052696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b899c53-b17c-4e96-a5a6-a56dc9309c50 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:46.054269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b899c53-b17c-4e96-a5a6-a56dc9309c50 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:46.058787 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b899c53-b17c-4e96-a5a6-a56dc9309c50 None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:46.060278 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b899c53-b17c-4e96-a5a6-a56dc9309c50 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:46.061923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 69/132] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:45 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:46.063817 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b899c53-b17c-4e96-a5a6-a56dc9309c50 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:46.085157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 64/133] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:29:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:29:46.085984 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829cea4-a6b4-4475-951d-111720b771e0 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:46.163398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:46.251430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b899c53-b17c-4e96-a5a6-a56dc9309c50 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:46.275476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829cea4-a6b4-4475-951d-111720b771e0 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:46.305268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:46.307508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f44a1b-db86-47d5-adc1-2afea326fa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:46.308287 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f44a1b-db86-47d5-adc1-2afea326fa6a None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:46.308570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f44a1b-db86-47d5-adc1-2afea326fa6a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:46.308846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f44a1b-db86-47d5-adc1-2afea326fa6a None admin] PATH_INFO: `/v3/projects/00a7fa2bed024e4bb40b766c05f019ae/users/342fd70c02c34a39b525655b3d8d3e46/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:46.313424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f44a1b-db86-47d5-adc1-2afea326fa6a None admin] RBAC: Authorizing `identity:create_grant(project_id=00a7fa2bed024e4bb40b766c05f019ae, user_id=342fd70c02c34a39b525655b3d8d3e46, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:46.314889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f44a1b-db86-47d5-adc1-2afea326fa6a None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:46.353044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b9fff-cdb2-4b54-bc13-72efc470cf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:46.353718 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b9fff-cdb2-4b54-bc13-72efc470cf06 None admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:46.354005 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b9fff-cdb2-4b54-bc13-72efc470cf06 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:46.354287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b9fff-cdb2-4b54-bc13-72efc470cf06 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555/users/2047940dbd8547dfbf3a3e01e9cedc83/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:46.356366 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b9fff-cdb2-4b54-bc13-72efc470cf06 None admin] RBAC: Authorizing `identity:create_grant(project_id=71ed3cc8b5a141bda65164dab60ee555, user_id=2047940dbd8547dfbf3a3e01e9cedc83, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:46.357837 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b9fff-cdb2-4b54-bc13-72efc470cf06 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:46.378528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 70/134] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:29:46 2022] PUT /identity/v3/projects/00a7fa2bed024e4bb40b766c05f019ae/users/342fd70c02c34a39b525655b3d8d3e46/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:46.379409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f44a1b-db86-47d5-adc1-2afea326fa6a None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:46.441601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 65/135] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:29:46 2022] PUT /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555/users/2047940dbd8547dfbf3a3e01e9cedc83/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:46.443789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c068e-723d-46f8-9af5-c63b89d250b6 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:46.444100 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c068e-723d-46f8-9af5-c63b89d250b6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:46.451992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c068e-723d-46f8-9af5-c63b89d250b6 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:46.454207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 66/136] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:46 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:46.460125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090f463-6ae3-4a41-8c8c-6c296fe34ebe None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:46.460405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090f463-6ae3-4a41-8c8c-6c296fe34ebe None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:46.460690 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090f463-6ae3-4a41-8c8c-6c296fe34ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:46.529619 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-3090f463-6ae3-4a41-8c8c-6c296fe34ebe None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:46.530758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3090f463-6ae3-4a41-8c8c-6c296fe34ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:46.589547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f44a1b-db86-47d5-adc1-2afea326fa6a None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:46.605340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:46.632594 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef999ce-dc96-4b47-8ba9-7a2d6e11c4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:46.633358 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef999ce-dc96-4b47-8ba9-7a2d6e11c4ed None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:46.633756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef999ce-dc96-4b47-8ba9-7a2d6e11c4ed None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:46.634104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef999ce-dc96-4b47-8ba9-7a2d6e11c4ed None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:46.635350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef999ce-dc96-4b47-8ba9-7a2d6e11c4ed None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:46.637077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef999ce-dc96-4b47-8ba9-7a2d6e11c4ed None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:46.638908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 71/137] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:46 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:46.643117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 67/138] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:29:46.645850 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef999ce-dc96-4b47-8ba9-7a2d6e11c4ed None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:46.789180 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef999ce-dc96-4b47-8ba9-7a2d6e11c4ed None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:46.836806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e0017-2840-497e-87fb-3941333ad1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:46.837436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e0017-2840-497e-87fb-3941333ad1a4 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:46.838051 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e0017-2840-497e-87fb-3941333ad1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:46.838338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e0017-2840-497e-87fb-3941333ad1a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:46.839076 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e0017-2840-497e-87fb-3941333ad1a4 None admin] RBAC: Adding query filter params (role.id=c0d24825bab14907b75e4205bd286479, scope.project.id=71ed3cc8b5a141bda65164dab60ee555, user.id=45d7dd3085b44590b16bc189308ac94e) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:46.839403 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e0017-2840-497e-87fb-3941333ad1a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:46.840867 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e0017-2840-497e-87fb-3941333ad1a4 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:46.847897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 72/139] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:29:46 2022] GET /identity/v3/role_assignments?user.id=45d7dd3085b44590b16bc189308ac94e&scope.project.id=71ed3cc8b5a141bda65164dab60ee555&role.id=c0d24825bab14907b75e4205bd286479 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:47.036349 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090f463-6ae3-4a41-8c8c-6c296fe34ebe None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:47.054142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c9d18-8c6d-4ee6-860a-ac1f6686789e None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:47.054433 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c9d18-8c6d-4ee6-860a-ac1f6686789e None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:47.054614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c9d18-8c6d-4ee6-860a-ac1f6686789e None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:47.056012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 73/140] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:47.061572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a0f10-861d-40d1-9b8a-5724001b5b2d None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:47.061853 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a0f10-861d-40d1-9b8a-5724001b5b2d None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:47.062128 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a0f10-861d-40d1-9b8a-5724001b5b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:47.097130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-ae8a0f10-861d-40d1-9b8a-5724001b5b2d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:47.098347 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ae8a0f10-861d-40d1-9b8a-5724001b5b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:47.150057 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090f463-6ae3-4a41-8c8c-6c296fe34ebe None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:47.168181 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:47.196519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:47.198491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79c9a0-44e3-420e-b7ca-5e093c32caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:47.199153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79c9a0-44e3-420e-b7ca-5e093c32caca None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:47.199470 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79c9a0-44e3-420e-b7ca-5e093c32caca None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:47.199754 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79c9a0-44e3-420e-b7ca-5e093c32caca None admin] PATH_INFO: `/v3/domains/default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:47.204826 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79c9a0-44e3-420e-b7ca-5e093c32caca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:47.206332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79c9a0-44e3-420e-b7ca-5e093c32caca None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:47.207973 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 68/141] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:29:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:47.213282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79c9a0-44e3-420e-b7ca-5e093c32caca None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:47.267644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 74/142] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:29:47.341280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79c9a0-44e3-420e-b7ca-5e093c32caca None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:47.385199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00419b01-eca0-4019-99a8-9960b5131ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:47.386281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00419b01-eca0-4019-99a8-9960b5131ddd None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:47.386759 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00419b01-eca0-4019-99a8-9960b5131ddd None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:47.387227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00419b01-eca0-4019-99a8-9960b5131ddd None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:47.388068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00419b01-eca0-4019-99a8-9960b5131ddd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:47.389760 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00419b01-eca0-4019-99a8-9960b5131ddd None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:47.487145 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 69/143] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:29:47 2022] POST /identity/v3/users => generated 283 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:29:47.794855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a0f10-861d-40d1-9b8a-5724001b5b2d None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:47.921859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a0f10-861d-40d1-9b8a-5724001b5b2d None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:47.966703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b55c95-fd63-45b3-9cf6-d79983929351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:47.967686 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b55c95-fd63-45b3-9cf6-d79983929351 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:47.968204 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b55c95-fd63-45b3-9cf6-d79983929351 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:47.968751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b55c95-fd63-45b3-9cf6-d79983929351 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:47.985693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b55c95-fd63-45b3-9cf6-d79983929351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-a1b55c95-fd63-45b3-9cf6-d79983929351 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:47.990906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:47.991749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:47.992526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:47.992526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:47.992526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:47.992526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:47.992526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:47.992526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:47.992526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:47.992526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:47.992526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:47.992526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:47.992526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:29:47.992526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:29:47.994763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 75/144] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:48.001231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00419b01-eca0-4019-99a8-9960b5131ddd None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:48.034444 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:48.123339 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00419b01-eca0-4019-99a8-9960b5131ddd None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:48.170561 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411d1e9-2664-4d64-85f4-31913e20609d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:48.171243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411d1e9-2664-4d64-85f4-31913e20609d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:48.171531 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411d1e9-2664-4d64-85f4-31913e20609d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:48.172434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411d1e9-2664-4d64-85f4-31913e20609d None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:48.173119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411d1e9-2664-4d64-85f4-31913e20609d None admin] RBAC: Adding query filter params (name=member) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:48.173423 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411d1e9-2664-4d64-85f4-31913e20609d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:48.175078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411d1e9-2664-4d64-85f4-31913e20609d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:48.188195 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 70/145] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:29:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:48.193811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b55c95-fd63-45b3-9cf6-d79983929351 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:48.251626 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:48.349005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b55c95-fd63-45b3-9cf6-d79983929351 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:48.392715 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defca110-d5f3-41cb-b8a9-32cbc12071d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:48.393276 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defca110-d5f3-41cb-b8a9-32cbc12071d3 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:48.393553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defca110-d5f3-41cb-b8a9-32cbc12071d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:48.393846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defca110-d5f3-41cb-b8a9-32cbc12071d3 None admin] PATH_INFO: `/v3/users/342fd70c02c34a39b525655b3d8d3e46` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:48.395028 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defca110-d5f3-41cb-b8a9-32cbc12071d3 None admin] RBAC: Authorizing `identity:get_user(user_id=342fd70c02c34a39b525655b3d8d3e46)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:48.396512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defca110-d5f3-41cb-b8a9-32cbc12071d3 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:48.398109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 76/146] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:48 2022] GET /identity/v3/users/342fd70c02c34a39b525655b3d8d3e46 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:48.404327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411d1e9-2664-4d64-85f4-31913e20609d None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:48.520988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:48.533796 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411d1e9-2664-4d64-85f4-31913e20609d None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:48.560688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1568bf-8715-4c02-b3bd-76e569e29e5c None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:48.561016 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1568bf-8715-4c02-b3bd-76e569e29e5c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:48.561248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1568bf-8715-4c02-b3bd-76e569e29e5c None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:48.563050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 77/147] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:48.569308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704b201-7da7-40e4-9b2c-e090323eac20 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:48.569589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704b201-7da7-40e4-9b2c-e090323eac20 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:48.569867 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704b201-7da7-40e4-9b2c-e090323eac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:48.578851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09868c1b-bb62-46c1-8be3-9c6730cf2c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:48.579496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09868c1b-bb62-46c1-8be3-9c6730cf2c2f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:48.579782 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09868c1b-bb62-46c1-8be3-9c6730cf2c2f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:48.580060 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09868c1b-bb62-46c1-8be3-9c6730cf2c2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:48.621756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-4704b201-7da7-40e4-9b2c-e090323eac20 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:48.623526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-4704b201-7da7-40e4-9b2c-e090323eac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:48.661611 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09868c1b-bb62-46c1-8be3-9c6730cf2c2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:48.663072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09868c1b-bb62-46c1-8be3-9c6730cf2c2f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:48.781585 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:48.791266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 71/148] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:29:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:29:48.797680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09868c1b-bb62-46c1-8be3-9c6730cf2c2f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:48.826515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 78/149] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:48.939216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09868c1b-bb62-46c1-8be3-9c6730cf2c2f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:48.983214 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75089db6-c115-4e9a-bdd9-6d1ff00cdeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:48.983868 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089db6-c115-4e9a-bdd9-6d1ff00cdeb6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:48.984696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089db6-c115-4e9a-bdd9-6d1ff00cdeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:48.984985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089db6-c115-4e9a-bdd9-6d1ff00cdeb6 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:48.986152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75089db6-c115-4e9a-bdd9-6d1ff00cdeb6 None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:48.987609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75089db6-c115-4e9a-bdd9-6d1ff00cdeb6 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:48.989288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 72/150] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:48 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:48.997206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704b201-7da7-40e4-9b2c-e090323eac20 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:49.070521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:49.165874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704b201-7da7-40e4-9b2c-e090323eac20 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:49.206660 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0dfd3-24b7-4667-8031-eb01faa0791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:49.207195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0dfd3-24b7-4667-8031-eb01faa0791b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:49.207472 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0dfd3-24b7-4667-8031-eb01faa0791b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:49.207739 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0dfd3-24b7-4667-8031-eb01faa0791b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:49.208502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0dfd3-24b7-4667-8031-eb01faa0791b None admin] RBAC: Adding query filter params (role.id=7cca4e8860b3437e801ffbf8429da7dd, scope.project.id=71ed3cc8b5a141bda65164dab60ee555, user.id=342fd70c02c34a39b525655b3d8d3e46) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:49.208809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0dfd3-24b7-4667-8031-eb01faa0791b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:49.210435 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0dfd3-24b7-4667-8031-eb01faa0791b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:49.221796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 79/151] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:29:48 2022] GET /identity/v3/role_assignments?user.id=342fd70c02c34a39b525655b3d8d3e46&scope.project.id=71ed3cc8b5a141bda65164dab60ee555&role.id=7cca4e8860b3437e801ffbf8429da7dd => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:49.409374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62727a-ac02-4fbc-9d90-710168986021 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:49.409883 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62727a-ac02-4fbc-9d90-710168986021 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:49.409954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62727a-ac02-4fbc-9d90-710168986021 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:49.411294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 73/152] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:49.430150 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc174377-33ea-4622-95fd-4799fe4a120d None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:49.430447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc174377-33ea-4622-95fd-4799fe4a120d None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:49.430705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc174377-33ea-4622-95fd-4799fe4a120d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:49.440255 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62727a-ac02-4fbc-9d90-710168986021 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:49.458578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-dc174377-33ea-4622-95fd-4799fe4a120d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:49.459716 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-dc174377-33ea-4622-95fd-4799fe4a120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:49.525948 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:49.584524 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 80/153] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:49.585883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f1c1d-a656-464a-8cf0-9a86da0fa701 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:49.586172 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f1c1d-a656-464a-8cf0-9a86da0fa701 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:49.586441 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f1c1d-a656-464a-8cf0-9a86da0fa701 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:49.592541 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 81/154] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:49.593801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e3d3-1b11-49d1-bd11-089f90add698 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:49.594085 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e3d3-1b11-49d1-bd11-089f90add698 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:49.594356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e3d3-1b11-49d1-bd11-089f90add698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:49.597312 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62727a-ac02-4fbc-9d90-710168986021 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:49.630354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-1f71e3d3-1b11-49d1-bd11-089f90add698 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:49.632393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1f71e3d3-1b11-49d1-bd11-089f90add698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:49.663018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb33b85-5331-49fd-a883-b2e6351e50c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:49.664529 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb33b85-5331-49fd-a883-b2e6351e50c2 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:49.664812 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb33b85-5331-49fd-a883-b2e6351e50c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:49.665317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb33b85-5331-49fd-a883-b2e6351e50c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:49.675853 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:49.690211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb33b85-5331-49fd-a883-b2e6351e50c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-4fb33b85-5331-49fd-a883-b2e6351e50c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:49.698881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:49.699786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:49.700606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:49.700606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:49.700606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:49.700606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:49.700606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:49.700606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:49.700606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:49.700606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:49.700606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:49.700606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:49.700606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:29:49.700606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:29:49.700606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 74/155] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:29:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:29:49.706954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb33b85-5331-49fd-a883-b2e6351e50c2 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:49.762812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 82/156] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:49.764060 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defae71-81e9-4c05-8556-b8cc375ffcde None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:49.764367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defae71-81e9-4c05-8556-b8cc375ffcde None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:49.764638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defae71-81e9-4c05-8556-b8cc375ffcde None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:49.766549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 83/157] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:49.773591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab6bfe-fc5b-4461-b13d-8f7ce4e563b3 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:49.773890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab6bfe-fc5b-4461-b13d-8f7ce4e563b3 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:49.774132 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab6bfe-fc5b-4461-b13d-8f7ce4e563b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:49.813112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-faab6bfe-fc5b-4461-b13d-8f7ce4e563b3 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:49.815595 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-faab6bfe-fc5b-4461-b13d-8f7ce4e563b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:49.912990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb33b85-5331-49fd-a883-b2e6351e50c2 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:49.933236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 84/158] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:49.944473 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:49.972813 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2ba05-26a8-4c82-878b-189a6c489b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:49.973758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2ba05-26a8-4c82-878b-189a6c489b00 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:49.974213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2ba05-26a8-4c82-878b-189a6c489b00 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:49.974685 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2ba05-26a8-4c82-878b-189a6c489b00 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:49.975556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2ba05-26a8-4c82-878b-189a6c489b00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:49.976029 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2ba05-26a8-4c82-878b-189a6c489b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:49.977616 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2ba05-26a8-4c82-878b-189a6c489b00 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:49.987133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 75/159] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:29:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:29:49.992977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab6bfe-fc5b-4461-b13d-8f7ce4e563b3 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:50.093174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:50.109757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab6bfe-fc5b-4461-b13d-8f7ce4e563b3 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:50.151462 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b148fa-2b89-4ccb-99a4-5ec8ba762077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:50.152415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b148fa-2b89-4ccb-99a4-5ec8ba762077 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:50.152866 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b148fa-2b89-4ccb-99a4-5ec8ba762077 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:50.153332 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b148fa-2b89-4ccb-99a4-5ec8ba762077 None admin] PATH_INFO: `/v3/users/342fd70c02c34a39b525655b3d8d3e46` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:50.156916 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b148fa-2b89-4ccb-99a4-5ec8ba762077 None admin] RBAC: Authorizing `identity:get_user(user_id=342fd70c02c34a39b525655b3d8d3e46)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:50.158524 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b148fa-2b89-4ccb-99a4-5ec8ba762077 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:50.160294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 85/160] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:49 2022] GET /identity/v3/users/342fd70c02c34a39b525655b3d8d3e46 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:50.166142 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2ba05-26a8-4c82-878b-189a6c489b00 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:50.217963 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b148fa-2b89-4ccb-99a4-5ec8ba762077 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:50.346074 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2ba05-26a8-4c82-878b-189a6c489b00 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:50.394049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b148fa-2b89-4ccb-99a4-5ec8ba762077 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:50.415962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb752b6-5004-4b85-ae24-ffa297d17d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:50.416612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb752b6-5004-4b85-ae24-ffa297d17d4e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:50.416886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb752b6-5004-4b85-ae24-ffa297d17d4e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:50.417166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb752b6-5004-4b85-ae24-ffa297d17d4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:50.465018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75093d-8432-4733-9667-e3dc26cec211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:50.465680 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75093d-8432-4733-9667-e3dc26cec211 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:50.465959 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75093d-8432-4733-9667-e3dc26cec211 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:50.466235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75093d-8432-4733-9667-e3dc26cec211 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:50.486499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75093d-8432-4733-9667-e3dc26cec211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-bf75093d-8432-4733-9667-e3dc26cec211 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:50.491401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:50.492531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:50.493450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:50.493450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:50.493450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:50.493450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:50.493450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:50.493450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:50.493450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:50.493450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:50.493450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:50.493450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:50.493450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:50.493450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:29:50.493450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 86/161] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:29:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:50.494074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75093d-8432-4733-9667-e3dc26cec211 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:50.508666 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:50.519506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:50.565517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb752b6-5004-4b85-ae24-ffa297d17d4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:50.567009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb752b6-5004-4b85-ae24-ffa297d17d4e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:50.647099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75093d-8432-4733-9667-e3dc26cec211 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:50.707966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 76/162] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:29:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:29:50.713125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb752b6-5004-4b85-ae24-ffa297d17d4e None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:50.766174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7941bd-2a33-4a5a-b1d9-546074bef1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:50.766932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7941bd-2a33-4a5a-b1d9-546074bef1c7 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:50.767218 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7941bd-2a33-4a5a-b1d9-546074bef1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:50.767563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7941bd-2a33-4a5a-b1d9-546074bef1c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:50.808467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:50.812752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7941bd-2a33-4a5a-b1d9-546074bef1c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-3e7941bd-2a33-4a5a-b1d9-546074bef1c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:50.817672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:50.823575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:50.824401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:50.824401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:50.824401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:50.824401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:50.824401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:50.824401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:50.824401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:50.824401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:50.824401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:50.824401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:50.824401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:29:50.824401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:29:50.824401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 87/163] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:50.824401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7941bd-2a33-4a5a-b1d9-546074bef1c7 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:50.830441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb752b6-5004-4b85-ae24-ffa297d17d4e None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:50.870439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11969e92-2520-4c62-ad93-1933614e0436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:50.871470 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11969e92-2520-4c62-ad93-1933614e0436 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:50.871975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11969e92-2520-4c62-ad93-1933614e0436 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:50.872413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11969e92-2520-4c62-ad93-1933614e0436 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:50.873278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11969e92-2520-4c62-ad93-1933614e0436 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:50.873752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11969e92-2520-4c62-ad93-1933614e0436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:50.875795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11969e92-2520-4c62-ad93-1933614e0436 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:50.887210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 77/164] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:50.896931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11969e92-2520-4c62-ad93-1933614e0436 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:50.981113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:51.028739 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7941bd-2a33-4a5a-b1d9-546074bef1c7 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:51.067321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ad215-a0e8-4778-860d-1f3f3599d1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:51.067959 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ad215-a0e8-4778-860d-1f3f3599d1c8 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:51.068268 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ad215-a0e8-4778-860d-1f3f3599d1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:51.068538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ad215-a0e8-4778-860d-1f3f3599d1c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:51.079753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ad215-a0e8-4778-860d-1f3f3599d1c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-2a8ad215-a0e8-4778-860d-1f3f3599d1c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:51.085409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:51.086438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:51.087540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:51.087540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:51.087540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:51.087540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:51.087540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:51.087540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:51.087540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:51.087540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:51.087540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:51.087540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:51.087540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:29:51.087540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:29:51.087540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 88/165] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:51.088381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ad215-a0e8-4778-860d-1f3f3599d1c8 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:51.110628 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11969e92-2520-4c62-ad93-1933614e0436 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:51.204612 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ad215-a0e8-4778-860d-1f3f3599d1c8 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:51.221718 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6746f1-36ba-4606-a929-e3b1150e047b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:51.222380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6746f1-36ba-4606-a929-e3b1150e047b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:51.222651 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6746f1-36ba-4606-a929-e3b1150e047b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:51.222925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6746f1-36ba-4606-a929-e3b1150e047b None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:51.224099 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6746f1-36ba-4606-a929-e3b1150e047b None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:51.225571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6746f1-36ba-4606-a929-e3b1150e047b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:51.236626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 78/166] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:50 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:51.237502 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6746f1-36ba-4606-a929-e3b1150e047b None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:51.243842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4d790-5ed1-4679-8d12-a6bdf375da4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:51.244783 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4d790-5ed1-4679-8d12-a6bdf375da4d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:51.245262 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4d790-5ed1-4679-8d12-a6bdf375da4d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:51.245724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4d790-5ed1-4679-8d12-a6bdf375da4d None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:51.246600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4d790-5ed1-4679-8d12-a6bdf375da4d None admin] RBAC: Adding query filter params (name=member) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:51.247118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4d790-5ed1-4679-8d12-a6bdf375da4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:51.248465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:51.249492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4d790-5ed1-4679-8d12-a6bdf375da4d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:51.256799 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:51.263446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 89/167] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:29:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:51.264832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4d790-5ed1-4679-8d12-a6bdf375da4d None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:51.374704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4d790-5ed1-4679-8d12-a6bdf375da4d None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:51.410490 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a38f3-8762-4b6e-b1be-6d32de279967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:51.411455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a38f3-8762-4b6e-b1be-6d32de279967 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:51.411933 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a38f3-8762-4b6e-b1be-6d32de279967 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:51.412472 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a38f3-8762-4b6e-b1be-6d32de279967 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:51.413502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a38f3-8762-4b6e-b1be-6d32de279967 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:51.414008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a38f3-8762-4b6e-b1be-6d32de279967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:51.415601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a38f3-8762-4b6e-b1be-6d32de279967 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:51.425792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 90/168] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:29:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:51.426928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a38f3-8762-4b6e-b1be-6d32de279967 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:51.454805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6746f1-36ba-4606-a929-e3b1150e047b None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:51.497224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:51.497390 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f0296-e044-48e8-8d3d-15351117237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:51.498211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f0296-e044-48e8-8d3d-15351117237c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:51.498317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f0296-e044-48e8-8d3d-15351117237c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:51.498568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f0296-e044-48e8-8d3d-15351117237c None admin] PATH_INFO: `/v3/users/2047940dbd8547dfbf3a3e01e9cedc83` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:51.500319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f0296-e044-48e8-8d3d-15351117237c None admin] RBAC: Authorizing `identity:get_user(user_id=2047940dbd8547dfbf3a3e01e9cedc83)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:51.502228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f0296-e044-48e8-8d3d-15351117237c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:51.504654 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 79/169] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:51 2022] GET /identity/v3/users/2047940dbd8547dfbf3a3e01e9cedc83 => generated 247 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:51.505247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f0296-e044-48e8-8d3d-15351117237c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:51.550292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a38f3-8762-4b6e-b1be-6d32de279967 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:51.599500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862aa10-7667-44f4-9107-98f939c5f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:51.600479 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862aa10-7667-44f4-9107-98f939c5f132 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:51.600965 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862aa10-7667-44f4-9107-98f939c5f132 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:51.601330 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:51.601706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862aa10-7667-44f4-9107-98f939c5f132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:51.603099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862aa10-7667-44f4-9107-98f939c5f132 None admin] RBAC: Adding query filter params (role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1, scope.project.id=71ed3cc8b5a141bda65164dab60ee555, user.id=342fd70c02c34a39b525655b3d8d3e46) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:51.603620 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862aa10-7667-44f4-9107-98f939c5f132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:51.605695 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862aa10-7667-44f4-9107-98f939c5f132 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:51.613431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 91/170] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:29:51 2022] GET /identity/v3/role_assignments?user.id=342fd70c02c34a39b525655b3d8d3e46&scope.project.id=71ed3cc8b5a141bda65164dab60ee555&role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:51.623871 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9411d26-bca2-4825-904a-ff46b0ca9ddd None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:51.624416 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9411d26-bca2-4825-904a-ff46b0ca9ddd None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:51.625431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9411d26-bca2-4825-904a-ff46b0ca9ddd None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:51.627629 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 92/171] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:51 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:51.628803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9411d26-bca2-4825-904a-ff46b0ca9ddd None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:51.660112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f0296-e044-48e8-8d3d-15351117237c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:51.727137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c9569-661e-44ec-88b7-19de02ca6063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:51.727792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c9569-661e-44ec-88b7-19de02ca6063 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:51.728075 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c9569-661e-44ec-88b7-19de02ca6063 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:51.728398 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c9569-661e-44ec-88b7-19de02ca6063 None admin] PATH_INFO: `/v3/users/342fd70c02c34a39b525655b3d8d3e46` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:51.729607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c9569-661e-44ec-88b7-19de02ca6063 None admin] RBAC: Authorizing `identity:get_user(user_id=342fd70c02c34a39b525655b3d8d3e46)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:51.731090 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c9569-661e-44ec-88b7-19de02ca6063 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:51.733109 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 80/172] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:51 2022] GET /identity/v3/users/342fd70c02c34a39b525655b3d8d3e46 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:51.733920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c9569-661e-44ec-88b7-19de02ca6063 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:51.818064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9411d26-bca2-4825-904a-ff46b0ca9ddd None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:51.846740 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:51.856711 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c9569-661e-44ec-88b7-19de02ca6063 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:51.866771 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291e741-e75e-4304-83e3-5d0f7bdc3ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:51.866771 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291e741-e75e-4304-83e3-5d0f7bdc3ffb None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:51.866771 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291e741-e75e-4304-83e3-5d0f7bdc3ffb None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:51.866771 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291e741-e75e-4304-83e3-5d0f7bdc3ffb None admin] PATH_INFO: `/v3/users/45d7dd3085b44590b16bc189308ac94e` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:51.867165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291e741-e75e-4304-83e3-5d0f7bdc3ffb None admin] RBAC: Authorizing `identity:get_user(user_id=45d7dd3085b44590b16bc189308ac94e)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:51.868404 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291e741-e75e-4304-83e3-5d0f7bdc3ffb None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:51.874723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 93/173] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:51 2022] GET /identity/v3/users/45d7dd3085b44590b16bc189308ac94e => generated 289 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:51.875816 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e335e-7fc2-4c91-a91d-3a3b3b575475 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:51.876131 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e335e-7fc2-4c91-a91d-3a3b3b575475 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:51.876403 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e335e-7fc2-4c91-a91d-3a3b3b575475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:51.897562 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-e04e335e-7fc2-4c91-a91d-3a3b3b575475 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:51.899225 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e04e335e-7fc2-4c91-a91d-3a3b3b575475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:51.903232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75cde7-9602-49df-b271-0f371074677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:51.903232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75cde7-9602-49df-b271-0f371074677a None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:51.903553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75cde7-9602-49df-b271-0f371074677a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:51.903778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75cde7-9602-49df-b271-0f371074677a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:51.918652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:51.981497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 94/174] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:51.984584 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75cde7-9602-49df-b271-0f371074677a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:51.986086 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75cde7-9602-49df-b271-0f371074677a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:51.990492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108335a-63de-4b18-bb42-b406ab3a4720 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:51.991005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108335a-63de-4b18-bb42-b406ab3a4720 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:51.991484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108335a-63de-4b18-bb42-b406ab3a4720 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:51.993045 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 95/175] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:51.994692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108335a-63de-4b18-bb42-b406ab3a4720 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:52.098818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 81/176] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:29:52.099619 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75cde7-9602-49df-b271-0f371074677a None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:52.116777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108335a-63de-4b18-bb42-b406ab3a4720 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:52.138962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:52.148703 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:52.154835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea61255-6e60-492d-be4a-6ddb2d35877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:52.155650 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea61255-6e60-492d-be4a-6ddb2d35877a None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:52.156750 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea61255-6e60-492d-be4a-6ddb2d35877a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:52.157185 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea61255-6e60-492d-be4a-6ddb2d35877a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:52.212199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75cde7-9602-49df-b271-0f371074677a None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:52.230472 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea61255-6e60-492d-be4a-6ddb2d35877a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:52.231946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea61255-6e60-492d-be4a-6ddb2d35877a None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:52.251323 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9abee2-135e-4078-bcbb-3a3dd24e3983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:52.252252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9abee2-135e-4078-bcbb-3a3dd24e3983 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:52.252705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9abee2-135e-4078-bcbb-3a3dd24e3983 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:52.253243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9abee2-135e-4078-bcbb-3a3dd24e3983 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:52.254388 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9abee2-135e-4078-bcbb-3a3dd24e3983 None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:52.255954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9abee2-135e-4078-bcbb-3a3dd24e3983 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:52.257975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 82/177] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:52 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:52.258973 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059244de-94f9-4c02-a833-b976719e9c97 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:52.259254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059244de-94f9-4c02-a833-b976719e9c97 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:52.259531 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059244de-94f9-4c02-a833-b976719e9c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:52.277671 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-059244de-94f9-4c02-a833-b976719e9c97 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:52.278908 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-059244de-94f9-4c02-a833-b976719e9c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:52.335142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 96/178] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:29:52.340605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea61255-6e60-492d-be4a-6ddb2d35877a None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:52.345911 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 83/179] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:52.347207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a281a09-ff23-4efd-a746-87c99940061e None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:52.347498 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a281a09-ff23-4efd-a746-87c99940061e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:52.347773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a281a09-ff23-4efd-a746-87c99940061e None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:52.349108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 84/180] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:52.349744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a281a09-ff23-4efd-a746-87c99940061e None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:52.367337 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:52.397885 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:52.452185 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea61255-6e60-492d-be4a-6ddb2d35877a None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:52.461853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a281a09-ff23-4efd-a746-87c99940061e None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:52.488774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c4104-f2a3-4517-8376-62c442793358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:52.489408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c4104-f2a3-4517-8376-62c442793358 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:52.489692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c4104-f2a3-4517-8376-62c442793358 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:52.489961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c4104-f2a3-4517-8376-62c442793358 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:52.491090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c4104-f2a3-4517-8376-62c442793358 None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:52.492569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c4104-f2a3-4517-8376-62c442793358 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:52.494308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 97/181] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:52 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:52.495173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c4104-f2a3-4517-8376-62c442793358 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:52.504619 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97694435-f30f-41a6-aefb-5f864f532f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:52.505264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97694435-f30f-41a6-aefb-5f864f532f97 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:52.505546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97694435-f30f-41a6-aefb-5f864f532f97 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:52.505822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97694435-f30f-41a6-aefb-5f864f532f97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:52.517956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97694435-f30f-41a6-aefb-5f864f532f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-97694435-f30f-41a6-aefb-5f864f532f97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:52.523345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:52.524281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:52.525083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:52.525083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:52.525083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:52.525083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:52.525083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:52.525083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:52.525083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:52.525083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:52.525083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:52.525083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:52.525083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:52.525083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:29:52.525083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 85/182] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:29:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:52.526310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97694435-f30f-41a6-aefb-5f864f532f97 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:52.600275 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:52.616808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c4104-f2a3-4517-8376-62c442793358 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:52.637163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:52.640155 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97694435-f30f-41a6-aefb-5f864f532f97 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:52.652485 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df69fcc-9068-4e32-a061-fd4df881bd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:52.653146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df69fcc-9068-4e32-a061-fd4df881bd72 None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:52.653426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df69fcc-9068-4e32-a061-fd4df881bd72 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:52.653707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df69fcc-9068-4e32-a061-fd4df881bd72 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555/users/45d7dd3085b44590b16bc189308ac94e/roles/c0d24825bab14907b75e4205bd286479` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:52.655604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df69fcc-9068-4e32-a061-fd4df881bd72 None admin] RBAC: Authorizing `identity:create_grant(project_id=71ed3cc8b5a141bda65164dab60ee555, user_id=45d7dd3085b44590b16bc189308ac94e, role_id=c0d24825bab14907b75e4205bd286479)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:52.657163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df69fcc-9068-4e32-a061-fd4df881bd72 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:52.675072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c0772-eb4d-4646-a4f0-26c29aa34085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:52.675807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c0772-eb4d-4646-a4f0-26c29aa34085 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:52.676113 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c0772-eb4d-4646-a4f0-26c29aa34085 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:52.676391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c0772-eb4d-4646-a4f0-26c29aa34085 None admin] PATH_INFO: `/v3/projects/00a7fa2bed024e4bb40b766c05f019ae` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:52.677510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c0772-eb4d-4646-a4f0-26c29aa34085 None admin] RBAC: Authorizing `identity:get_project(project_id=00a7fa2bed024e4bb40b766c05f019ae)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:52.678944 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c0772-eb4d-4646-a4f0-26c29aa34085 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:52.680644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 86/183] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:52 2022] GET /identity/v3/projects/00a7fa2bed024e4bb40b766c05f019ae => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:52.681735 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9147ca-13c8-4d9e-8b86-c55d1eb3c76d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:52.682015 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9147ca-13c8-4d9e-8b86-c55d1eb3c76d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:52.682286 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9147ca-13c8-4d9e-8b86-c55d1eb3c76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:52.699901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-8d9147ca-13c8-4d9e-8b86-c55d1eb3c76d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:52.702168 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8d9147ca-13c8-4d9e-8b86-c55d1eb3c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:52.726251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 98/184] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:29:52 2022] PUT /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555/users/45d7dd3085b44590b16bc189308ac94e/roles/c0d24825bab14907b75e4205bd286479 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:52.727513 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df69fcc-9068-4e32-a061-fd4df881bd72 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:52.780927 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 87/185] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:52.789096 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9147ca-13c8-4d9e-8b86-c55d1eb3c76d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:52.870952 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df69fcc-9068-4e32-a061-fd4df881bd72 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:52.902391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:52.906723 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9147ca-13c8-4d9e-8b86-c55d1eb3c76d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:52.911701 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce9e04-68ec-4f9a-bae6-fa204e5e9845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:52.912680 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce9e04-68ec-4f9a-bae6-fa204e5e9845 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:52.916800 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce9e04-68ec-4f9a-bae6-fa204e5e9845 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:52.916800 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce9e04-68ec-4f9a-bae6-fa204e5e9845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:52.916800 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce9e04-68ec-4f9a-bae6-fa204e5e9845 None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=71ed3cc8b5a141bda65164dab60ee555, user.id=2047940dbd8547dfbf3a3e01e9cedc83) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:52.916800 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce9e04-68ec-4f9a-bae6-fa204e5e9845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:52.917319 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce9e04-68ec-4f9a-bae6-fa204e5e9845 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:52.926653 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 99/186] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:29:52 2022] GET /identity/v3/role_assignments?user.id=2047940dbd8547dfbf3a3e01e9cedc83&scope.project.id=71ed3cc8b5a141bda65164dab60ee555&role.id=a7d59d2982de4bfeb758dce70808029f => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:52.927757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce9e04-68ec-4f9a-bae6-fa204e5e9845 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:52.959395 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:52.961154 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387d7ac-1b96-476f-82cc-4aee47d9a73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:52.961781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387d7ac-1b96-476f-82cc-4aee47d9a73f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:52.962059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387d7ac-1b96-476f-82cc-4aee47d9a73f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:52.962346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387d7ac-1b96-476f-82cc-4aee47d9a73f None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:52.963091 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387d7ac-1b96-476f-82cc-4aee47d9a73f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:52.963390 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387d7ac-1b96-476f-82cc-4aee47d9a73f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:52.964844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387d7ac-1b96-476f-82cc-4aee47d9a73f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:52.981196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 88/187] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:52.983369 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387d7ac-1b96-476f-82cc-4aee47d9a73f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:53.103123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce9e04-68ec-4f9a-bae6-fa204e5e9845 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:53.138747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387d7ac-1b96-476f-82cc-4aee47d9a73f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:53.152220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff7cc8-2f50-44a7-8d74-bbfc2dddaf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:53.153291 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff7cc8-2f50-44a7-8d74-bbfc2dddaf03 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:53.153798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff7cc8-2f50-44a7-8d74-bbfc2dddaf03 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:53.154294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff7cc8-2f50-44a7-8d74-bbfc2dddaf03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:53.168985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff7cc8-2f50-44a7-8d74-bbfc2dddaf03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-0bff7cc8-2f50-44a7-8d74-bbfc2dddaf03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:53.175489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:53.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:53.177667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:53.177667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:53.177667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:53.177667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:53.177667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:53.177667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:53.177667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:53.177667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:53.177667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:53.177667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:53.177667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:29:53.177667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:29:53.179614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 100/188] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:29:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:53.181109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff7cc8-2f50-44a7-8d74-bbfc2dddaf03 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:53.185990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ca7a2-1283-4c72-84e3-c164bc28b421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:53.186703 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ca7a2-1283-4c72-84e3-c164bc28b421 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:53.186912 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ca7a2-1283-4c72-84e3-c164bc28b421 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:53.187194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ca7a2-1283-4c72-84e3-c164bc28b421 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:53.189138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ca7a2-1283-4c72-84e3-c164bc28b421 None admin] RBAC: Adding query filter params (role.id=7cca4e8860b3437e801ffbf8429da7dd, scope.project.id=00a7fa2bed024e4bb40b766c05f019ae, user.id=342fd70c02c34a39b525655b3d8d3e46) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:53.189138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ca7a2-1283-4c72-84e3-c164bc28b421 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:53.190445 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ca7a2-1283-4c72-84e3-c164bc28b421 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:53.197490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 89/189] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:29:52 2022] GET /identity/v3/role_assignments?user.id=342fd70c02c34a39b525655b3d8d3e46&scope.project.id=00a7fa2bed024e4bb40b766c05f019ae&role.id=7cca4e8860b3437e801ffbf8429da7dd => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:53.198600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ca7a2-1283-4c72-84e3-c164bc28b421 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:53.244288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:53.278019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:53.311604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff7cc8-2f50-44a7-8d74-bbfc2dddaf03 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:53.354442 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d022b-89bf-4c75-859f-00efd6e53e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:53.355099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d022b-89bf-4c75-859f-00efd6e53e6b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:53.355380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d022b-89bf-4c75-859f-00efd6e53e6b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:53.355654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d022b-89bf-4c75-859f-00efd6e53e6b None admin] PATH_INFO: `/v3/users/06257f1f40ae40548e89659b8983e790` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:53.357211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ca7a2-1283-4c72-84e3-c164bc28b421 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:53.371699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d022b-89bf-4c75-859f-00efd6e53e6b None admin] RBAC: Authorizing `identity:get_user(user_id=06257f1f40ae40548e89659b8983e790)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:53.373232 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d022b-89bf-4c75-859f-00efd6e53e6b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:53.375522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 101/190] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:53 2022] GET /identity/v3/users/06257f1f40ae40548e89659b8983e790 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:53.380840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d022b-89bf-4c75-859f-00efd6e53e6b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:53.411288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a28b80-a342-4a11-9c5c-f3121b136a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:53.411857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a28b80-a342-4a11-9c5c-f3121b136a5e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:53.412869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a28b80-a342-4a11-9c5c-f3121b136a5e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:53.412869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a28b80-a342-4a11-9c5c-f3121b136a5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:53.414276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a28b80-a342-4a11-9c5c-f3121b136a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:53.415748 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a28b80-a342-4a11-9c5c-f3121b136a5e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:53.417382 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 90/191] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:29:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:53.418213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a28b80-a342-4a11-9c5c-f3121b136a5e None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:53.505253 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d022b-89bf-4c75-859f-00efd6e53e6b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:53.535861 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:53.539139 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:53.544891 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81998e-7da9-404e-ae2f-26512435bbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:53.545484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81998e-7da9-404e-ae2f-26512435bbb1 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:53.545610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a28b80-a342-4a11-9c5c-f3121b136a5e None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:53.545773 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81998e-7da9-404e-ae2f-26512435bbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:53.546030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81998e-7da9-404e-ae2f-26512435bbb1 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:53.547215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81998e-7da9-404e-ae2f-26512435bbb1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:53.547513 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81998e-7da9-404e-ae2f-26512435bbb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:53.548935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81998e-7da9-404e-ae2f-26512435bbb1 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:53.557408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 102/192] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:29:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:53.558013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81998e-7da9-404e-ae2f-26512435bbb1 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:53.588380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400f339-3f0b-4044-9106-6ab2ccdead53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:53.589064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400f339-3f0b-4044-9106-6ab2ccdead53 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:53.589624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400f339-3f0b-4044-9106-6ab2ccdead53 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:53.590086 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400f339-3f0b-4044-9106-6ab2ccdead53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:53.668448 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400f339-3f0b-4044-9106-6ab2ccdead53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:53.669852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400f339-3f0b-4044-9106-6ab2ccdead53 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:53.677870 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81998e-7da9-404e-ae2f-26512435bbb1 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:53.715453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945386b2-c249-49a3-ae92-20cde080485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:53.716428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945386b2-c249-49a3-ae92-20cde080485f None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:53.716710 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945386b2-c249-49a3-ae92-20cde080485f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:53.716988 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945386b2-c249-49a3-ae92-20cde080485f None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:53.717659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945386b2-c249-49a3-ae92-20cde080485f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:53.719726 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945386b2-c249-49a3-ae92-20cde080485f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:53.767470 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:53.781997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 91/193] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:29:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:29:53.783211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400f339-3f0b-4044-9106-6ab2ccdead53 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:53.875767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 103/194] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:29:53 2022] POST /identity/v3/users => generated 297 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:53.876662 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945386b2-c249-49a3-ae92-20cde080485f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:53.898938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400f339-3f0b-4044-9106-6ab2ccdead53 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:53.951349 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:53.951744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689a0de-f0a0-466f-a942-ea0efd7feaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:53.954172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689a0de-f0a0-466f-a942-ea0efd7feaf3 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:53.954699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689a0de-f0a0-466f-a942-ea0efd7feaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:53.955165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689a0de-f0a0-466f-a942-ea0efd7feaf3 None admin] PATH_INFO: `/v3/users/06257f1f40ae40548e89659b8983e790` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:53.956731 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689a0de-f0a0-466f-a942-ea0efd7feaf3 None admin] RBAC: Authorizing `identity:get_user(user_id=06257f1f40ae40548e89659b8983e790)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:53.959340 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689a0de-f0a0-466f-a942-ea0efd7feaf3 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:53.961991 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 92/195] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:53 2022] GET /identity/v3/users/06257f1f40ae40548e89659b8983e790 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:53.969006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689a0de-f0a0-466f-a942-ea0efd7feaf3 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:54.025668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945386b2-c249-49a3-ae92-20cde080485f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:54.041787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:54.064904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7e7bf-e3a9-4d2c-943f-b49259dceb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:54.066481 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7e7bf-e3a9-4d2c-943f-b49259dceb2f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:54.066481 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7e7bf-e3a9-4d2c-943f-b49259dceb2f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:54.066824 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7e7bf-e3a9-4d2c-943f-b49259dceb2f None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:54.068414 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7e7bf-e3a9-4d2c-943f-b49259dceb2f None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:54.069870 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7e7bf-e3a9-4d2c-943f-b49259dceb2f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:54.071679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 104/196] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:53 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:54.078114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7e7bf-e3a9-4d2c-943f-b49259dceb2f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:54.092869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689a0de-f0a0-466f-a942-ea0efd7feaf3 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:54.145716 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632637f-1bdc-48f0-9aec-5fdf855c320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:54.146344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632637f-1bdc-48f0-9aec-5fdf855c320c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:54.146625 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632637f-1bdc-48f0-9aec-5fdf855c320c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:54.146899 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632637f-1bdc-48f0-9aec-5fdf855c320c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:54.221067 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7e7bf-e3a9-4d2c-943f-b49259dceb2f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:54.239187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632637f-1bdc-48f0-9aec-5fdf855c320c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:54.241924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632637f-1bdc-48f0-9aec-5fdf855c320c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:54.243464 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:54.268641 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0bbf3-9caa-4c49-b722-c21905a053c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:54.269399 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0bbf3-9caa-4c49-b722-c21905a053c2 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:54.269689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0bbf3-9caa-4c49-b722-c21905a053c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:54.269965 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0bbf3-9caa-4c49-b722-c21905a053c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:54.270968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0bbf3-9caa-4c49-b722-c21905a053c2 None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=95503c3913594436a874debf8bd8d080, user.id=06257f1f40ae40548e89659b8983e790) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:54.271356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0bbf3-9caa-4c49-b722-c21905a053c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:54.272763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0bbf3-9caa-4c49-b722-c21905a053c2 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:54.280452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 105/197] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:29:54 2022] GET /identity/v3/role_assignments?user.id=06257f1f40ae40548e89659b8983e790&scope.project.id=95503c3913594436a874debf8bd8d080&role.id=a7d59d2982de4bfeb758dce70808029f => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:54.331280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:54.389841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 93/198] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:29:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:29:54.393229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0bbf3-9caa-4c49-b722-c21905a053c2 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:54.523537 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0bbf3-9caa-4c49-b722-c21905a053c2 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:54.571862 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdce3bb-8204-4f1d-a301-358827ae42d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:54.572535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdce3bb-8204-4f1d-a301-358827ae42d7 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:54.572817 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdce3bb-8204-4f1d-a301-358827ae42d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:54.573090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdce3bb-8204-4f1d-a301-358827ae42d7 None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:54.576777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdce3bb-8204-4f1d-a301-358827ae42d7 None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:54.578780 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdce3bb-8204-4f1d-a301-358827ae42d7 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:54.580816 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 106/199] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:54 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:54.591028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632637f-1bdc-48f0-9aec-5fdf855c320c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:54.754089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632637f-1bdc-48f0-9aec-5fdf855c320c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:54.794883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a20a-bbca-4f36-9974-bcd8c50dde01 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:54.795055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a20a-bbca-4f36-9974-bcd8c50dde01 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:54.795351 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a20a-bbca-4f36-9974-bcd8c50dde01 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:54.797285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 107/200] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:54.803046 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c4766-5d27-4cec-b1c0-d13c9ad35c81 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:54.803333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c4766-5d27-4cec-b1c0-d13c9ad35c81 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:54.803615 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c4766-5d27-4cec-b1c0-d13c9ad35c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:54.808072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b6baa-d149-4c12-a54d-dfc48fba27f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:54.808728 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b6baa-d149-4c12-a54d-dfc48fba27f5 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:54.809006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b6baa-d149-4c12-a54d-dfc48fba27f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:54.809276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b6baa-d149-4c12-a54d-dfc48fba27f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:54.810014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b6baa-d149-4c12-a54d-dfc48fba27f5 None admin] RBAC: Adding query filter params (role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1, scope.project.id=95503c3913594436a874debf8bd8d080, user.id=06257f1f40ae40548e89659b8983e790) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:54.810324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b6baa-d149-4c12-a54d-dfc48fba27f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:54.811777 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b6baa-d149-4c12-a54d-dfc48fba27f5 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:54.830456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 94/201] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:29:54 2022] GET /identity/v3/role_assignments?user.id=06257f1f40ae40548e89659b8983e790&scope.project.id=95503c3913594436a874debf8bd8d080&role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:54.841393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-2f9c4766-5d27-4cec-b1c0-d13c9ad35c81 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:54.842634 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-2f9c4766-5d27-4cec-b1c0-d13c9ad35c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:54.917159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:54.952652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 108/202] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 29 22:29:55.353953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b6baa-d149-4c12-a54d-dfc48fba27f5 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:55.390032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:55.492912 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b6baa-d149-4c12-a54d-dfc48fba27f5 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:55.528456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28efb1-47dd-4cdf-9b92-b5343c0f6fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:55.529093 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28efb1-47dd-4cdf-9b92-b5343c0f6fbc None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:55.529370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28efb1-47dd-4cdf-9b92-b5343c0f6fbc None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:55.529643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28efb1-47dd-4cdf-9b92-b5343c0f6fbc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:55.540614 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28efb1-47dd-4cdf-9b92-b5343c0f6fbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-8c28efb1-47dd-4cdf-9b92-b5343c0f6fbc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:55.545870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:55.547428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:55.548275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:55.548275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:55.548275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:55.548275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:55.548275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:55.548275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:55.548275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:55.548275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:55.548275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:55.548275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:55.548275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:29:55.548275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:29:55.548275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 95/203] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:55.555554 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c4766-5d27-4cec-b1c0-d13c9ad35c81 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:55.730955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c4766-5d27-4cec-b1c0-d13c9ad35c81 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:55.776442 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1acb6-e283-4a3c-a655-57e471f66888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:55.777061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1acb6-e283-4a3c-a655-57e471f66888 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:55.777342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1acb6-e283-4a3c-a655-57e471f66888 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:55.777679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1acb6-e283-4a3c-a655-57e471f66888 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:55.778367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1acb6-e283-4a3c-a655-57e471f66888 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:55.778671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1acb6-e283-4a3c-a655-57e471f66888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:55.780118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1acb6-e283-4a3c-a655-57e471f66888 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:55.793237 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 109/204] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:29:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:55.799502 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28efb1-47dd-4cdf-9b92-b5343c0f6fbc None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:55.912281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:55.932655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28efb1-47dd-4cdf-9b92-b5343c0f6fbc None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:55.982982 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da455da2-fd23-4037-a42d-fc7eb32d05b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:55.983541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da455da2-fd23-4037-a42d-fc7eb32d05b8 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:55.983822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da455da2-fd23-4037-a42d-fc7eb32d05b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:55.984146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da455da2-fd23-4037-a42d-fc7eb32d05b8 None admin] PATH_INFO: `/v3/users/45d7dd3085b44590b16bc189308ac94e` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:55.988816 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da455da2-fd23-4037-a42d-fc7eb32d05b8 None admin] RBAC: Authorizing `identity:get_user(user_id=45d7dd3085b44590b16bc189308ac94e)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:55.990284 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da455da2-fd23-4037-a42d-fc7eb32d05b8 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:55.992239 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 96/205] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:55 2022] GET /identity/v3/users/45d7dd3085b44590b16bc189308ac94e => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:55.997984 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1acb6-e283-4a3c-a655-57e471f66888 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:56.086373 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:56.192421 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1acb6-e283-4a3c-a655-57e471f66888 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:56.245965 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5044d3f-aa1e-4277-b764-082f7d5af684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:56.246498 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5044d3f-aa1e-4277-b764-082f7d5af684 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:56.246784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5044d3f-aa1e-4277-b764-082f7d5af684 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:56.247058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5044d3f-aa1e-4277-b764-082f7d5af684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:56.342497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5044d3f-aa1e-4277-b764-082f7d5af684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:56.344000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5044d3f-aa1e-4277-b764-082f7d5af684 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:56.400229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:56.474692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 110/206] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:29:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:29:56.478103 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa9c78-bf93-4361-8178-0e15ca8c4362 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:56.478391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa9c78-bf93-4361-8178-0e15ca8c4362 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:56.478669 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa9c78-bf93-4361-8178-0e15ca8c4362 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:56.480000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 97/207] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:56.480939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5044d3f-aa1e-4277-b764-082f7d5af684 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:56.488478 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cda02-2f6f-4b56-bd42-e7445a06ba93 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:56.488766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cda02-2f6f-4b56-bd42-e7445a06ba93 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:56.489048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cda02-2f6f-4b56-bd42-e7445a06ba93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:56.516922 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ad3cda02-2f6f-4b56-bd42-e7445a06ba93 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:56.518050 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ad3cda02-2f6f-4b56-bd42-e7445a06ba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:56.625768 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 98/208] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:29:56.677642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5044d3f-aa1e-4277-b764-082f7d5af684 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:56.684324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b63f6-d21f-4a8f-b37a-3f86ca463be4 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:56.685877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b63f6-d21f-4a8f-b37a-3f86ca463be4 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:56.685877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b63f6-d21f-4a8f-b37a-3f86ca463be4 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:56.686514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 99/209] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:29:56.697905 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cc9fa-9747-4336-85e4-cd2f9a4c1265 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:56.698197 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cc9fa-9747-4336-85e4-cd2f9a4c1265 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:56.698457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cc9fa-9747-4336-85e4-cd2f9a4c1265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:56.729138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-090cc9fa-9747-4336-85e4-cd2f9a4c1265 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:56.730329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-090cc9fa-9747-4336-85e4-cd2f9a4c1265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:56.754426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f374e23-adbc-4952-a376-25f82d212581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:56.755073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f374e23-adbc-4952-a376-25f82d212581 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:56.755354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f374e23-adbc-4952-a376-25f82d212581 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:56.755628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f374e23-adbc-4952-a376-25f82d212581 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:56.759106 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f374e23-adbc-4952-a376-25f82d212581 None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:56.760598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f374e23-adbc-4952-a376-25f82d212581 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:56.762247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 111/210] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:56 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:56.769090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f374e23-adbc-4952-a376-25f82d212581 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:56.790950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:56.838353 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 100/211] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:29:56.889492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0de4f-01fa-4cd3-9ecd-4c76f38d9e4a None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:56.889822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0de4f-01fa-4cd3-9ecd-4c76f38d9e4a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:56.890045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0de4f-01fa-4cd3-9ecd-4c76f38d9e4a None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:56.892009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 101/212] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:29:56.897659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1142582-9de5-4379-83de-ac5936ec90db None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:56.897943 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1142582-9de5-4379-83de-ac5936ec90db None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:56.898219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1142582-9de5-4379-83de-ac5936ec90db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:56.925422 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-c1142582-9de5-4379-83de-ac5936ec90db None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:56.926624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c1142582-9de5-4379-83de-ac5936ec90db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:56.938395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:56.969549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f374e23-adbc-4952-a376-25f82d212581 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:57.006029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdfa15-fa19-448c-acc3-c915effa27f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:57.006738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdfa15-fa19-448c-acc3-c915effa27f3 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:57.007022 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdfa15-fa19-448c-acc3-c915effa27f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:57.007302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdfa15-fa19-448c-acc3-c915effa27f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:57.007627 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 102/213] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:29:57.008041 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdfa15-fa19-448c-acc3-c915effa27f3 None admin] RBAC: Adding query filter params (role.id=c0d24825bab14907b75e4205bd286479, scope.project.id=71ed3cc8b5a141bda65164dab60ee555, user.id=45d7dd3085b44590b16bc189308ac94e) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:57.008379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdfa15-fa19-448c-acc3-c915effa27f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:57.008565 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1142582-9de5-4379-83de-ac5936ec90db None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:57.009940 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdfa15-fa19-448c-acc3-c915effa27f3 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:57.016606 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 112/214] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:29:56 2022] GET /identity/v3/role_assignments?user.id=45d7dd3085b44590b16bc189308ac94e&scope.project.id=71ed3cc8b5a141bda65164dab60ee555&role.id=c0d24825bab14907b75e4205bd286479 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:57.141423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdfa15-fa19-448c-acc3-c915effa27f3 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:57.148838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1142582-9de5-4379-83de-ac5936ec90db None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:57.189768 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c4487-ad39-4730-bb93-02fd7056b4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:57.190737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c4487-ad39-4730-bb93-02fd7056b4f6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:57.191518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c4487-ad39-4730-bb93-02fd7056b4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:57.191865 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c4487-ad39-4730-bb93-02fd7056b4f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:57.215539 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c4487-ad39-4730-bb93-02fd7056b4f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-196c4487-ad39-4730-bb93-02fd7056b4f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:57.221193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:57.222119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:57.222938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:57.222938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:57.222938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:57.222938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:57.222938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:57.222938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:57.222938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:57.222938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:57.222938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:57.222938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:57.222938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:29:57.222938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:29:57.222938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 103/215] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:57.224126 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f6c27-fef5-4144-b838-34b7cf59dac9 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:57.229069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f6c27-fef5-4144-b838-34b7cf59dac9 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:57.229344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f6c27-fef5-4144-b838-34b7cf59dac9 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:57.231014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 104/216] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:29:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:29:57.231785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f6c27-fef5-4144-b838-34b7cf59dac9 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:57.235487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:57.255315 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:57.293644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdfa15-fa19-448c-acc3-c915effa27f3 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:57.346601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7ad53-be44-4386-92ba-4cbebc91fc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:57.347715 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7ad53-be44-4386-92ba-4cbebc91fc3a None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:57.348014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7ad53-be44-4386-92ba-4cbebc91fc3a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:57.348670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7ad53-be44-4386-92ba-4cbebc91fc3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:57.362597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7ad53-be44-4386-92ba-4cbebc91fc3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:57.367561 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f6c27-fef5-4144-b838-34b7cf59dac9 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-84b7ad53-be44-4386-92ba-4cbebc91fc3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:57.369224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:57.370453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:57.371380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:57.371380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:57.371380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:57.371380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:57.371380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:57.371380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:57.371380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:57.371380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:57.371380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:57.371380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:57.371380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:29:57.371380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:29:57.371380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 113/217] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:29:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:29:57.372434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538ee78-bdcf-478c-b4c6-7e6f7920e923 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:57.372434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538ee78-bdcf-478c-b4c6-7e6f7920e923 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:57.372434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538ee78-bdcf-478c-b4c6-7e6f7920e923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:57.390710 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-7538ee78-bdcf-478c-b4c6-7e6f7920e923 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:29:57.391973 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-7538ee78-bdcf-478c-b4c6-7e6f7920e923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:29:57.407685 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb492555-856e-48b3-8f23-07734a59ad2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:57.408330 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb492555-856e-48b3-8f23-07734a59ad2a None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:57.408628 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb492555-856e-48b3-8f23-07734a59ad2a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:57.408898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb492555-856e-48b3-8f23-07734a59ad2a None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:57.409571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb492555-856e-48b3-8f23-07734a59ad2a None admin] RBAC: Adding query filter params (name=member) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:57.409878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb492555-856e-48b3-8f23-07734a59ad2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:57.411271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb492555-856e-48b3-8f23-07734a59ad2a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:57.419327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 105/218] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:29:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:57.420150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb492555-856e-48b3-8f23-07734a59ad2a None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:57.459605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 114/219] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:29:57.468919 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538ee78-bdcf-478c-b4c6-7e6f7920e923 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:57.493736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:57.530019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:57.535380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb492555-856e-48b3-8f23-07734a59ad2a None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:57.575246 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31643ed2-ddb7-4664-a290-4bff4dda9fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:57.575887 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31643ed2-ddb7-4664-a290-4bff4dda9fd0 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:57.576221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31643ed2-ddb7-4664-a290-4bff4dda9fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:57.576503 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31643ed2-ddb7-4664-a290-4bff4dda9fd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:57.577736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31643ed2-ddb7-4664-a290-4bff4dda9fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:57.579359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31643ed2-ddb7-4664-a290-4bff4dda9fd0 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:57.581137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 106/220] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:29:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:57.581729 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31643ed2-ddb7-4664-a290-4bff4dda9fd0 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:57.581828 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538ee78-bdcf-478c-b4c6-7e6f7920e923 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:57.630696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cf8b0-868a-4992-b0b3-d9d0cde1f813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:57.631427 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cf8b0-868a-4992-b0b3-d9d0cde1f813 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:57.631698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cf8b0-868a-4992-b0b3-d9d0cde1f813 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:57.631969 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cf8b0-868a-4992-b0b3-d9d0cde1f813 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:57.632752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cf8b0-868a-4992-b0b3-d9d0cde1f813 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:57.633013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cf8b0-868a-4992-b0b3-d9d0cde1f813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:57.634310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cf8b0-868a-4992-b0b3-d9d0cde1f813 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:57.642605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 115/221] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:29:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:57.643149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cf8b0-868a-4992-b0b3-d9d0cde1f813 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:57.697043 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31643ed2-ddb7-4664-a290-4bff4dda9fd0 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:57.728552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:57.733807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14664bf4-b866-4b5c-b796-d2c116df1559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:57.734971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14664bf4-b866-4b5c-b796-d2c116df1559 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:57.735253 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14664bf4-b866-4b5c-b796-d2c116df1559 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:57.741133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14664bf4-b866-4b5c-b796-d2c116df1559 None admin] PATH_INFO: `/v3/users/9577ac02df5e4f5299de79b49b9e7acb` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:57.750080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14664bf4-b866-4b5c-b796-d2c116df1559 None admin] RBAC: Authorizing `identity:get_user(user_id=9577ac02df5e4f5299de79b49b9e7acb)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:57.751446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cf8b0-868a-4992-b0b3-d9d0cde1f813 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:57.751900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14664bf4-b866-4b5c-b796-d2c116df1559 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:57.753512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 107/222] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:57 2022] GET /identity/v3/users/9577ac02df5e4f5299de79b49b9e7acb => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:57.754699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14664bf4-b866-4b5c-b796-d2c116df1559 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:57.777802 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:57.788928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08c589-0a3e-4ec4-b8b5-c67f9e43842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:57.789570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08c589-0a3e-4ec4-b8b5-c67f9e43842a None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:57.789905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08c589-0a3e-4ec4-b8b5-c67f9e43842a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:57.790243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08c589-0a3e-4ec4-b8b5-c67f9e43842a None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:57.792812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08c589-0a3e-4ec4-b8b5-c67f9e43842a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:57.792812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08c589-0a3e-4ec4-b8b5-c67f9e43842a None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:57.864921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14664bf4-b866-4b5c-b796-d2c116df1559 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:57.897235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 116/223] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:29:57 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:29:57.898085 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08c589-0a3e-4ec4-b8b5-c67f9e43842a None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:57.899428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64c7fb-e0df-409b-83ed-5b2897ad3ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:57.899821 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64c7fb-e0df-409b-83ed-5b2897ad3ac6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:57.900116 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64c7fb-e0df-409b-83ed-5b2897ad3ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:57.900454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64c7fb-e0df-409b-83ed-5b2897ad3ac6 None admin] PATH_INFO: `/v3/users/06257f1f40ae40548e89659b8983e790` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:57.901677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64c7fb-e0df-409b-83ed-5b2897ad3ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=06257f1f40ae40548e89659b8983e790)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:57.903165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64c7fb-e0df-409b-83ed-5b2897ad3ac6 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:57.905184 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 108/224] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:57 2022] GET /identity/v3/users/06257f1f40ae40548e89659b8983e790 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:57.906277 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64c7fb-e0df-409b-83ed-5b2897ad3ac6 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:57.977736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:58.031982 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64c7fb-e0df-409b-83ed-5b2897ad3ac6 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:58.036447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08c589-0a3e-4ec4-b8b5-c67f9e43842a None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:58.072673 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4dbd9-4abf-4dfc-b0de-e6832dda74bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:58.073295 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4dbd9-4abf-4dfc-b0de-e6832dda74bb None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:58.073576 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4dbd9-4abf-4dfc-b0de-e6832dda74bb None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:58.073851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4dbd9-4abf-4dfc-b0de-e6832dda74bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:58.079468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9e267-723e-4eb6-b228-48b9e40914af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:58.080208 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9e267-723e-4eb6-b228-48b9e40914af None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:58.080495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9e267-723e-4eb6-b228-48b9e40914af None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:58.080774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9e267-723e-4eb6-b228-48b9e40914af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:58.092227 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9e267-723e-4eb6-b228-48b9e40914af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-83e9e267-723e-4eb6-b228-48b9e40914af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:29:58.098125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:29:58.098994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:29:58.099903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:29:58.099903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:29:58.099903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:29:58.099903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:29:58.099903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:29:58.099903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:29:58.099903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:29:58.099903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:29:58.099903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:29:58.099903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:29:58.099903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:29:58.099903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:29:58.099903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 117/225] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:29:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:29:58.101366 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9e267-723e-4eb6-b228-48b9e40914af None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:58.151656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:58.165241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4dbd9-4abf-4dfc-b0de-e6832dda74bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:58.167247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4dbd9-4abf-4dfc-b0de-e6832dda74bb None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:58.233046 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9e267-723e-4eb6-b228-48b9e40914af None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:58.240314 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:58.291831 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e639b3-4e96-4bc0-b21d-75659b889a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:58.292904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e639b3-4e96-4bc0-b21d-75659b889a8d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:58.293384 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e639b3-4e96-4bc0-b21d-75659b889a8d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:58.293854 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e639b3-4e96-4bc0-b21d-75659b889a8d None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:58.294788 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 109/226] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:29:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:29:58.295858 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4dbd9-4abf-4dfc-b0de-e6832dda74bb None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:58.296113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e639b3-4e96-4bc0-b21d-75659b889a8d None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:58.306845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e639b3-4e96-4bc0-b21d-75659b889a8d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:58.310470 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 118/227] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:58 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:58.311862 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e639b3-4e96-4bc0-b21d-75659b889a8d None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:58.412350 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4dbd9-4abf-4dfc-b0de-e6832dda74bb None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:58.458429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b2c9a-e057-4873-88e4-a3b12629fa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:58.459324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b2c9a-e057-4873-88e4-a3b12629fa40 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:58.459751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b2c9a-e057-4873-88e4-a3b12629fa40 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:58.460206 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b2c9a-e057-4873-88e4-a3b12629fa40 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:58.461029 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b2c9a-e057-4873-88e4-a3b12629fa40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:58.461493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b2c9a-e057-4873-88e4-a3b12629fa40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:58.463417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b2c9a-e057-4873-88e4-a3b12629fa40 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:58.473996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 110/228] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:29:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:58.479579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b2c9a-e057-4873-88e4-a3b12629fa40 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:58.505794 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:58.508828 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e639b3-4e96-4bc0-b21d-75659b889a8d None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:58.527108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:58.572030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a32a94-8a6f-4825-8564-a53ad834c7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:58.573112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a32a94-8a6f-4825-8564-a53ad834c7d3 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:58.573615 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a32a94-8a6f-4825-8564-a53ad834c7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:58.574200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a32a94-8a6f-4825-8564-a53ad834c7d3 None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:58.576124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a32a94-8a6f-4825-8564-a53ad834c7d3 None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:58.579440 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a32a94-8a6f-4825-8564-a53ad834c7d3 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:58.582768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 119/229] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:58 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:58.584250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a32a94-8a6f-4825-8564-a53ad834c7d3 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:58.602791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b2c9a-e057-4873-88e4-a3b12629fa40 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:58.647677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adc7fd-d63c-4aa3-a387-1b0b09c6a812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:58.648646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adc7fd-d63c-4aa3-a387-1b0b09c6a812 None admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:58.649187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adc7fd-d63c-4aa3-a387-1b0b09c6a812 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:58.649609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adc7fd-d63c-4aa3-a387-1b0b09c6a812 None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080/users/06257f1f40ae40548e89659b8983e790/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:58.652041 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adc7fd-d63c-4aa3-a387-1b0b09c6a812 None admin] RBAC: Authorizing `identity:create_grant(project_id=95503c3913594436a874debf8bd8d080, user_id=06257f1f40ae40548e89659b8983e790, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:58.653894 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adc7fd-d63c-4aa3-a387-1b0b09c6a812 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:58.752913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 111/230] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:29:58 2022] PUT /identity/v3/projects/95503c3913594436a874debf8bd8d080/users/06257f1f40ae40548e89659b8983e790/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:29:58.754161 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adc7fd-d63c-4aa3-a387-1b0b09c6a812 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:58.795553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a32a94-8a6f-4825-8564-a53ad834c7d3 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:58.864046 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:58.889658 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adc7fd-d63c-4aa3-a387-1b0b09c6a812 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:58.904955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2ec0b-9c6c-4da7-a074-8da1bd1be183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:58.906633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2ec0b-9c6c-4da7-a074-8da1bd1be183 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:58.907120 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2ec0b-9c6c-4da7-a074-8da1bd1be183 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:58.907603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2ec0b-9c6c-4da7-a074-8da1bd1be183 None admin] PATH_INFO: `/v3/users/06257f1f40ae40548e89659b8983e790` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:58.913419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2ec0b-9c6c-4da7-a074-8da1bd1be183 None admin] RBAC: Authorizing `identity:get_user(user_id=06257f1f40ae40548e89659b8983e790)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:58.916248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2ec0b-9c6c-4da7-a074-8da1bd1be183 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:58.919287 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 120/231] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:29:58 2022] GET /identity/v3/users/06257f1f40ae40548e89659b8983e790 => generated 283 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:58.928840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2ec0b-9c6c-4da7-a074-8da1bd1be183 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:58.934397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3b75e-38fb-46f3-979a-58c0efd47696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:58.936557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b75e-38fb-46f3-979a-58c0efd47696 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:58.937183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b75e-38fb-46f3-979a-58c0efd47696 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:58.937963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b75e-38fb-46f3-979a-58c0efd47696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:58.938922 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3b75e-38fb-46f3-979a-58c0efd47696 None admin] RBAC: Adding query filter params (role.id=7cca4e8860b3437e801ffbf8429da7dd, scope.project.id=95503c3913594436a874debf8bd8d080, user.id=9577ac02df5e4f5299de79b49b9e7acb) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:29:58.939500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3b75e-38fb-46f3-979a-58c0efd47696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:58.941524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3b75e-38fb-46f3-979a-58c0efd47696 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:58.949604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 112/232] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:29:58 2022] GET /identity/v3/role_assignments?user.id=9577ac02df5e4f5299de79b49b9e7acb&scope.project.id=95503c3913594436a874debf8bd8d080&role.id=7cca4e8860b3437e801ffbf8429da7dd => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:29:59.034811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:29:59.123641 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2ec0b-9c6c-4da7-a074-8da1bd1be183 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:59.169622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5e038-e9dd-4fb8-90b2-55893da8e8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:59.170277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5e038-e9dd-4fb8-90b2-55893da8e8f4 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:59.170557 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5e038-e9dd-4fb8-90b2-55893da8e8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:59.170832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5e038-e9dd-4fb8-90b2-55893da8e8f4 None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:59.172078 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5e038-e9dd-4fb8-90b2-55893da8e8f4 None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:59.173610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5e038-e9dd-4fb8-90b2-55893da8e8f4 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:59.175607 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 121/233] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:29:58 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:29:59.183223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3b75e-38fb-46f3-979a-58c0efd47696 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:29:59.364760 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3b75e-38fb-46f3-979a-58c0efd47696 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:29:59.426667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052b815-b495-4147-b4a0-473d4c83d90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:29:59.427359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052b815-b495-4147-b4a0-473d4c83d90d None admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:29:59.427638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052b815-b495-4147-b4a0-473d4c83d90d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:29:59.427925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052b815-b495-4147-b4a0-473d4c83d90d None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080/users/06257f1f40ae40548e89659b8983e790/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:29:59.434157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052b815-b495-4147-b4a0-473d4c83d90d None admin] RBAC: Authorizing `identity:create_grant(project_id=95503c3913594436a874debf8bd8d080, user_id=06257f1f40ae40548e89659b8983e790, role_id=dcd0c9dbe86e4660b3d7ab1bce4762b1)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:29:59.435712 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052b815-b495-4147-b4a0-473d4c83d90d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:29:59.590260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 113/234] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:29:59 2022] PUT /identity/v3/projects/95503c3913594436a874debf8bd8d080/users/06257f1f40ae40548e89659b8983e790/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:00.311503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770d16-aab2-4f04-9377-659730c1cc43 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:00.312123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770d16-aab2-4f04-9377-659730c1cc43 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:00.312123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770d16-aab2-4f04-9377-659730c1cc43 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:00.313467 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 122/235] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:00.319397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2443941-0aab-43d9-80d3-431c45ea4d45 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:00.319927 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2443941-0aab-43d9-80d3-431c45ea4d45 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:00.320292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2443941-0aab-43d9-80d3-431c45ea4d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:00.333288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:00.345221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-e2443941-0aab-43d9-80d3-431c45ea4d45 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:00.348285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e2443941-0aab-43d9-80d3-431c45ea4d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:00.455386 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 114/236] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:00.545884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03343c19-9cef-425e-bfe4-0a91b8a60166 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:00.546340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03343c19-9cef-425e-bfe4-0a91b8a60166 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:00.546590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03343c19-9cef-425e-bfe4-0a91b8a60166 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:00.548199 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 123/237] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:30:00.553804 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69538b8-a784-45e6-afbb-2e0fae0e65e3 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:00.554086 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69538b8-a784-45e6-afbb-2e0fae0e65e3 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:00.554355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69538b8-a784-45e6-afbb-2e0fae0e65e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:00.577112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-a69538b8-a784-45e6-afbb-2e0fae0e65e3 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:00.578986 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a69538b8-a784-45e6-afbb-2e0fae0e65e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:00.678353 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 115/238] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:00.840162 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03343c19-9cef-425e-bfe4-0a91b8a60166 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:00.976859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03343c19-9cef-425e-bfe4-0a91b8a60166 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:00.992476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:01.023443 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44fb8f-0b0d-450a-b93a-4320d65aa5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:01.024156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44fb8f-0b0d-450a-b93a-4320d65aa5e5 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:01.024444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44fb8f-0b0d-450a-b93a-4320d65aa5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:01.024722 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44fb8f-0b0d-450a-b93a-4320d65aa5e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:01.025958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44fb8f-0b0d-450a-b93a-4320d65aa5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:01.027416 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44fb8f-0b0d-450a-b93a-4320d65aa5e5 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:01.030365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 124/239] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:01.035654 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69538b8-a784-45e6-afbb-2e0fae0e65e3 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:01.138888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:01.185436 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69538b8-a784-45e6-afbb-2e0fae0e65e3 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:01.201684 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44fb8f-0b0d-450a-b93a-4320d65aa5e5 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:01.255981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52dfbd-0100-4773-a321-4de0ea2790c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:01.256662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52dfbd-0100-4773-a321-4de0ea2790c4 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:01.256946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52dfbd-0100-4773-a321-4de0ea2790c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:01.257223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52dfbd-0100-4773-a321-4de0ea2790c4 None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:01.258096 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52dfbd-0100-4773-a321-4de0ea2790c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:01.259474 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52dfbd-0100-4773-a321-4de0ea2790c4 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:01.338050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44fb8f-0b0d-450a-b93a-4320d65aa5e5 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:01.349878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 116/240] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:30:01 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:30:01.398902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2fcf-deef-4193-895e-48b33780b835 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:01.398902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2fcf-deef-4193-895e-48b33780b835 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:01.398902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2fcf-deef-4193-895e-48b33780b835 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:01.398902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 117/241] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:01.404812 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ba76f-0f46-44ce-a418-7ebee1c7eb80 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:01.405173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ba76f-0f46-44ce-a418-7ebee1c7eb80 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:01.405453 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ba76f-0f46-44ce-a418-7ebee1c7eb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:01.409663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6a0dc-16ae-48be-b470-06b19e8a4e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:01.410624 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6a0dc-16ae-48be-b470-06b19e8a4e53 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:01.411116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6a0dc-16ae-48be-b470-06b19e8a4e53 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:01.411582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6a0dc-16ae-48be-b470-06b19e8a4e53 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:01.425812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6a0dc-16ae-48be-b470-06b19e8a4e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-46a6a0dc-16ae-48be-b470-06b19e8a4e53 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:01.431654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:01.432628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:01.433619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:01.433619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:01.433619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:01.433619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:01.433619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:01.433619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:01.433619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:01.433619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:01.433619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:01.433619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:01.433619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:30:01.433619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:01.437998 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 125/242] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:01.444143 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6a0dc-16ae-48be-b470-06b19e8a4e53 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:01.449257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-bf5ba76f-0f46-44ce-a418-7ebee1c7eb80 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:01.450486 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-bf5ba76f-0f46-44ce-a418-7ebee1c7eb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:01.526943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:01.613993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 118/243] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:30:01.615458 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad784f-f629-4118-9e7d-399ba3bf967a None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:01.615747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad784f-f629-4118-9e7d-399ba3bf967a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:01.616019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad784f-f629-4118-9e7d-399ba3bf967a None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:01.619445 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 119/244] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:01.625646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c205450-94e7-4835-acc2-ae67a4a608cb None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:01.625937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c205450-94e7-4835-acc2-ae67a4a608cb None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:01.626212 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c205450-94e7-4835-acc2-ae67a4a608cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:01.630492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6a0dc-16ae-48be-b470-06b19e8a4e53 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:01.651371 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-0c205450-94e7-4835-acc2-ae67a4a608cb None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:01.652551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0c205450-94e7-4835-acc2-ae67a4a608cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:01.675655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ad22b-1ac6-4d21-b1ee-b0d4f8b12b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:01.676978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad22b-1ac6-4d21-b1ee-b0d4f8b12b5b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:01.677487 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad22b-1ac6-4d21-b1ee-b0d4f8b12b5b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:01.678002 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad22b-1ac6-4d21-b1ee-b0d4f8b12b5b None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:01.678902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ad22b-1ac6-4d21-b1ee-b0d4f8b12b5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:01.679421 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ad22b-1ac6-4d21-b1ee-b0d4f8b12b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:01.681273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ad22b-1ac6-4d21-b1ee-b0d4f8b12b5b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:01.695418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 126/245] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:30:01.700929 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ad22b-1ac6-4d21-b1ee-b0d4f8b12b5b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:01.714596 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:01.745694 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 120/246] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:30:01.838510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ad22b-1ac6-4d21-b1ee-b0d4f8b12b5b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:01.840252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:01.878773 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88f56b-86ed-4bbe-8597-fdc5195aea3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:01.879467 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88f56b-86ed-4bbe-8597-fdc5195aea3c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:01.879748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88f56b-86ed-4bbe-8597-fdc5195aea3c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:01.880027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88f56b-86ed-4bbe-8597-fdc5195aea3c None admin] PATH_INFO: `/v3/users/c9ea3ddb0cd34d7a9a3fdece44ff947b` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:01.896051 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88f56b-86ed-4bbe-8597-fdc5195aea3c None admin] RBAC: Authorizing `identity:get_user(user_id=c9ea3ddb0cd34d7a9a3fdece44ff947b)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:01.897562 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88f56b-86ed-4bbe-8597-fdc5195aea3c None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:01.899433 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 127/247] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:30:01 2022] GET /identity/v3/users/c9ea3ddb0cd34d7a9a3fdece44ff947b => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:01.905098 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c205450-94e7-4835-acc2-ae67a4a608cb None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:01.912868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88f56b-86ed-4bbe-8597-fdc5195aea3c None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:02.054660 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88f56b-86ed-4bbe-8597-fdc5195aea3c None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:02.078457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c205450-94e7-4835-acc2-ae67a4a608cb None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:02.104021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32891d4d-27cb-42d4-a38e-2a703826fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:02.105049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32891d4d-27cb-42d4-a38e-2a703826fbf2 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:02.105530 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32891d4d-27cb-42d4-a38e-2a703826fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:02.106020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32891d4d-27cb-42d4-a38e-2a703826fbf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:02.129062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37eb5d-5077-426a-8a71-ffffa945016f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:02.130059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37eb5d-5077-426a-8a71-ffffa945016f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:02.130493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37eb5d-5077-426a-8a71-ffffa945016f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:02.130790 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37eb5d-5077-426a-8a71-ffffa945016f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:02.140922 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:02.143947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37eb5d-5077-426a-8a71-ffffa945016f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-ef37eb5d-5077-426a-8a71-ffffa945016f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:02.148965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:02.154124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:02.154947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:02.154947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:02.154947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:02.154947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:02.154947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:02.154947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:02.154947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:02.154947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:02.154947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:02.154947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:02.154947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:30:02.154947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:02.154947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 121/248] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:30:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:02.154947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37eb5d-5077-426a-8a71-ffffa945016f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:02.195238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32891d4d-27cb-42d4-a38e-2a703826fbf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:02.198013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32891d4d-27cb-42d4-a38e-2a703826fbf2 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:02.204013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:02.281510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37eb5d-5077-426a-8a71-ffffa945016f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:02.334094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86897c-9298-44cd-9c35-88a8035a87ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:02.335444 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86897c-9298-44cd-9c35-88a8035a87ca None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:02.336489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86897c-9298-44cd-9c35-88a8035a87ca None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:02.337007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86897c-9298-44cd-9c35-88a8035a87ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:02.348107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 128/249] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:02.350452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845651b7-8494-4a89-9885-3d80c79e5a69 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:02.350980 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845651b7-8494-4a89-9885-3d80c79e5a69 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:02.351553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845651b7-8494-4a89-9885-3d80c79e5a69 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:02.352733 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86897c-9298-44cd-9c35-88a8035a87ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:02.354224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 129/250] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:02.355602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845651b7-8494-4a89-9885-3d80c79e5a69 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-ab86897c-9298-44cd-9c35-88a8035a87ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:02.359575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:02.360533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:02.361358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:02.361358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:02.361358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:02.361358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:02.361358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:02.361358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:02.361358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:02.361358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:02.361358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:02.361358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:02.361358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:02.361358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:02.363827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 122/251] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:02.364974 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86897c-9298-44cd-9c35-88a8035a87ca None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:02.454620 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:02.498850 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86897c-9298-44cd-9c35-88a8035a87ca None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:02.513321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845651b7-8494-4a89-9885-3d80c79e5a69 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:02.537084 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:02.545763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfe431-0cc1-443f-a22e-954a9a10e6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:02.547076 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe431-0cc1-443f-a22e-954a9a10e6da None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:02.547587 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe431-0cc1-443f-a22e-954a9a10e6da None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:02.548039 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe431-0cc1-443f-a22e-954a9a10e6da None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:02.550601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfe431-0cc1-443f-a22e-954a9a10e6da None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:02.552845 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfe431-0cc1-443f-a22e-954a9a10e6da None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:02.556256 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 123/252] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:02 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:02.558061 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff559e4-2536-469c-a349-275b25ac313e None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:02.559002 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff559e4-2536-469c-a349-275b25ac313e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:02.559629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff559e4-2536-469c-a349-275b25ac313e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:02.564375 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a59d9-5d8e-4132-a3f1-615f3b22145b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:02.565083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a59d9-5d8e-4132-a3f1-615f3b22145b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:02.565469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a59d9-5d8e-4132-a3f1-615f3b22145b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:02.565820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a59d9-5d8e-4132-a3f1-615f3b22145b None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:02.566679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a59d9-5d8e-4132-a3f1-615f3b22145b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:02.567118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a59d9-5d8e-4132-a3f1-615f3b22145b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:02.569051 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a59d9-5d8e-4132-a3f1-615f3b22145b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:02.590053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 130/253] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:02.590681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-0ff559e4-2536-469c-a349-275b25ac313e None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:02.591220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a59d9-5d8e-4132-a3f1-615f3b22145b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:02.592484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0ff559e4-2536-469c-a349-275b25ac313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:02.696490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 124/254] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:02.697572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff559e4-2536-469c-a349-275b25ac313e None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:02.762055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a59d9-5d8e-4132-a3f1-615f3b22145b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:02.793865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:02.809301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d32f14-ce6e-4d5d-b0ae-1fdda68a0137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:02.810288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d32f14-ce6e-4d5d-b0ae-1fdda68a0137 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:02.810759 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d32f14-ce6e-4d5d-b0ae-1fdda68a0137 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:02.811239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d32f14-ce6e-4d5d-b0ae-1fdda68a0137 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:02.812900 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d32f14-ce6e-4d5d-b0ae-1fdda68a0137 None admin] RBAC: Adding query filter params (name=member) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:02.813393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d32f14-ce6e-4d5d-b0ae-1fdda68a0137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:02.814998 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d32f14-ce6e-4d5d-b0ae-1fdda68a0137 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:02.826088 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 131/255] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:02.827977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d32f14-ce6e-4d5d-b0ae-1fdda68a0137 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:02.933794 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:02.946271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff559e4-2536-469c-a349-275b25ac313e None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:02.951420 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d32f14-ce6e-4d5d-b0ae-1fdda68a0137 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:02.993896 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9862b-54f2-490d-8d1a-eca7fddfd923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:02.994850 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9862b-54f2-490d-8d1a-eca7fddfd923 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:02.995338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9862b-54f2-490d-8d1a-eca7fddfd923 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:02.995790 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9862b-54f2-490d-8d1a-eca7fddfd923 None admin] PATH_INFO: `/v3/users/06257f1f40ae40548e89659b8983e790` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:02.997206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9862b-54f2-490d-8d1a-eca7fddfd923 None admin] RBAC: Authorizing `identity:get_user(user_id=06257f1f40ae40548e89659b8983e790)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:02.998845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9862b-54f2-490d-8d1a-eca7fddfd923 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:03.000721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 132/256] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:30:02 2022] GET /identity/v3/users/06257f1f40ae40548e89659b8983e790 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:03.001707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9862b-54f2-490d-8d1a-eca7fddfd923 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:03.029522 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936d9fc-642a-41fe-95b9-1cc42b5c5df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:03.030068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936d9fc-642a-41fe-95b9-1cc42b5c5df7 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:03.030343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936d9fc-642a-41fe-95b9-1cc42b5c5df7 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:03.031147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936d9fc-642a-41fe-95b9-1cc42b5c5df7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:03.031908 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936d9fc-642a-41fe-95b9-1cc42b5c5df7 None admin] RBAC: Adding query filter params (role.id=c0d24825bab14907b75e4205bd286479, scope.project.id=95503c3913594436a874debf8bd8d080, user.id=c9ea3ddb0cd34d7a9a3fdece44ff947b) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:03.032344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936d9fc-642a-41fe-95b9-1cc42b5c5df7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:03.033717 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936d9fc-642a-41fe-95b9-1cc42b5c5df7 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:03.049110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 125/257] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:30:02 2022] GET /identity/v3/role_assignments?user.id=c9ea3ddb0cd34d7a9a3fdece44ff947b&scope.project.id=95503c3913594436a874debf8bd8d080&role.id=c0d24825bab14907b75e4205bd286479 => generated 259 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:03.050491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936d9fc-642a-41fe-95b9-1cc42b5c5df7 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:03.075148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:03.146363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9862b-54f2-490d-8d1a-eca7fddfd923 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:03.190697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934cbd5-19be-43d6-b109-d3a732362f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:03.191550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934cbd5-19be-43d6-b109-d3a732362f54 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:03.191978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934cbd5-19be-43d6-b109-d3a732362f54 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:03.192616 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934cbd5-19be-43d6-b109-d3a732362f54 None admin] PATH_INFO: `/v3/users/9577ac02df5e4f5299de79b49b9e7acb` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:03.194616 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934cbd5-19be-43d6-b109-d3a732362f54 None admin] RBAC: Authorizing `identity:get_user(user_id=9577ac02df5e4f5299de79b49b9e7acb)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:03.196294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934cbd5-19be-43d6-b109-d3a732362f54 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:03.198268 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 133/258] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:30:03 2022] GET /identity/v3/users/9577ac02df5e4f5299de79b49b9e7acb => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:03.199302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934cbd5-19be-43d6-b109-d3a732362f54 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:03.298321 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936d9fc-642a-41fe-95b9-1cc42b5c5df7 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:03.370183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f90e7f-bcca-4b9b-87d4-c60a265ac31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:03.370846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934cbd5-19be-43d6-b109-d3a732362f54 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:03.371186 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f90e7f-bcca-4b9b-87d4-c60a265ac31f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:03.371186 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f90e7f-bcca-4b9b-87d4-c60a265ac31f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:03.371431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f90e7f-bcca-4b9b-87d4-c60a265ac31f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:03.392487 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:03.412873 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b4de3-b776-4854-a5d9-2ef3c0ebb7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:03.413538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b4de3-b776-4854-a5d9-2ef3c0ebb7fa None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:03.413820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b4de3-b776-4854-a5d9-2ef3c0ebb7fa None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:03.414093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b4de3-b776-4854-a5d9-2ef3c0ebb7fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:03.431944 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b4de3-b776-4854-a5d9-2ef3c0ebb7fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-040b4de3-b776-4854-a5d9-2ef3c0ebb7fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:03.437057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:03.438023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:03.438825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:03.438825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:03.438825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:03.438825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:03.438825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:03.438825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:03.438825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:03.438825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:03.438825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:03.438825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:03.438825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:03.438825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:03.440899 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:03.443191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 134/259] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:30:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:03.449009 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b4de3-b776-4854-a5d9-2ef3c0ebb7fa None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:03.507199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f90e7f-bcca-4b9b-87d4-c60a265ac31f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:03.508924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f90e7f-bcca-4b9b-87d4-c60a265ac31f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:03.604282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b4de3-b776-4854-a5d9-2ef3c0ebb7fa None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:03.631437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 126/260] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:03.637038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f90e7f-bcca-4b9b-87d4-c60a265ac31f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:03.709978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:03.753426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a684d77-ff0b-4332-8038-cfb75c39724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:03.754083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a684d77-ff0b-4332-8038-cfb75c39724a None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:03.754362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a684d77-ff0b-4332-8038-cfb75c39724a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:03.754635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a684d77-ff0b-4332-8038-cfb75c39724a None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:03.755517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f90e7f-bcca-4b9b-87d4-c60a265ac31f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:03.760938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a684d77-ff0b-4332-8038-cfb75c39724a None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:03.762431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a684d77-ff0b-4332-8038-cfb75c39724a None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:03.764202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 135/261] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:03 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:03.765563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a684d77-ff0b-4332-8038-cfb75c39724a None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:03.798982 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52e1de-823a-4d91-b6f5-f93b3127a898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:03.799865 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52e1de-823a-4d91-b6f5-f93b3127a898 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:03.800243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52e1de-823a-4d91-b6f5-f93b3127a898 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:03.800522 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52e1de-823a-4d91-b6f5-f93b3127a898 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:03.801543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52e1de-823a-4d91-b6f5-f93b3127a898 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:03.801852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52e1de-823a-4d91-b6f5-f93b3127a898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:03.803471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52e1de-823a-4d91-b6f5-f93b3127a898 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:03.813605 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 127/262] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:03.818665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52e1de-823a-4d91-b6f5-f93b3127a898 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:03.928529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:03.937667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52e1de-823a-4d91-b6f5-f93b3127a898 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:03.966293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:03.978888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476134d-5820-4a1f-b0c5-9f0a3b5004d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:03.979673 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476134d-5820-4a1f-b0c5-9f0a3b5004d5 None admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:03.980117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476134d-5820-4a1f-b0c5-9f0a3b5004d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:03.980420 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476134d-5820-4a1f-b0c5-9f0a3b5004d5 None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080/users/9577ac02df5e4f5299de79b49b9e7acb/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:03.983214 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476134d-5820-4a1f-b0c5-9f0a3b5004d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=95503c3913594436a874debf8bd8d080, user_id=9577ac02df5e4f5299de79b49b9e7acb, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:03.985270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476134d-5820-4a1f-b0c5-9f0a3b5004d5 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:04.036905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a684d77-ff0b-4332-8038-cfb75c39724a None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:04.076438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b068f3-4f9b-4b2d-a13f-79c9da84bec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:04.077084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b068f3-4f9b-4b2d-a13f-79c9da84bec6 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:04.077392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b068f3-4f9b-4b2d-a13f-79c9da84bec6 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:04.077726 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b068f3-4f9b-4b2d-a13f-79c9da84bec6 None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:04.078940 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b068f3-4f9b-4b2d-a13f-79c9da84bec6 None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:04.080505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b068f3-4f9b-4b2d-a13f-79c9da84bec6 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:04.082629 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 136/263] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:03 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:04.083429 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b068f3-4f9b-4b2d-a13f-79c9da84bec6 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:04.096665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 128/264] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:30:03 2022] PUT /identity/v3/projects/95503c3913594436a874debf8bd8d080/users/9577ac02df5e4f5299de79b49b9e7acb/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:04.098663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476134d-5820-4a1f-b0c5-9f0a3b5004d5 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:04.215365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b068f3-4f9b-4b2d-a13f-79c9da84bec6 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:04.235658 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:04.258998 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372020a4-b7cb-4381-9a5f-9cfcc875002b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:04.259724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372020a4-b7cb-4381-9a5f-9cfcc875002b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:04.260186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372020a4-b7cb-4381-9a5f-9cfcc875002b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:04.260523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372020a4-b7cb-4381-9a5f-9cfcc875002b None admin] PATH_INFO: `/v3/users/06257f1f40ae40548e89659b8983e790` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:04.261954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372020a4-b7cb-4381-9a5f-9cfcc875002b None admin] RBAC: Authorizing `identity:get_user(user_id=06257f1f40ae40548e89659b8983e790)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:04.264736 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372020a4-b7cb-4381-9a5f-9cfcc875002b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:04.267651 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 137/265] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:30:04 2022] GET /identity/v3/users/06257f1f40ae40548e89659b8983e790 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:04.275560 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ee2fe-28bb-42b6-a866-92a2de37e50e None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:04.275844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ee2fe-28bb-42b6-a866-92a2de37e50e None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:04.276147 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ee2fe-28bb-42b6-a866-92a2de37e50e None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:04.277665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 138/266] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:04.281637 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc70a0-4d02-4153-8d8d-08701a2a45ce None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:04.281883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc70a0-4d02-4153-8d8d-08701a2a45ce None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:04.282173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc70a0-4d02-4153-8d8d-08701a2a45ce None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:04.283815 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 139/267] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:04.284744 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc70a0-4d02-4153-8d8d-08701a2a45ce None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:04.295841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476134d-5820-4a1f-b0c5-9f0a3b5004d5 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:04.354551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f0b82-ded4-48c2-977f-64293d3956b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:04.355431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f0b82-ded4-48c2-977f-64293d3956b4 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:04.355721 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f0b82-ded4-48c2-977f-64293d3956b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:04.356113 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f0b82-ded4-48c2-977f-64293d3956b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:04.357303 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f0b82-ded4-48c2-977f-64293d3956b4 None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=95503c3913594436a874debf8bd8d080, user.id=06257f1f40ae40548e89659b8983e790) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:04.357686 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f0b82-ded4-48c2-977f-64293d3956b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:04.360447 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f0b82-ded4-48c2-977f-64293d3956b4 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:04.368555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 129/268] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:30:04 2022] GET /identity/v3/role_assignments?user.id=06257f1f40ae40548e89659b8983e790&scope.project.id=95503c3913594436a874debf8bd8d080&role.id=a7d59d2982de4bfeb758dce70808029f => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:04.369855 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007e8eb-f2d2-43ed-9ad7-eaa8bfaaf69e None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:04.370142 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007e8eb-f2d2-43ed-9ad7-eaa8bfaaf69e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:04.370583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007e8eb-f2d2-43ed-9ad7-eaa8bfaaf69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:04.391777 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-5007e8eb-f2d2-43ed-9ad7-eaa8bfaaf69e None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:04.393211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-5007e8eb-f2d2-43ed-9ad7-eaa8bfaaf69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:04.408299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc70a0-4d02-4153-8d8d-08701a2a45ce None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:04.448231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:04.453113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e6929-7dc1-4869-9ce2-e5420a2357d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:04.453113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e6929-7dc1-4869-9ce2-e5420a2357d3 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:04.453113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e6929-7dc1-4869-9ce2-e5420a2357d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:04.453113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e6929-7dc1-4869-9ce2-e5420a2357d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:04.497748 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 130/269] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:04.500122 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeedb6-37a6-4a60-b854-1c87a58f59b3 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:04.500516 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeedb6-37a6-4a60-b854-1c87a58f59b3 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:04.500975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeedb6-37a6-4a60-b854-1c87a58f59b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:04.523047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:04.536378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-fcfeedb6-37a6-4a60-b854-1c87a58f59b3 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:04.537702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-fcfeedb6-37a6-4a60-b854-1c87a58f59b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:04.541158 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e6929-7dc1-4869-9ce2-e5420a2357d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:04.543782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e6929-7dc1-4869-9ce2-e5420a2357d3 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:04.673226 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 140/270] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:04.682076 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e6929-7dc1-4869-9ce2-e5420a2357d3 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:04.692067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 131/271] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:04.803081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:04.825426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e6929-7dc1-4869-9ce2-e5420a2357d3 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:04.868351 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63fcbe-54e8-4ac2-8574-3a68abd14e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:04.869006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63fcbe-54e8-4ac2-8574-3a68abd14e56 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:04.869283 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63fcbe-54e8-4ac2-8574-3a68abd14e56 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:04.869553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63fcbe-54e8-4ac2-8574-3a68abd14e56 None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:04.870679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63fcbe-54e8-4ac2-8574-3a68abd14e56 None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:04.872150 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63fcbe-54e8-4ac2-8574-3a68abd14e56 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:04.874109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 141/272] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:04 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:30:04.880607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeedb6-37a6-4a60-b854-1c87a58f59b3 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:04.988227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeedb6-37a6-4a60-b854-1c87a58f59b3 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:04.998480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:05.027376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2398ac9-12af-445b-a8f0-e84be2bffc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:05.028016 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2398ac9-12af-445b-a8f0-e84be2bffc9d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:05.028369 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2398ac9-12af-445b-a8f0-e84be2bffc9d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:05.029643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63fcbe-54e8-4ac2-8574-3a68abd14e56 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:05.043677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2398ac9-12af-445b-a8f0-e84be2bffc9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:05.044655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2398ac9-12af-445b-a8f0-e84be2bffc9d None admin] RBAC: Adding query filter params (role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1, scope.project.id=95503c3913594436a874debf8bd8d080, user.id=06257f1f40ae40548e89659b8983e790) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:05.045090 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2398ac9-12af-445b-a8f0-e84be2bffc9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:05.046498 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2398ac9-12af-445b-a8f0-e84be2bffc9d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:05.064695 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 132/273] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:30:04 2022] GET /identity/v3/role_assignments?user.id=06257f1f40ae40548e89659b8983e790&scope.project.id=95503c3913594436a874debf8bd8d080&role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:05.134702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2398ac9-12af-445b-a8f0-e84be2bffc9d None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:05.191014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63fcbe-54e8-4ac2-8574-3a68abd14e56 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:05.234726 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a6307-4443-453d-829c-68b21d91d6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:05.235438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a6307-4443-453d-829c-68b21d91d6c7 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:05.235718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a6307-4443-453d-829c-68b21d91d6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:05.235987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a6307-4443-453d-829c-68b21d91d6c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:05.237258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a6307-4443-453d-829c-68b21d91d6c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:05.238746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a6307-4443-453d-829c-68b21d91d6c7 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:05.240848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 142/274] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:30:05.247190 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a6307-4443-453d-829c-68b21d91d6c7 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:05.300465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:05.333678 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2398ac9-12af-445b-a8f0-e84be2bffc9d None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:05.392982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a6307-4443-453d-829c-68b21d91d6c7 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:05.415389 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306507d-1394-46d2-a7fe-0a90b8f93112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:05.417738 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306507d-1394-46d2-a7fe-0a90b8f93112 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:05.418232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306507d-1394-46d2-a7fe-0a90b8f93112 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:05.418724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306507d-1394-46d2-a7fe-0a90b8f93112 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:05.435120 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306507d-1394-46d2-a7fe-0a90b8f93112 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-c306507d-1394-46d2-a7fe-0a90b8f93112 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:05.441993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:05.442929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:05.443903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:05.443903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:05.443903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:05.443903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:05.443903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:05.443903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:05.443903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:05.443903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:05.443903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:05.443903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:05.443903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:05.443903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:05.445528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e3670-35fe-4f63-81cc-33d71d23edef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:05.446139 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e3670-35fe-4f63-81cc-33d71d23edef None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:05.446416 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e3670-35fe-4f63-81cc-33d71d23edef None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:05.446686 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e3670-35fe-4f63-81cc-33d71d23edef None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:05.447410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e3670-35fe-4f63-81cc-33d71d23edef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:05.447997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 133/275] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:30:05.448911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e3670-35fe-4f63-81cc-33d71d23edef None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:05.453715 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306507d-1394-46d2-a7fe-0a90b8f93112 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:05.492770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:05.569775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306507d-1394-46d2-a7fe-0a90b8f93112 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:05.576576 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 143/276] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:30:05 2022] POST /identity/v3/users => generated 293 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:30:05.584709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19707538-a493-4b41-a4eb-8abbccc3265d None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:05.585138 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19707538-a493-4b41-a4eb-8abbccc3265d None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:05.585550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19707538-a493-4b41-a4eb-8abbccc3265d None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:05.588317 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 144/277] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:05.599806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1249d22-efcb-41b4-9e1c-c83eb2506fc6 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:05.600690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1249d22-efcb-41b4-9e1c-c83eb2506fc6 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:05.601579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1249d22-efcb-41b4-9e1c-c83eb2506fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:05.620358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9de22c-9c9a-4f7c-b7a9-24e81484751b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:05.621099 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9de22c-9c9a-4f7c-b7a9-24e81484751b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:05.621379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9de22c-9c9a-4f7c-b7a9-24e81484751b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:05.621652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9de22c-9c9a-4f7c-b7a9-24e81484751b None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:05.622618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9de22c-9c9a-4f7c-b7a9-24e81484751b None admin] RBAC: Adding query filter params (name=member) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:05.622926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9de22c-9c9a-4f7c-b7a9-24e81484751b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:05.625210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9de22c-9c9a-4f7c-b7a9-24e81484751b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:05.637718 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 134/278] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:05.643428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-c1249d22-efcb-41b4-9e1c-c83eb2506fc6 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:05.643785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9de22c-9c9a-4f7c-b7a9-24e81484751b None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:05.646319 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-c1249d22-efcb-41b4-9e1c-c83eb2506fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:05.735586 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 145/279] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:30:05.766792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:05.777630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9de22c-9c9a-4f7c-b7a9-24e81484751b None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:05.821398 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f240b98-9ad3-4d3b-9ccd-e583c181c3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:05.822349 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f240b98-9ad3-4d3b-9ccd-e583c181c3a1 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:05.822628 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f240b98-9ad3-4d3b-9ccd-e583c181c3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:05.822895 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f240b98-9ad3-4d3b-9ccd-e583c181c3a1 None admin] PATH_INFO: `/v3/users/e74f276bcbfb4e60ad4ed089e6402646` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:05.838831 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f240b98-9ad3-4d3b-9ccd-e583c181c3a1 None admin] RBAC: Authorizing `identity:get_user(user_id=e74f276bcbfb4e60ad4ed089e6402646)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:05.840370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f240b98-9ad3-4d3b-9ccd-e583c181c3a1 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:05.842186 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 135/280] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:30:05 2022] GET /identity/v3/users/e74f276bcbfb4e60ad4ed089e6402646 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:30:05.848712 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1249d22-efcb-41b4-9e1c-c83eb2506fc6 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:05.859217 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:05.970272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1249d22-efcb-41b4-9e1c-c83eb2506fc6 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:06.010257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df9af5-8677-4afd-9dbb-bcf1aeaa71f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:06.011262 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df9af5-8677-4afd-9dbb-bcf1aeaa71f9 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:06.011742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df9af5-8677-4afd-9dbb-bcf1aeaa71f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:06.012255 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df9af5-8677-4afd-9dbb-bcf1aeaa71f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:06.013192 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df9af5-8677-4afd-9dbb-bcf1aeaa71f9 None admin] RBAC: Adding query filter params (role.id=7cca4e8860b3437e801ffbf8429da7dd, user.id=e74f276bcbfb4e60ad4ed089e6402646, scope.system=all) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:06.013706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df9af5-8677-4afd-9dbb-bcf1aeaa71f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:06.015890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df9af5-8677-4afd-9dbb-bcf1aeaa71f9 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:06.020417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f240b98-9ad3-4d3b-9ccd-e583c181c3a1 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:06.022275 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 146/281] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Aug 29 22:30:05 2022] GET /identity/v3/role_assignments?user.id=e74f276bcbfb4e60ad4ed089e6402646&scope.system=all&role.id=7cca4e8860b3437e801ffbf8429da7dd => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:30:06.164120 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f240b98-9ad3-4d3b-9ccd-e583c181c3a1 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:06.216819 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ec24f-7a1d-4cb7-80c4-4fd1caa04044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:06.217469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ec24f-7a1d-4cb7-80c4-4fd1caa04044 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:06.217751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ec24f-7a1d-4cb7-80c4-4fd1caa04044 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:06.218581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ec24f-7a1d-4cb7-80c4-4fd1caa04044 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:06.231850 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ec24f-7a1d-4cb7-80c4-4fd1caa04044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-b77ec24f-7a1d-4cb7-80c4-4fd1caa04044 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:06.237571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:06.238488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:06.239282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:06.239282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:06.239282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:06.239282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:06.239282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:06.239282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:06.239282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:06.239282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:06.239282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:06.239282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:06.239282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:30:06.239282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:06.243547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 136/282] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:30:06.246949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df9af5-8677-4afd-9dbb-bcf1aeaa71f9 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:06.321534 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:06.356044 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df9af5-8677-4afd-9dbb-bcf1aeaa71f9 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:06.393142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a620cd-b658-44e3-8ba2-b6434da13906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:06.393767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a620cd-b658-44e3-8ba2-b6434da13906 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:06.394111 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a620cd-b658-44e3-8ba2-b6434da13906 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:06.394331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a620cd-b658-44e3-8ba2-b6434da13906 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:06.395008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a620cd-b658-44e3-8ba2-b6434da13906 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:06.395313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a620cd-b658-44e3-8ba2-b6434da13906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:06.396723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a620cd-b658-44e3-8ba2-b6434da13906 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:06.410688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 147/283] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:06.412256 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ec24f-7a1d-4cb7-80c4-4fd1caa04044 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:06.435375 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:06.465705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f5481-691c-402d-b765-a416583f125e None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:06.466204 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f5481-691c-402d-b765-a416583f125e None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:06.466276 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f5481-691c-402d-b765-a416583f125e None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:06.470195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 148/284] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:30:06.478010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fadb4-d529-4d73-b04e-6a14b696d161 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:06.492609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fadb4-d529-4d73-b04e-6a14b696d161 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:06.492609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fadb4-d529-4d73-b04e-6a14b696d161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:06.500111 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-799fadb4-d529-4d73-b04e-6a14b696d161 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:06.501508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-799fadb4-d529-4d73-b04e-6a14b696d161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:06.576487 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 149/285] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:06.603489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ec24f-7a1d-4cb7-80c4-4fd1caa04044 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:06.653336 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a7462-0d87-408b-9890-b7a794a4603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:06.653989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a7462-0d87-408b-9890-b7a794a4603f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:06.654273 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a7462-0d87-408b-9890-b7a794a4603f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:06.654549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a7462-0d87-408b-9890-b7a794a4603f None admin] PATH_INFO: `/v3/users/c9ea3ddb0cd34d7a9a3fdece44ff947b` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:06.655726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a7462-0d87-408b-9890-b7a794a4603f None admin] RBAC: Authorizing `identity:get_user(user_id=c9ea3ddb0cd34d7a9a3fdece44ff947b)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:06.657232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a7462-0d87-408b-9890-b7a794a4603f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:06.661926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 137/286] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:30:06 2022] GET /identity/v3/users/c9ea3ddb0cd34d7a9a3fdece44ff947b => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:06.665126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fadb4-d529-4d73-b04e-6a14b696d161 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:06.744561 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:06.798431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fadb4-d529-4d73-b04e-6a14b696d161 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:06.835504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941a567-59c5-4edf-80d2-b43e10b9a73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:06.836174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941a567-59c5-4edf-80d2-b43e10b9a73d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:06.836457 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941a567-59c5-4edf-80d2-b43e10b9a73d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:06.836733 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941a567-59c5-4edf-80d2-b43e10b9a73d None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:06.837881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941a567-59c5-4edf-80d2-b43e10b9a73d None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:06.839402 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941a567-59c5-4edf-80d2-b43e10b9a73d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:06.846295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 150/287] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:06 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:06.849249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a7462-0d87-408b-9890-b7a794a4603f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:06.866880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941a567-59c5-4edf-80d2-b43e10b9a73d None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:06.989264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941a567-59c5-4edf-80d2-b43e10b9a73d None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:07.024590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:07.029002 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e013f3-6d17-44b2-9986-17b7b1b1e3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:07.029645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e013f3-6d17-44b2-9986-17b7b1b1e3b8 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:07.029928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e013f3-6d17-44b2-9986-17b7b1b1e3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:07.030206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e013f3-6d17-44b2-9986-17b7b1b1e3b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:07.045772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e013f3-6d17-44b2-9986-17b7b1b1e3b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-02e013f3-6d17-44b2-9986-17b7b1b1e3b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:07.053589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:07.054517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:07.055338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:07.055338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:07.055338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:07.055338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:07.055338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:07.055338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:07.055338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:07.055338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:07.055338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:07.055338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:07.055338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:07.055338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:07.055338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 151/288] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:07.062451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e013f3-6d17-44b2-9986-17b7b1b1e3b8 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:07.123921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:07.158674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a7462-0d87-408b-9890-b7a794a4603f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:07.211461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3497c2-aa9e-4eb8-886a-c078801c20ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:07.212430 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3497c2-aa9e-4eb8-886a-c078801c20ff None admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:07.212848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3497c2-aa9e-4eb8-886a-c078801c20ff None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:07.213258 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3497c2-aa9e-4eb8-886a-c078801c20ff None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080/users/c9ea3ddb0cd34d7a9a3fdece44ff947b/roles/c0d24825bab14907b75e4205bd286479` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:07.219476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3497c2-aa9e-4eb8-886a-c078801c20ff None admin] RBAC: Authorizing `identity:create_grant(project_id=95503c3913594436a874debf8bd8d080, user_id=c9ea3ddb0cd34d7a9a3fdece44ff947b, role_id=c0d24825bab14907b75e4205bd286479)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:07.222104 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3497c2-aa9e-4eb8-886a-c078801c20ff None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:07.237370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e013f3-6d17-44b2-9986-17b7b1b1e3b8 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:07.280856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 138/289] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:30:06 2022] PUT /identity/v3/projects/95503c3913594436a874debf8bd8d080/users/c9ea3ddb0cd34d7a9a3fdece44ff947b/roles/c0d24825bab14907b75e4205bd286479 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:07.282348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262dba5-038d-472f-b6b5-f51da4d0e2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:07.283190 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262dba5-038d-472f-b6b5-f51da4d0e2e9 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:07.283782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262dba5-038d-472f-b6b5-f51da4d0e2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:07.284243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262dba5-038d-472f-b6b5-f51da4d0e2e9 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:07.285172 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262dba5-038d-472f-b6b5-f51da4d0e2e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:07.285667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262dba5-038d-472f-b6b5-f51da4d0e2e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:07.287307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262dba5-038d-472f-b6b5-f51da4d0e2e9 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:07.298938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 152/290] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:07.305746 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3497c2-aa9e-4eb8-886a-c078801c20ff None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:07.442667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3497c2-aa9e-4eb8-886a-c078801c20ff None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:07.486656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e7810-78b5-414e-a9e8-8545b24161ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:07.488079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e7810-78b5-414e-a9e8-8545b24161ac None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:07.488752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e7810-78b5-414e-a9e8-8545b24161ac None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:07.489452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e7810-78b5-414e-a9e8-8545b24161ac None admin] PATH_INFO: `/v3/users/9577ac02df5e4f5299de79b49b9e7acb` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:07.491318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e7810-78b5-414e-a9e8-8545b24161ac None admin] RBAC: Authorizing `identity:get_user(user_id=9577ac02df5e4f5299de79b49b9e7acb)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:07.493193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e7810-78b5-414e-a9e8-8545b24161ac None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:07.495327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 139/291] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:30:07 2022] GET /identity/v3/users/9577ac02df5e4f5299de79b49b9e7acb => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:07.505169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262dba5-038d-472f-b6b5-f51da4d0e2e9 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:07.564765 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:07.624925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262dba5-038d-472f-b6b5-f51da4d0e2e9 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:07.676971 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5c7f0-0269-4120-9e9a-899d7c8db259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:07.677634 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5c7f0-0269-4120-9e9a-899d7c8db259 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:07.677919 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5c7f0-0269-4120-9e9a-899d7c8db259 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:07.678197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5c7f0-0269-4120-9e9a-899d7c8db259 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:07.784836 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5c7f0-0269-4120-9e9a-899d7c8db259 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:07.786531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5c7f0-0269-4120-9e9a-899d7c8db259 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:07.858388 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:07.928831 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 153/292] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:07.934249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e7810-78b5-414e-a9e8-8545b24161ac None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:07.956751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:08.101904 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e7810-78b5-414e-a9e8-8545b24161ac None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:08.154493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5642081-409b-461c-8b76-e0ee04224514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:08.155063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5642081-409b-461c-8b76-e0ee04224514 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:08.155395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5642081-409b-461c-8b76-e0ee04224514 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:08.156285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5642081-409b-461c-8b76-e0ee04224514 None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:08.157479 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5642081-409b-461c-8b76-e0ee04224514 None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:08.158956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5642081-409b-461c-8b76-e0ee04224514 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:08.160965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 140/293] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:07 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:08.166942 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5c7f0-0269-4120-9e9a-899d7c8db259 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:08.327823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0db3a-29ef-41d6-97ed-cb7daa1cd897 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:08.328133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0db3a-29ef-41d6-97ed-cb7daa1cd897 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:08.328419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0db3a-29ef-41d6-97ed-cb7daa1cd897 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:08.329930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 141/294] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:30:08.335328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780dee4-cf94-4222-a577-ca4cc6201e43 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:08.335631 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780dee4-cf94-4222-a577-ca4cc6201e43 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:08.335915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780dee4-cf94-4222-a577-ca4cc6201e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:08.337171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5c7f0-0269-4120-9e9a-899d7c8db259 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:08.368119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-0780dee4-cf94-4222-a577-ca4cc6201e43 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:08.368119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0780dee4-cf94-4222-a577-ca4cc6201e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:08.396224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae086b-c1af-4535-a23e-252c7003740d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:08.396849 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae086b-c1af-4535-a23e-252c7003740d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:08.397132 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae086b-c1af-4535-a23e-252c7003740d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:08.397409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae086b-c1af-4535-a23e-252c7003740d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:08.398148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae086b-c1af-4535-a23e-252c7003740d None admin] RBAC: Adding query filter params (role.id=7cca4e8860b3437e801ffbf8429da7dd, scope.project.id=95503c3913594436a874debf8bd8d080, user.id=9577ac02df5e4f5299de79b49b9e7acb) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:08.398462 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae086b-c1af-4535-a23e-252c7003740d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:08.399931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae086b-c1af-4535-a23e-252c7003740d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:08.414893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 154/295] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:30:08 2022] GET /identity/v3/role_assignments?user.id=9577ac02df5e4f5299de79b49b9e7acb&scope.project.id=95503c3913594436a874debf8bd8d080&role.id=7cca4e8860b3437e801ffbf8429da7dd => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:08.493935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 142/296] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:30:08.610083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75f357-13f9-4f73-940a-8beed620f360 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:08.611014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75f357-13f9-4f73-940a-8beed620f360 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:08.611483 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75f357-13f9-4f73-940a-8beed620f360 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:08.613541 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 155/297] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:08.619768 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd119b1e-d487-4d35-b5e9-eb392b197aa4 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:08.620078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd119b1e-d487-4d35-b5e9-eb392b197aa4 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:08.620368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd119b1e-d487-4d35-b5e9-eb392b197aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:08.638224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:08.646222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-dd119b1e-d487-4d35-b5e9-eb392b197aa4 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:08.647419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-dd119b1e-d487-4d35-b5e9-eb392b197aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:08.663377 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6721774-066c-4f3b-ab5c-bde576864b84 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:08.664188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6721774-066c-4f3b-ab5c-bde576864b84 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:08.664708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6721774-066c-4f3b-ab5c-bde576864b84 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:08.667420 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 156/298] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:08.673652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd979872-9a78-4f69-9155-ecf02ec9f49f None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:08.674083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd979872-9a78-4f69-9155-ecf02ec9f49f None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:08.674678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd979872-9a78-4f69-9155-ecf02ec9f49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:08.699052 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-bd979872-9a78-4f69-9155-ecf02ec9f49f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:08.700432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-bd979872-9a78-4f69-9155-ecf02ec9f49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:08.716137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:08.745880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 143/299] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:08.796705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 157/300] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:08.819146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd119b1e-d487-4d35-b5e9-eb392b197aa4 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:08.933003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd119b1e-d487-4d35-b5e9-eb392b197aa4 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:08.971832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7336a-4513-4f93-b89e-1b3b224ef540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:08.972512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7336a-4513-4f93-b89e-1b3b224ef540 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:08.972788 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7336a-4513-4f93-b89e-1b3b224ef540 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:08.973056 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7336a-4513-4f93-b89e-1b3b224ef540 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:08.976378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:08.988310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7336a-4513-4f93-b89e-1b3b224ef540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-f9c7336a-4513-4f93-b89e-1b3b224ef540 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:08.993146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:08.995952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:08.996798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:08.996798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:08.996798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:08.996798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:08.996798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:08.996798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:08.996798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:08.996798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:08.996798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:08.996798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:08.996798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:30:08.996798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:08.996798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 144/301] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:09.001065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd979872-9a78-4f69-9155-ecf02ec9f49f None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:09.065242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7336a-4513-4f93-b89e-1b3b224ef540 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:09.132646 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd979872-9a78-4f69-9155-ecf02ec9f49f None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:09.170515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6df80f-2bb2-48a9-9bcd-97290391d3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:09.171130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6df80f-2bb2-48a9-9bcd-97290391d3ac None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:09.171411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6df80f-2bb2-48a9-9bcd-97290391d3ac None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:09.171686 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6df80f-2bb2-48a9-9bcd-97290391d3ac None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:09.172401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6df80f-2bb2-48a9-9bcd-97290391d3ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:09.172706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6df80f-2bb2-48a9-9bcd-97290391d3ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:09.174074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6df80f-2bb2-48a9-9bcd-97290391d3ac None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:09.183305 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 158/302] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:30:09.184372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6df80f-2bb2-48a9-9bcd-97290391d3ac None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:09.197419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:09.213585 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7336a-4513-4f93-b89e-1b3b224ef540 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:09.257077 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184bdc0-320a-4d39-b579-44d70854bd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:09.257715 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184bdc0-320a-4d39-b579-44d70854bd64 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:09.258006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184bdc0-320a-4d39-b579-44d70854bd64 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:09.258279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184bdc0-320a-4d39-b579-44d70854bd64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:09.259603 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184bdc0-320a-4d39-b579-44d70854bd64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:09.261187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184bdc0-320a-4d39-b579-44d70854bd64 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:09.264141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 145/303] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:30:09.264270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184bdc0-320a-4d39-b579-44d70854bd64 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:09.319693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6df80f-2bb2-48a9-9bcd-97290391d3ac None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:09.341682 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:09.358436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b0ff3-18d3-4e86-b67d-fd8946e3748e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:09.358865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b0ff3-18d3-4e86-b67d-fd8946e3748e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:09.359140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b0ff3-18d3-4e86-b67d-fd8946e3748e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:09.359590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b0ff3-18d3-4e86-b67d-fd8946e3748e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:09.372379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b0ff3-18d3-4e86-b67d-fd8946e3748e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-952b0ff3-18d3-4e86-b67d-fd8946e3748e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:09.378207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:09.379119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:09.379914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:09.379914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:09.379914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:09.379914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:09.379914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:09.379914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:09.379914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:09.379914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:09.379914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:09.379914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:09.379914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:09.379914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:09.379914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 159/304] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:09.380614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b0ff3-18d3-4e86-b67d-fd8946e3748e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:09.393789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184bdc0-320a-4d39-b579-44d70854bd64 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:09.432640 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e8321-6765-4d3a-b7fc-08e285d9ce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:09.433641 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e8321-6765-4d3a-b7fc-08e285d9ce46 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:09.434083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e8321-6765-4d3a-b7fc-08e285d9ce46 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:09.434578 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e8321-6765-4d3a-b7fc-08e285d9ce46 None admin] PATH_INFO: `/v3/users/c422b18a2cff42bea2c7d6fd9c791acf` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:09.455171 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e8321-6765-4d3a-b7fc-08e285d9ce46 None admin] RBAC: Authorizing `identity:get_user(user_id=c422b18a2cff42bea2c7d6fd9c791acf)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:09.456916 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e8321-6765-4d3a-b7fc-08e285d9ce46 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:09.458803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 146/305] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:30:09 2022] GET /identity/v3/users/c422b18a2cff42bea2c7d6fd9c791acf => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:09.458933 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:09.460418 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e8321-6765-4d3a-b7fc-08e285d9ce46 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:09.502290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b0ff3-18d3-4e86-b67d-fd8946e3748e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:09.538829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16682bb-17b9-4626-bc39-41c1d5bc1713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:09.539588 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16682bb-17b9-4626-bc39-41c1d5bc1713 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:09.539874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16682bb-17b9-4626-bc39-41c1d5bc1713 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:09.540184 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16682bb-17b9-4626-bc39-41c1d5bc1713 None admin] PATH_INFO: `/v3/groups` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:09.540868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16682bb-17b9-4626-bc39-41c1d5bc1713 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:09.542295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16682bb-17b9-4626-bc39-41c1d5bc1713 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:09.590741 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e8321-6765-4d3a-b7fc-08e285d9ce46 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:09.597557 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 160/306] 10.222.0.62 () {60 vars in 1134 bytes} [Mon Aug 29 22:30:09 2022] POST /identity/v3/groups => generated 229 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:30:09.598403 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16682bb-17b9-4626-bc39-41c1d5bc1713 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:09.622406 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:09.638370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8c69c-3058-4982-9152-56548363f639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:09.639088 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8c69c-3058-4982-9152-56548363f639 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:09.639369 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8c69c-3058-4982-9152-56548363f639 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:09.639673 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8c69c-3058-4982-9152-56548363f639 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:09.640393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8c69c-3058-4982-9152-56548363f639 None admin] RBAC: Adding query filter params (name=member) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:09.640700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8c69c-3058-4982-9152-56548363f639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:09.642251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8c69c-3058-4982-9152-56548363f639 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:09.652674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 147/307] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:09.661460 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8c69c-3058-4982-9152-56548363f639 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:09.779046 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16682bb-17b9-4626-bc39-41c1d5bc1713 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:09.805571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8c69c-3058-4982-9152-56548363f639 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:09.815930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:09.826974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9d374-760d-49ee-ae9f-ee311249893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:09.827636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9d374-760d-49ee-ae9f-ee311249893f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:09.827916 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9d374-760d-49ee-ae9f-ee311249893f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:09.833469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9d374-760d-49ee-ae9f-ee311249893f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:09.833469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9d374-760d-49ee-ae9f-ee311249893f None admin] RBAC: Adding query filter params (role.id=c0d24825bab14907b75e4205bd286479, user.id=c422b18a2cff42bea2c7d6fd9c791acf, scope.system=all) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:09.833469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9d374-760d-49ee-ae9f-ee311249893f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:09.833469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9d374-760d-49ee-ae9f-ee311249893f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:09.836503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 161/308] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Aug 29 22:30:09 2022] GET /identity/v3/role_assignments?user.id=c422b18a2cff42bea2c7d6fd9c791acf&scope.system=all&role.id=c0d24825bab14907b75e4205bd286479 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:09.837474 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2548ce-8aa5-402f-a3b2-c6ffe5af88e5 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:09.837756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2548ce-8aa5-402f-a3b2-c6ffe5af88e5 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:09.838045 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2548ce-8aa5-402f-a3b2-c6ffe5af88e5 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:09.844297 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 162/309] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:09.852804 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a8506-5cf4-43a9-954c-edcc03deb070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:09.853833 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a8506-5cf4-43a9-954c-edcc03deb070 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:09.854285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a8506-5cf4-43a9-954c-edcc03deb070 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:09.855143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a8506-5cf4-43a9-954c-edcc03deb070 None admin] PATH_INFO: `/v3/users/e74f276bcbfb4e60ad4ed089e6402646` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:09.856896 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a8506-5cf4-43a9-954c-edcc03deb070 None admin] RBAC: Authorizing `identity:get_user(user_id=e74f276bcbfb4e60ad4ed089e6402646)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:09.857377 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5517642-6674-40aa-aaa1-f1e5deb23887 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:09.857889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5517642-6674-40aa-aaa1-f1e5deb23887 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:09.858955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5517642-6674-40aa-aaa1-f1e5deb23887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:09.860005 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a8506-5cf4-43a9-954c-edcc03deb070 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:09.867095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 148/310] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:30:09 2022] GET /identity/v3/users/e74f276bcbfb4e60ad4ed089e6402646 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:30:09.877748 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a8506-5cf4-43a9-954c-edcc03deb070 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:09.898525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-e5517642-6674-40aa-aaa1-f1e5deb23887 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:09.901068 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e5517642-6674-40aa-aaa1-f1e5deb23887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:09.962369 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:10.001485 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 163/311] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:30:10.053354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a8506-5cf4-43a9-954c-edcc03deb070 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:10.119966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1bc22-6a61-40a5-bf5f-522814b9b5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:10.121028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1bc22-6a61-40a5-bf5f-522814b9b5f5 None admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:10.121585 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1bc22-6a61-40a5-bf5f-522814b9b5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:10.122062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1bc22-6a61-40a5-bf5f-522814b9b5f5 None admin] PATH_INFO: `/v3/system/users/e74f276bcbfb4e60ad4ed089e6402646/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:10.123883 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1bc22-6a61-40a5-bf5f-522814b9b5f5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e74f276bcbfb4e60ad4ed089e6402646, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:10.125607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1bc22-6a61-40a5-bf5f-522814b9b5f5 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:10.218400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 149/312] 10.222.0.62 () {58 vars in 1334 bytes} [Mon Aug 29 22:30:09 2022] PUT /identity/v3/system/users/e74f276bcbfb4e60ad4ed089e6402646/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:10.357450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5517642-6674-40aa-aaa1-f1e5deb23887 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:10.668849 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5517642-6674-40aa-aaa1-f1e5deb23887 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:10.715405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:10.720215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a933b-ea9e-4d43-b09c-4299bb5d4a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:10.720911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a933b-ea9e-4d43-b09c-4299bb5d4a3d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:10.721196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a933b-ea9e-4d43-b09c-4299bb5d4a3d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:10.721469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a933b-ea9e-4d43-b09c-4299bb5d4a3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:10.732961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a933b-ea9e-4d43-b09c-4299bb5d4a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-9a1a933b-ea9e-4d43-b09c-4299bb5d4a3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:10.737912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:10.742671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:10.743480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:10.743480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:10.743480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:10.743480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:10.743480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:10.743480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:10.743480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:10.743480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:10.743480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:10.743480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:10.743480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:30:10.743480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:10.743480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 164/313] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:10.746142 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1bc22-6a61-40a5-bf5f-522814b9b5f5 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:10.874183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1bc22-6a61-40a5-bf5f-522814b9b5f5 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:10.893036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:10.915026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c414fd1-1d61-4c6f-b113-8691a09cf8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:10.915895 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c414fd1-1d61-4c6f-b113-8691a09cf8c0 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:10.916346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c414fd1-1d61-4c6f-b113-8691a09cf8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:10.916762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c414fd1-1d61-4c6f-b113-8691a09cf8c0 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:10.917619 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c414fd1-1d61-4c6f-b113-8691a09cf8c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:10.918070 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c414fd1-1d61-4c6f-b113-8691a09cf8c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:10.919737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c414fd1-1d61-4c6f-b113-8691a09cf8c0 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:10.931118 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 150/314] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:10.937636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a933b-ea9e-4d43-b09c-4299bb5d4a3d None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:11.049776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a933b-ea9e-4d43-b09c-4299bb5d4a3d None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:11.086446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e568be-4899-4b3c-8ed6-4a6fc9d1da16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:11.087085 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e568be-4899-4b3c-8ed6-4a6fc9d1da16 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:11.087364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e568be-4899-4b3c-8ed6-4a6fc9d1da16 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:11.087633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e568be-4899-4b3c-8ed6-4a6fc9d1da16 None admin] PATH_INFO: `/v3/users/c9ea3ddb0cd34d7a9a3fdece44ff947b` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:11.088814 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e568be-4899-4b3c-8ed6-4a6fc9d1da16 None admin] RBAC: Authorizing `identity:get_user(user_id=c9ea3ddb0cd34d7a9a3fdece44ff947b)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:11.090298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e568be-4899-4b3c-8ed6-4a6fc9d1da16 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:11.092301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 165/315] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:30:10 2022] GET /identity/v3/users/c9ea3ddb0cd34d7a9a3fdece44ff947b => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:11.098707 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c414fd1-1d61-4c6f-b113-8691a09cf8c0 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:11.239623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c414fd1-1d61-4c6f-b113-8691a09cf8c0 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:11.279029 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260af470-f9a7-4f55-8e65-b3cf156764db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:11.279662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260af470-f9a7-4f55-8e65-b3cf156764db None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:11.279946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260af470-f9a7-4f55-8e65-b3cf156764db None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:11.280844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260af470-f9a7-4f55-8e65-b3cf156764db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:11.335381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:11.356560 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260af470-f9a7-4f55-8e65-b3cf156764db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:11.358066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260af470-f9a7-4f55-8e65-b3cf156764db None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:11.466966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 151/316] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:11.473561 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e568be-4899-4b3c-8ed6-4a6fc9d1da16 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:11.552556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:11.606258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e568be-4899-4b3c-8ed6-4a6fc9d1da16 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:11.649407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e4eaf-f467-4708-bc13-041f41977b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:11.649614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e4eaf-f467-4708-bc13-041f41977b56 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:11.650104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e4eaf-f467-4708-bc13-041f41977b56 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:11.650589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e4eaf-f467-4708-bc13-041f41977b56 None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:11.652169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e4eaf-f467-4708-bc13-041f41977b56 None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:11.653949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e4eaf-f467-4708-bc13-041f41977b56 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:11.657280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 166/317] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:11 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:11.664043 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260af470-f9a7-4f55-8e65-b3cf156764db None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:11.758790 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:11.783818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260af470-f9a7-4f55-8e65-b3cf156764db None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:11.826693 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b0bf3-507c-4f94-a503-72395b51934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:11.827927 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0bf3-507c-4f94-a503-72395b51934c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:11.828284 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0bf3-507c-4f94-a503-72395b51934c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:11.828554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0bf3-507c-4f94-a503-72395b51934c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:11.829480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b0bf3-507c-4f94-a503-72395b51934c None admin] RBAC: Adding query filter params (role.id=c0d24825bab14907b75e4205bd286479, scope.project.id=95503c3913594436a874debf8bd8d080, user.id=c9ea3ddb0cd34d7a9a3fdece44ff947b) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:11.829794 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b0bf3-507c-4f94-a503-72395b51934c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:11.831713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b0bf3-507c-4f94-a503-72395b51934c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:11.838970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 152/318] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:30:11 2022] GET /identity/v3/role_assignments?user.id=c9ea3ddb0cd34d7a9a3fdece44ff947b&scope.project.id=95503c3913594436a874debf8bd8d080&role.id=c0d24825bab14907b75e4205bd286479 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:11.876757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccadcdf-b52b-46e8-84a7-12a2486a0be2 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:11.877400 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccadcdf-b52b-46e8-84a7-12a2486a0be2 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:11.877880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccadcdf-b52b-46e8-84a7-12a2486a0be2 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:11.879818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 167/319] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:11.885906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b1f08-f48e-42f1-bccd-3700dc2d22b9 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:11.886260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b1f08-f48e-42f1-bccd-3700dc2d22b9 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:11.886534 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b1f08-f48e-42f1-bccd-3700dc2d22b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:11.909425 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-3d7b1f08-f48e-42f1-bccd-3700dc2d22b9 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:11.910803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3d7b1f08-f48e-42f1-bccd-3700dc2d22b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:12.000667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 153/320] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:12.202433 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084954c-a7d7-41f6-b7b7-e2b1f5529560 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:12.202990 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084954c-a7d7-41f6-b7b7-e2b1f5529560 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:12.202990 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084954c-a7d7-41f6-b7b7-e2b1f5529560 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:12.204486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 168/321] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:12.209756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25946a-30c5-4a03-b398-6801c0021636 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:12.210073 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25946a-30c5-4a03-b398-6801c0021636 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:12.210340 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25946a-30c5-4a03-b398-6801c0021636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:12.229588 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-5b25946a-30c5-4a03-b398-6801c0021636 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:12.230780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-5b25946a-30c5-4a03-b398-6801c0021636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:12.271329 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084954c-a7d7-41f6-b7b7-e2b1f5529560 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:12.320651 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 154/322] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:30:12.395558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084954c-a7d7-41f6-b7b7-e2b1f5529560 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:12.415820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:12.433921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80769f8b-e247-4278-a894-688557434208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:12.434563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80769f8b-e247-4278-a894-688557434208 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:12.434840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80769f8b-e247-4278-a894-688557434208 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:12.435429 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80769f8b-e247-4278-a894-688557434208 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:12.436475 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80769f8b-e247-4278-a894-688557434208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:12.437925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80769f8b-e247-4278-a894-688557434208 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:12.439746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 169/323] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:30:12.445643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25946a-30c5-4a03-b398-6801c0021636 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:12.448397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:12.515842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7733b7-da1d-4db7-ad0d-75d3355eab66 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:12.516026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7733b7-da1d-4db7-ad0d-75d3355eab66 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:12.516339 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7733b7-da1d-4db7-ad0d-75d3355eab66 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:12.517691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 170/324] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:30:12.522900 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed518846-0bbf-48a0-b166-1889f09bcff9 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:12.523195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed518846-0bbf-48a0-b166-1889f09bcff9 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:12.523468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed518846-0bbf-48a0-b166-1889f09bcff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:12.543511 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-ed518846-0bbf-48a0-b166-1889f09bcff9 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:12.545234 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ed518846-0bbf-48a0-b166-1889f09bcff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:12.560603 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25946a-30c5-4a03-b398-6801c0021636 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:12.602633 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bbdce-d361-40cf-9761-9e35526073c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:12.603255 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bbdce-d361-40cf-9761-9e35526073c9 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:12.603538 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bbdce-d361-40cf-9761-9e35526073c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:12.603788 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bbdce-d361-40cf-9761-9e35526073c9 None admin] PATH_INFO: `/v3/groups` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:12.604607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bbdce-d361-40cf-9761-9e35526073c9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:12.607801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bbdce-d361-40cf-9761-9e35526073c9 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:12.627699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 171/325] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:12.628675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed518846-0bbf-48a0-b166-1889f09bcff9 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:12.704427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 155/326] 10.222.0.62 () {60 vars in 1134 bytes} [Mon Aug 29 22:30:12 2022] POST /identity/v3/groups => generated 226 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:30:12.749062 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed518846-0bbf-48a0-b166-1889f09bcff9 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:12.776396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:12.802311 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69650-2a3d-487b-a56c-28a8d1678154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:12.803096 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69650-2a3d-487b-a56c-28a8d1678154 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:12.803414 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69650-2a3d-487b-a56c-28a8d1678154 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:12.803739 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69650-2a3d-487b-a56c-28a8d1678154 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:12.818743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe69650-2a3d-487b-a56c-28a8d1678154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-bbe69650-2a3d-487b-a56c-28a8d1678154 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:12.823506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:12.824766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:12.825556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:12.825556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:12.825556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:12.825556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:12.825556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:12.825556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:12.825556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:12.825556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:12.825556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:12.825556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:12.825556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:30:12.825556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:12.825556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 172/327] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:12.831848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bbdce-d361-40cf-9761-9e35526073c9 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:12.904502 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:12.915151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69650-2a3d-487b-a56c-28a8d1678154 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:12.956678 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bbdce-d361-40cf-9761-9e35526073c9 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:13.010497 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1e363-8f71-4f69-8e23-8618b4fff403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:13.013304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1e363-8f71-4f69-8e23-8618b4fff403 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:13.013304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1e363-8f71-4f69-8e23-8618b4fff403 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:13.013304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1e363-8f71-4f69-8e23-8618b4fff403 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:13.013304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1e363-8f71-4f69-8e23-8618b4fff403 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:13.013589 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1e363-8f71-4f69-8e23-8618b4fff403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:13.015538 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1e363-8f71-4f69-8e23-8618b4fff403 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:13.028701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 156/328] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:13.035075 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1e363-8f71-4f69-8e23-8618b4fff403 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:13.048234 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69650-2a3d-487b-a56c-28a8d1678154 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:13.097823 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2006748-45ee-4e57-b9a7-d7aacb760d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:13.098809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2006748-45ee-4e57-b9a7-d7aacb760d29 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:13.099293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2006748-45ee-4e57-b9a7-d7aacb760d29 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:13.099597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2006748-45ee-4e57-b9a7-d7aacb760d29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:13.119090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2006748-45ee-4e57-b9a7-d7aacb760d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-f2006748-45ee-4e57-b9a7-d7aacb760d29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:13.127233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:13.129008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:13.130570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:13.130570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:13.130570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:13.130570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:13.130570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:13.130570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:13.130570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:13.130570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:13.130570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:13.130570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:13.130570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:13.130570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:13.130570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 173/329] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:30:13.141817 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2006748-45ee-4e57-b9a7-d7aacb760d29 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:13.189069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1e363-8f71-4f69-8e23-8618b4fff403 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:13.210277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:13.218918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:13.240022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb530d-805a-4fb3-be5f-1348c87610df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:13.241012 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb530d-805a-4fb3-be5f-1348c87610df None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:13.241794 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb530d-805a-4fb3-be5f-1348c87610df None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:13.242222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb530d-805a-4fb3-be5f-1348c87610df None admin] PATH_INFO: `/v3/users/c422b18a2cff42bea2c7d6fd9c791acf` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:13.244894 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb530d-805a-4fb3-be5f-1348c87610df None admin] RBAC: Authorizing `identity:get_user(user_id=c422b18a2cff42bea2c7d6fd9c791acf)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:13.247154 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb530d-805a-4fb3-be5f-1348c87610df None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:13.248595 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 157/330] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:30:13 2022] GET /identity/v3/users/c422b18a2cff42bea2c7d6fd9c791acf => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:30:13.254742 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb530d-805a-4fb3-be5f-1348c87610df None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:13.309857 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2006748-45ee-4e57-b9a7-d7aacb760d29 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:13.355193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2ce11-981e-4472-83ad-2a1f04b8bc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:13.356161 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2ce11-981e-4472-83ad-2a1f04b8bc22 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:13.356649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2ce11-981e-4472-83ad-2a1f04b8bc22 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:13.357121 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2ce11-981e-4472-83ad-2a1f04b8bc22 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:13.358013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2ce11-981e-4472-83ad-2a1f04b8bc22 None admin] RBAC: Adding query filter params (name=member) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:13.358570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2ce11-981e-4472-83ad-2a1f04b8bc22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:13.360207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2ce11-981e-4472-83ad-2a1f04b8bc22 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:13.373778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 174/331] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:13.382438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2ce11-981e-4472-83ad-2a1f04b8bc22 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:13.416071 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb530d-805a-4fb3-be5f-1348c87610df None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:13.460282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e81e1-192d-4ffd-9204-b8d7f8ff0d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:13.461247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e81e1-192d-4ffd-9204-b8d7f8ff0d3d None admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:13.461247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e81e1-192d-4ffd-9204-b8d7f8ff0d3d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:13.461247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e81e1-192d-4ffd-9204-b8d7f8ff0d3d None admin] PATH_INFO: `/v3/system/users/c422b18a2cff42bea2c7d6fd9c791acf/roles/c0d24825bab14907b75e4205bd286479` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:13.464687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e81e1-192d-4ffd-9204-b8d7f8ff0d3d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c422b18a2cff42bea2c7d6fd9c791acf, role_id=c0d24825bab14907b75e4205bd286479)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:13.466110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e81e1-192d-4ffd-9204-b8d7f8ff0d3d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:13.543932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 158/332] 10.222.0.62 () {58 vars in 1334 bytes} [Mon Aug 29 22:30:13 2022] PUT /identity/v3/system/users/c422b18a2cff42bea2c7d6fd9c791acf/roles/c0d24825bab14907b75e4205bd286479 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:30:13.582717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:13.591088 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2ce11-981e-4472-83ad-2a1f04b8bc22 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:13.638820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c99f8-2918-45fb-8a54-74deed8628e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:13.639593 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c99f8-2918-45fb-8a54-74deed8628e6 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:13.639882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c99f8-2918-45fb-8a54-74deed8628e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:13.640186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c99f8-2918-45fb-8a54-74deed8628e6 None admin] PATH_INFO: `/v3/users/e74f276bcbfb4e60ad4ed089e6402646` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:13.641661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c99f8-2918-45fb-8a54-74deed8628e6 None admin] RBAC: Authorizing `identity:get_user(user_id=e74f276bcbfb4e60ad4ed089e6402646)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:13.643354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c99f8-2918-45fb-8a54-74deed8628e6 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:13.645352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 175/333] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:30:13 2022] GET /identity/v3/users/e74f276bcbfb4e60ad4ed089e6402646 => generated 293 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:30:13.651691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e81e1-192d-4ffd-9204-b8d7f8ff0d3d None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:13.748334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:13.812334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e81e1-192d-4ffd-9204-b8d7f8ff0d3d None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:13.852516 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76395a10-1620-4961-9313-7d1bbfbdb45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:13.853956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76395a10-1620-4961-9313-7d1bbfbdb45d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:13.854451 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76395a10-1620-4961-9313-7d1bbfbdb45d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:13.854918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76395a10-1620-4961-9313-7d1bbfbdb45d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:13.855851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76395a10-1620-4961-9313-7d1bbfbdb45d None admin] RBAC: Adding query filter params (role.id=7cca4e8860b3437e801ffbf8429da7dd, user.id=e74f276bcbfb4e60ad4ed089e6402646, scope.system=all) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:13.856389 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76395a10-1620-4961-9313-7d1bbfbdb45d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:13.858034 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76395a10-1620-4961-9313-7d1bbfbdb45d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:13.876012 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 159/334] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Aug 29 22:30:13 2022] GET /identity/v3/role_assignments?user.id=e74f276bcbfb4e60ad4ed089e6402646&scope.system=all&role.id=7cca4e8860b3437e801ffbf8429da7dd => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:15.144363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e3e28-3d53-405c-bcea-8993b0a5718f None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:15.144879 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e3e28-3d53-405c-bcea-8993b0a5718f None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:15.144963 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e3e28-3d53-405c-bcea-8993b0a5718f None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:15.146418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 176/335] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:15.152590 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7eddcf-2190-47a1-95df-7ced9d1d3c28 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:15.153464 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7eddcf-2190-47a1-95df-7ced9d1d3c28 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:15.155946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7eddcf-2190-47a1-95df-7ced9d1d3c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:15.180586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-eb7eddcf-2190-47a1-95df-7ced9d1d3c28 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:15.182191 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-eb7eddcf-2190-47a1-95df-7ced9d1d3c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:15.295568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 160/336] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:15.917896 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e3e28-3d53-405c-bcea-8993b0a5718f None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:16.055372 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c634c9-3de5-4f7a-85f9-a559e0700473 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:16.055372 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c634c9-3de5-4f7a-85f9-a559e0700473 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:16.055372 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c634c9-3de5-4f7a-85f9-a559e0700473 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:16.057312 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 161/337] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:16.072014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce809fe3-6c2d-43c3-85dc-f6ddcb82c23e None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:16.072014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce809fe3-6c2d-43c3-85dc-f6ddcb82c23e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:16.072014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce809fe3-6c2d-43c3-85dc-f6ddcb82c23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:16.151935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e3e28-3d53-405c-bcea-8993b0a5718f None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:16.158868 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ce809fe3-6c2d-43c3-85dc-f6ddcb82c23e None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:16.160068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ce809fe3-6c2d-43c3-85dc-f6ddcb82c23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:16.286114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee84198-e7a9-4979-ae0e-53c4bf67c962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:16.287164 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee84198-e7a9-4979-ae0e-53c4bf67c962 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:16.288945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee84198-e7a9-4979-ae0e-53c4bf67c962 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:16.289472 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee84198-e7a9-4979-ae0e-53c4bf67c962 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:16.296575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:16.325504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee84198-e7a9-4979-ae0e-53c4bf67c962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-3ee84198-e7a9-4979-ae0e-53c4bf67c962 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:16.337117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:16.338072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:16.338877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:16.338877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:16.338877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:16.338877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:16.338877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:16.338877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:16.338877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:16.338877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:16.338877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:16.338877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:16.338877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:16.338877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:16.341652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 177/338] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:16.349569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee84198-e7a9-4979-ae0e-53c4bf67c962 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:16.403938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 162/339] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:16.425856 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:16.588591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee84198-e7a9-4979-ae0e-53c4bf67c962 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:16.645441 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d361f37-549b-4ea0-9e0f-01100ac60069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:16.646081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d361f37-549b-4ea0-9e0f-01100ac60069 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:16.646368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d361f37-549b-4ea0-9e0f-01100ac60069 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:16.646646 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d361f37-549b-4ea0-9e0f-01100ac60069 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:16.647349 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d361f37-549b-4ea0-9e0f-01100ac60069 None admin] RBAC: Adding query filter params (name=member) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:16.647658 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d361f37-549b-4ea0-9e0f-01100ac60069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:16.649070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d361f37-549b-4ea0-9e0f-01100ac60069 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:16.664170 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 178/340] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:16.670489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce809fe3-6c2d-43c3-85dc-f6ddcb82c23e None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:16.849198 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce809fe3-6c2d-43c3-85dc-f6ddcb82c23e None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:16.850864 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d361f37-549b-4ea0-9e0f-01100ac60069 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:16.955457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464b4a0-7d83-4c77-98b5-afe3659d2a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:16.956494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464b4a0-7d83-4c77-98b5-afe3659d2a35 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:16.956985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464b4a0-7d83-4c77-98b5-afe3659d2a35 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:16.957495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464b4a0-7d83-4c77-98b5-afe3659d2a35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:17.026597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:17.040835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:17.042684 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d361f37-549b-4ea0-9e0f-01100ac60069 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:17.091985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464b4a0-7d83-4c77-98b5-afe3659d2a35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:17.096334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464b4a0-7d83-4c77-98b5-afe3659d2a35 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:17.100493 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d13df-50b5-4ed0-a528-5fbe0e8eee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:17.101065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d13df-50b5-4ed0-a528-5fbe0e8eee35 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:17.101350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d13df-50b5-4ed0-a528-5fbe0e8eee35 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:17.101624 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d13df-50b5-4ed0-a528-5fbe0e8eee35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:17.117646 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d13df-50b5-4ed0-a528-5fbe0e8eee35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-999d13df-50b5-4ed0-a528-5fbe0e8eee35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:17.123264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:17.125355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:17.128941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:17.128941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:17.128941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:17.128941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:17.128941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:17.128941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:17.128941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:17.128941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:17.128941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:17.128941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:17.128941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:17.128941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:17.128941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 179/341] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:30:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:30:17.129611 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38486ce1-84e5-47bb-88aa-749a84a1b960 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:17.129909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38486ce1-84e5-47bb-88aa-749a84a1b960 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:17.130108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38486ce1-84e5-47bb-88aa-749a84a1b960 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:17.135607 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 180/342] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:17.136945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a292852-cf22-48e9-a94c-6ac07301f8cd None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:17.137228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a292852-cf22-48e9-a94c-6ac07301f8cd None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:17.137499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a292852-cf22-48e9-a94c-6ac07301f8cd None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:17.141962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 181/343] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:17.144074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf051cf-f4eb-40dd-a7ac-943c16beb2b4 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:17.144384 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf051cf-f4eb-40dd-a7ac-943c16beb2b4 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:17.144662 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf051cf-f4eb-40dd-a7ac-943c16beb2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:17.168073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-dbf051cf-f4eb-40dd-a7ac-943c16beb2b4 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:17.169326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-dbf051cf-f4eb-40dd-a7ac-943c16beb2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:17.273346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 182/344] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:17.274600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e90869-856c-454d-a7e5-34ec28be94e9 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:17.274892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e90869-856c-454d-a7e5-34ec28be94e9 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:17.275167 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e90869-856c-454d-a7e5-34ec28be94e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:17.296621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-e5e90869-856c-454d-a7e5-34ec28be94e9 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:17.297839 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e5e90869-856c-454d-a7e5-34ec28be94e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:17.324541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 163/345] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:17.331473 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464b4a0-7d83-4c77-98b5-afe3659d2a35 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:17.401681 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 183/346] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:17.403585 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c13ca5-0720-4e99-9090-84cbbcc9b215 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:17.404048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c13ca5-0720-4e99-9090-84cbbcc9b215 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:17.408521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c13ca5-0720-4e99-9090-84cbbcc9b215 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:17.414698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 184/347] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:17.416318 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c13ca5-0720-4e99-9090-84cbbcc9b215 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:17.460878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:17.524700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:17.600512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464b4a0-7d83-4c77-98b5-afe3659d2a35 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:17.602553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c13ca5-0720-4e99-9090-84cbbcc9b215 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:17.643047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2319430-5975-4859-8550-972823fdac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:17.644048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319430-5975-4859-8550-972823fdac70 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:17.644566 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319430-5975-4859-8550-972823fdac70 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:17.645145 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319430-5975-4859-8550-972823fdac70 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:17.646522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2319430-5975-4859-8550-972823fdac70 None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:17.648285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2319430-5975-4859-8550-972823fdac70 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:17.657044 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 185/348] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:17 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:17.658730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97805d0-3545-4383-a5d3-6e19348887fb None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:17.659284 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97805d0-3545-4383-a5d3-6e19348887fb None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:17.659848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97805d0-3545-4383-a5d3-6e19348887fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:17.684696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ddbf3-f86c-4c86-8180-5aaa58bed06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:17.685688 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ddbf3-f86c-4c86-8180-5aaa58bed06b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:17.686170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ddbf3-f86c-4c86-8180-5aaa58bed06b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:17.687151 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ddbf3-f86c-4c86-8180-5aaa58bed06b None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:17.687448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-b97805d0-3545-4383-a5d3-6e19348887fb None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:17.687922 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ddbf3-f86c-4c86-8180-5aaa58bed06b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:17.688275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ddbf3-f86c-4c86-8180-5aaa58bed06b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:17.689334 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b97805d0-3545-4383-a5d3-6e19348887fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:17.689712 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ddbf3-f86c-4c86-8180-5aaa58bed06b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:17.712459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 164/349] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:17.716267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ddbf3-f86c-4c86-8180-5aaa58bed06b None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:17.786637 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 186/350] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:17.794914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97805d0-3545-4383-a5d3-6e19348887fb None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:17.803713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:17.857857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ddbf3-f86c-4c86-8180-5aaa58bed06b None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:17.906200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce4bf0-9a98-4dad-8445-020adad26982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:17.906850 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce4bf0-9a98-4dad-8445-020adad26982 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:17.907180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce4bf0-9a98-4dad-8445-020adad26982 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:17.907403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce4bf0-9a98-4dad-8445-020adad26982 None admin] PATH_INFO: `/v3/groups/24b292470f914e9ba61ff8d9eb65a176` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:17.914043 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:17.924503 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce4bf0-9a98-4dad-8445-020adad26982 None admin] RBAC: Authorizing `identity:get_group(group_id=24b292470f914e9ba61ff8d9eb65a176)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:17.926253 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce4bf0-9a98-4dad-8445-020adad26982 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:17.929719 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 165/351] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 29 22:30:17 2022] GET /identity/v3/groups/24b292470f914e9ba61ff8d9eb65a176 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:17.930986 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce4bf0-9a98-4dad-8445-020adad26982 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:17.963880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97805d0-3545-4383-a5d3-6e19348887fb None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:18.029757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587ace6-a368-4bf0-ab56-3231a4a2580a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:18.030985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587ace6-a368-4bf0-ab56-3231a4a2580a None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:18.031270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587ace6-a368-4bf0-ab56-3231a4a2580a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:18.031551 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587ace6-a368-4bf0-ab56-3231a4a2580a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:18.051567 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587ace6-a368-4bf0-ab56-3231a4a2580a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-c587ace6-a368-4bf0-ab56-3231a4a2580a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:18.059930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:18.061731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:18.063312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:18.063312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:18.063312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:18.063312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:18.063312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:18.063312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:18.063312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:18.063312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:18.063312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:18.063312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:18.063312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:30:18.063312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:18.063312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 187/352] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:18.065392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587ace6-a368-4bf0-ab56-3231a4a2580a None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:18.107820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce4bf0-9a98-4dad-8445-020adad26982 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:18.162459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a16aab-46bb-4ec6-81fe-c0c47d5408de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:18.162964 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a16aab-46bb-4ec6-81fe-c0c47d5408de None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:18.163239 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a16aab-46bb-4ec6-81fe-c0c47d5408de None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:18.163510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a16aab-46bb-4ec6-81fe-c0c47d5408de None admin] PATH_INFO: `/v3/roles/member` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:18.165455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:18.176346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a16aab-46bb-4ec6-81fe-c0c47d5408de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-67a16aab-46bb-4ec6-81fe-c0c47d5408de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:18.181877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:18.189800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:18.191080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:18.191080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:18.191080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:18.191080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:18.191080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:18.191080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:18.191080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:18.191080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:18.191080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:18.191080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:18.191080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:18.191080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:18.191080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 166/353] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:18.191080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7f37e-ea7e-46d3-bf1a-4b48f2d33056 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:18.192319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7f37e-ea7e-46d3-bf1a-4b48f2d33056 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:18.192319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7f37e-ea7e-46d3-bf1a-4b48f2d33056 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:18.192319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 167/354] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:18.192319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7f37e-ea7e-46d3-bf1a-4b48f2d33056 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:18.228571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587ace6-a368-4bf0-ab56-3231a4a2580a None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:18.272626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:18.273856 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64f378-349b-440a-b1aa-244b95971c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:18.274477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64f378-349b-440a-b1aa-244b95971c62 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:18.274753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64f378-349b-440a-b1aa-244b95971c62 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:18.275023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64f378-349b-440a-b1aa-244b95971c62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:18.339023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7f37e-ea7e-46d3-bf1a-4b48f2d33056 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:18.371780 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64f378-349b-440a-b1aa-244b95971c62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:18.373408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64f378-349b-440a-b1aa-244b95971c62 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:18.389108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cca27c-8357-4f71-9fcd-a354a7199697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:18.390616 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cca27c-8357-4f71-9fcd-a354a7199697 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:18.390898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cca27c-8357-4f71-9fcd-a354a7199697 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:18.391168 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cca27c-8357-4f71-9fcd-a354a7199697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:18.391908 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cca27c-8357-4f71-9fcd-a354a7199697 None admin] RBAC: Adding query filter params (group.id=24b292470f914e9ba61ff8d9eb65a176, role.id=7cca4e8860b3437e801ffbf8429da7dd, scope.project.id=71ed3cc8b5a141bda65164dab60ee555) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:18.392255 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cca27c-8357-4f71-9fcd-a354a7199697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:18.393735 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cca27c-8357-4f71-9fcd-a354a7199697 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:18.400299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 168/355] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 29 22:30:18 2022] GET /identity/v3/role_assignments?group.id=24b292470f914e9ba61ff8d9eb65a176&scope.project.id=71ed3cc8b5a141bda65164dab60ee555&role.id=7cca4e8860b3437e801ffbf8429da7dd => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:18.401352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cca27c-8357-4f71-9fcd-a354a7199697 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:18.497854 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:18.555235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 188/356] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:18.560898 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64f378-349b-440a-b1aa-244b95971c62 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:18.590801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cca27c-8357-4f71-9fcd-a354a7199697 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:18.621075 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:18.649002 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb433f-05a1-4725-878d-bb433623c4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:18.650774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb433f-05a1-4725-878d-bb433623c4ca None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:18.651269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb433f-05a1-4725-878d-bb433623c4ca None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:18.651766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb433f-05a1-4725-878d-bb433623c4ca None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:18.654514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb433f-05a1-4725-878d-bb433623c4ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:18.655278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb433f-05a1-4725-878d-bb433623c4ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:18.658202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb433f-05a1-4725-878d-bb433623c4ca None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:18.683429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 169/357] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:18.684891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbd833-01a2-45b3-bb39-b1d0f9a6b39b None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:18.685123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbd833-01a2-45b3-bb39-b1d0f9a6b39b None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:18.685403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbd833-01a2-45b3-bb39-b1d0f9a6b39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:18.706997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-e9fbd833-01a2-45b3-bb39-b1d0f9a6b39b None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:18.708913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e9fbd833-01a2-45b3-bb39-b1d0f9a6b39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:18.711168 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64f378-349b-440a-b1aa-244b95971c62 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:18.766789 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35eac2-dfd3-4022-bb53-f860ed755e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:18.767361 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35eac2-dfd3-4022-bb53-f860ed755e84 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:18.767640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35eac2-dfd3-4022-bb53-f860ed755e84 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:18.767908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35eac2-dfd3-4022-bb53-f860ed755e84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:18.790888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35eac2-dfd3-4022-bb53-f860ed755e84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-ad35eac2-dfd3-4022-bb53-f860ed755e84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:18.796696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:18.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:18.798502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:18.798502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:18.798502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:18.798502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:18.798502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:18.798502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:18.798502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:18.798502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:18.798502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:18.798502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:18.798502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:18.798502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:18.798502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 189/358] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:30:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:18.799446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35eac2-dfd3-4022-bb53-f860ed755e84 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:18.815558 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 170/359] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:18.816073 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbd833-01a2-45b3-bb39-b1d0f9a6b39b None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:18.834220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:18.948302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35eac2-dfd3-4022-bb53-f860ed755e84 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:18.983562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbd833-01a2-45b3-bb39-b1d0f9a6b39b None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:19.015351 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d985ec-bcd3-43a2-b604-6570a4e87ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:19.015923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:19.017071 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d985ec-bcd3-43a2-b604-6570a4e87ee9 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:19.017304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d985ec-bcd3-43a2-b604-6570a4e87ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:19.017582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d985ec-bcd3-43a2-b604-6570a4e87ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:19.018310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d985ec-bcd3-43a2-b604-6570a4e87ee9 None admin] RBAC: Adding query filter params (name=member) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:19.018587 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d985ec-bcd3-43a2-b604-6570a4e87ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:19.019991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d985ec-bcd3-43a2-b604-6570a4e87ee9 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:19.031995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 190/360] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:19.036468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d985ec-bcd3-43a2-b604-6570a4e87ee9 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:19.044299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f131b4-a63c-4133-a45a-b45d7d58f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:19.045010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f131b4-a63c-4133-a45a-b45d7d58f5ae None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:19.045292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f131b4-a63c-4133-a45a-b45d7d58f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:19.045614 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f131b4-a63c-4133-a45a-b45d7d58f5ae None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:19.046852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f131b4-a63c-4133-a45a-b45d7d58f5ae None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:19.048451 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f131b4-a63c-4133-a45a-b45d7d58f5ae None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:19.050484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 171/361] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:18 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:19.051422 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f131b4-a63c-4133-a45a-b45d7d58f5ae None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:19.167210 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:19.191734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d985ec-bcd3-43a2-b604-6570a4e87ee9 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:19.210586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f131b4-a63c-4133-a45a-b45d7d58f5ae None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:19.241615 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466d02d-9442-4de0-bf8d-3060cb8edd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:19.242426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466d02d-9442-4de0-bf8d-3060cb8edd1b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:19.242774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466d02d-9442-4de0-bf8d-3060cb8edd1b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:19.243399 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466d02d-9442-4de0-bf8d-3060cb8edd1b None admin] PATH_INFO: `/v3/users/c422b18a2cff42bea2c7d6fd9c791acf` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:19.244628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466d02d-9442-4de0-bf8d-3060cb8edd1b None admin] RBAC: Authorizing `identity:get_user(user_id=c422b18a2cff42bea2c7d6fd9c791acf)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:19.246093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466d02d-9442-4de0-bf8d-3060cb8edd1b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:19.247720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 191/362] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:30:19 2022] GET /identity/v3/users/c422b18a2cff42bea2c7d6fd9c791acf => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:19.248511 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466d02d-9442-4de0-bf8d-3060cb8edd1b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:19.261935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ef925-68d7-44b0-b42e-3386b60f919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:19.262910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ef925-68d7-44b0-b42e-3386b60f919f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:19.263402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ef925-68d7-44b0-b42e-3386b60f919f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:19.263849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ef925-68d7-44b0-b42e-3386b60f919f None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:19.264829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ef925-68d7-44b0-b42e-3386b60f919f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:19.265414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ef925-68d7-44b0-b42e-3386b60f919f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:19.269051 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ef925-68d7-44b0-b42e-3386b60f919f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:19.281136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 172/363] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:19.282747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ef925-68d7-44b0-b42e-3386b60f919f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:19.369973 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:19.392349 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466d02d-9442-4de0-bf8d-3060cb8edd1b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:19.448569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e0ed5-eee3-4fc4-bfe0-71b77fe22dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:19.449197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e0ed5-eee3-4fc4-bfe0-71b77fe22dc2 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:19.449300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ef925-68d7-44b0-b42e-3386b60f919f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:19.449480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e0ed5-eee3-4fc4-bfe0-71b77fe22dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:19.449758 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e0ed5-eee3-4fc4-bfe0-71b77fe22dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:19.490195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:19.502608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf518d2-27f0-46fb-9654-c4ee160b4cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:19.503266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf518d2-27f0-46fb-9654-c4ee160b4cbe None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:19.503552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf518d2-27f0-46fb-9654-c4ee160b4cbe None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:19.503831 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf518d2-27f0-46fb-9654-c4ee160b4cbe None admin] PATH_INFO: `/v3/groups/24b292470f914e9ba61ff8d9eb65a176` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:19.505088 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf518d2-27f0-46fb-9654-c4ee160b4cbe None admin] RBAC: Authorizing `identity:get_group(group_id=24b292470f914e9ba61ff8d9eb65a176)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:19.506564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf518d2-27f0-46fb-9654-c4ee160b4cbe None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:19.509618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 173/364] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 29 22:30:19 2022] GET /identity/v3/groups/24b292470f914e9ba61ff8d9eb65a176 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:19.509618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf518d2-27f0-46fb-9654-c4ee160b4cbe None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:19.577652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e0ed5-eee3-4fc4-bfe0-71b77fe22dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:19.579409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e0ed5-eee3-4fc4-bfe0-71b77fe22dc2 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:19.666884 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf518d2-27f0-46fb-9654-c4ee160b4cbe None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:19.686409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:19.706400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e66e9-a57a-4fb7-8f26-9c7eb3f2e2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:19.707042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e66e9-a57a-4fb7-8f26-9c7eb3f2e2fe None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:19.707325 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e66e9-a57a-4fb7-8f26-9c7eb3f2e2fe None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:19.707602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e66e9-a57a-4fb7-8f26-9c7eb3f2e2fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:19.722275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e66e9-a57a-4fb7-8f26-9c7eb3f2e2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:19.727794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 192/365] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-c59e66e9-a57a-4fb7-8f26-9c7eb3f2e2fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:19.727965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:19.728844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:19.729639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:19.729639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:19.729639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:19.729639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:19.729639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:19.729639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:19.729639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:19.729639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:19.729639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:19.729639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:19.729639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:30:19.729639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:19.729639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 174/366] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:30:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:19.729639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e66e9-a57a-4fb7-8f26-9c7eb3f2e2fe None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:19.736868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e0ed5-eee3-4fc4-bfe0-71b77fe22dc2 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:19.811561 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:19.858774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e66e9-a57a-4fb7-8f26-9c7eb3f2e2fe None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:19.864896 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e0ed5-eee3-4fc4-bfe0-71b77fe22dc2 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:19.898685 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b220a-0798-410c-a1ce-1c9131283c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:19.899545 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b220a-0798-410c-a1ce-1c9131283c28 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:19.899978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b220a-0798-410c-a1ce-1c9131283c28 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:19.900340 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b220a-0798-410c-a1ce-1c9131283c28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:19.901119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b220a-0798-410c-a1ce-1c9131283c28 None admin] RBAC: Adding query filter params (role.id=c0d24825bab14907b75e4205bd286479, user.id=c422b18a2cff42bea2c7d6fd9c791acf, scope.system=all) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:19.901376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b220a-0798-410c-a1ce-1c9131283c28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:19.902830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b220a-0798-410c-a1ce-1c9131283c28 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:19.908420 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629e4d0-cfec-4ddd-94fa-33d7880bc6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:19.909196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629e4d0-cfec-4ddd-94fa-33d7880bc6f6 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:19.909550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629e4d0-cfec-4ddd-94fa-33d7880bc6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:19.909897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629e4d0-cfec-4ddd-94fa-33d7880bc6f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:19.916366 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 175/367] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Aug 29 22:30:19 2022] GET /identity/v3/role_assignments?user.id=c422b18a2cff42bea2c7d6fd9c791acf&scope.system=all&role.id=c0d24825bab14907b75e4205bd286479 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:19.917380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b220a-0798-410c-a1ce-1c9131283c28 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:19.974647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:20.016333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629e4d0-cfec-4ddd-94fa-33d7880bc6f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:20.018980 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629e4d0-cfec-4ddd-94fa-33d7880bc6f6 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:20.076288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b220a-0798-410c-a1ce-1c9131283c28 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:20.108971 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:20.136511 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0389b-64bf-4240-a140-45b23d8d1b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:20.138610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0389b-64bf-4240-a140-45b23d8d1b91 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:20.139124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0389b-64bf-4240-a140-45b23d8d1b91 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:20.140221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0389b-64bf-4240-a140-45b23d8d1b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:20.141176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0389b-64bf-4240-a140-45b23d8d1b91 None admin] RBAC: Adding query filter params (group.id=24b292470f914e9ba61ff8d9eb65a176, role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1, scope.project.id=71ed3cc8b5a141bda65164dab60ee555) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:20.141693 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0389b-64bf-4240-a140-45b23d8d1b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:20.143361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0389b-64bf-4240-a140-45b23d8d1b91 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:20.152410 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 176/368] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 29 22:30:19 2022] GET /identity/v3/role_assignments?group.id=24b292470f914e9ba61ff8d9eb65a176&scope.project.id=71ed3cc8b5a141bda65164dab60ee555&role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:20.156429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0389b-64bf-4240-a140-45b23d8d1b91 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:20.172123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 193/369] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:20.172123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629e4d0-cfec-4ddd-94fa-33d7880bc6f6 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:20.313138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:20.320256 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0389b-64bf-4240-a140-45b23d8d1b91 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:20.334273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629e4d0-cfec-4ddd-94fa-33d7880bc6f6 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:20.363851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a134d54-e1bd-4826-8336-0d2a9579a0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:20.364549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a134d54-e1bd-4826-8336-0d2a9579a0eb None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:20.364902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a134d54-e1bd-4826-8336-0d2a9579a0eb None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:20.365265 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a134d54-e1bd-4826-8336-0d2a9579a0eb None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:20.366079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a134d54-e1bd-4826-8336-0d2a9579a0eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:20.366450 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a134d54-e1bd-4826-8336-0d2a9579a0eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:20.367984 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a134d54-e1bd-4826-8336-0d2a9579a0eb None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:20.379566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 177/370] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:20.380572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a134d54-e1bd-4826-8336-0d2a9579a0eb None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:20.384924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ffda2-b153-4bc1-aee9-c9cbb9b804a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:20.385606 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ffda2-b153-4bc1-aee9-c9cbb9b804a5 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:20.385888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ffda2-b153-4bc1-aee9-c9cbb9b804a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:20.386163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ffda2-b153-4bc1-aee9-c9cbb9b804a5 None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:20.388547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ffda2-b153-4bc1-aee9-c9cbb9b804a5 None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:20.390616 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ffda2-b153-4bc1-aee9-c9cbb9b804a5 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:20.392696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 194/371] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:20 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:20.393535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ffda2-b153-4bc1-aee9-c9cbb9b804a5 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:20.425968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:20.523165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a134d54-e1bd-4826-8336-0d2a9579a0eb None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:20.523888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ffda2-b153-4bc1-aee9-c9cbb9b804a5 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:20.566282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438693e6-40bf-47b4-a3c0-6d7208a625f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:20.566908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438693e6-40bf-47b4-a3c0-6d7208a625f9 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:20.567188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438693e6-40bf-47b4-a3c0-6d7208a625f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:20.567464 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438693e6-40bf-47b4-a3c0-6d7208a625f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:20.571786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41102fae-a855-43cb-8892-7dd928cdef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:20.572540 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41102fae-a855-43cb-8892-7dd928cdef5c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:20.573085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41102fae-a855-43cb-8892-7dd928cdef5c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:20.573431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41102fae-a855-43cb-8892-7dd928cdef5c None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:20.574673 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41102fae-a855-43cb-8892-7dd928cdef5c None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:20.576300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41102fae-a855-43cb-8892-7dd928cdef5c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:20.578710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 178/372] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:20 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:20.583852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41102fae-a855-43cb-8892-7dd928cdef5c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:20.631710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:20.657838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438693e6-40bf-47b4-a3c0-6d7208a625f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:20.659322 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438693e6-40bf-47b4-a3c0-6d7208a625f9 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:20.690737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:20.725170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41102fae-a855-43cb-8892-7dd928cdef5c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:20.774294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ee2c5-370f-481d-99e8-51453b577048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:20.775358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ee2c5-370f-481d-99e8-51453b577048 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:20.775986 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ee2c5-370f-481d-99e8-51453b577048 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:20.777939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ee2c5-370f-481d-99e8-51453b577048 None admin] PATH_INFO: `/v3/groups/24b292470f914e9ba61ff8d9eb65a176` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:20.778618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ee2c5-370f-481d-99e8-51453b577048 None admin] RBAC: Authorizing `identity:get_group(group_id=24b292470f914e9ba61ff8d9eb65a176)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:20.780995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ee2c5-370f-481d-99e8-51453b577048 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:20.782860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 179/373] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 29 22:30:20 2022] GET /identity/v3/groups/24b292470f914e9ba61ff8d9eb65a176 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:20.783969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c852aec-8e06-47ac-9e6b-73bcd83a3eb5 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:20.784286 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c852aec-8e06-47ac-9e6b-73bcd83a3eb5 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:20.784566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c852aec-8e06-47ac-9e6b-73bcd83a3eb5 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:20.785980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 180/374] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:20.789725 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c852aec-8e06-47ac-9e6b-73bcd83a3eb5 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:20.799396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 195/375] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:20.800446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438693e6-40bf-47b4-a3c0-6d7208a625f9 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:20.912421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:20.921920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c852aec-8e06-47ac-9e6b-73bcd83a3eb5 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:20.966551 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438693e6-40bf-47b4-a3c0-6d7208a625f9 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:20.977572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174b858-0d4f-4634-8832-779e753f8ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:20.978353 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174b858-0d4f-4634-8832-779e753f8ee8 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:20.978828 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174b858-0d4f-4634-8832-779e753f8ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:20.979203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174b858-0d4f-4634-8832-779e753f8ee8 None admin] PATH_INFO: `/v3/groups/24b292470f914e9ba61ff8d9eb65a176` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:20.980671 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174b858-0d4f-4634-8832-779e753f8ee8 None admin] RBAC: Authorizing `identity:get_group(group_id=24b292470f914e9ba61ff8d9eb65a176)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:20.982193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174b858-0d4f-4634-8832-779e753f8ee8 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:20.984188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 181/376] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 29 22:30:20 2022] GET /identity/v3/groups/24b292470f914e9ba61ff8d9eb65a176 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:20.990123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184c8c4-d24c-4a9d-82d0-59c25f359b0d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:20.990484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184c8c4-d24c-4a9d-82d0-59c25f359b0d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:20.990836 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184c8c4-d24c-4a9d-82d0-59c25f359b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:20.997320 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:21.014091 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35885e38-5b7f-4791-956b-247d990d54f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:21.016469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-5184c8c4-d24c-4a9d-82d0-59c25f359b0d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:21.016469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-5184c8c4-d24c-4a9d-82d0-59c25f359b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:21.018007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35885e38-5b7f-4791-956b-247d990d54f1 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:21.020145 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35885e38-5b7f-4791-956b-247d990d54f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:21.020592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35885e38-5b7f-4791-956b-247d990d54f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:21.021359 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35885e38-5b7f-4791-956b-247d990d54f1 None admin] RBAC: Adding query filter params (group.id=24b292470f914e9ba61ff8d9eb65a176, role.id=7cca4e8860b3437e801ffbf8429da7dd, scope.project.id=95503c3913594436a874debf8bd8d080) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:21.021699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35885e38-5b7f-4791-956b-247d990d54f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:21.023119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35885e38-5b7f-4791-956b-247d990d54f1 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:21.036214 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 196/377] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 29 22:30:20 2022] GET /identity/v3/role_assignments?group.id=24b292470f914e9ba61ff8d9eb65a176&scope.project.id=95503c3913594436a874debf8bd8d080&role.id=7cca4e8860b3437e801ffbf8429da7dd => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:21.036214 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35885e38-5b7f-4791-956b-247d990d54f1 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:21.196399 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 182/378] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:21.197610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184c8c4-d24c-4a9d-82d0-59c25f359b0d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:21.325766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:21.337658 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184c8c4-d24c-4a9d-82d0-59c25f359b0d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:21.390749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2f119-2883-4d6d-8144-30cecc01a2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:21.392639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2f119-2883-4d6d-8144-30cecc01a2fe None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:21.393716 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2f119-2883-4d6d-8144-30cecc01a2fe None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:21.394198 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2f119-2883-4d6d-8144-30cecc01a2fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:21.395092 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2f119-2883-4d6d-8144-30cecc01a2fe None admin] RBAC: Adding query filter params (group.id=24b292470f914e9ba61ff8d9eb65a176, role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1, scope.project.id=95503c3913594436a874debf8bd8d080) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:21.395536 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2f119-2883-4d6d-8144-30cecc01a2fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:21.397326 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2f119-2883-4d6d-8144-30cecc01a2fe None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:21.405632 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 183/379] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 29 22:30:21 2022] GET /identity/v3/role_assignments?group.id=24b292470f914e9ba61ff8d9eb65a176&scope.project.id=95503c3913594436a874debf8bd8d080&role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:21.490315 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35885e38-5b7f-4791-956b-247d990d54f1 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:21.577492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2f119-2883-4d6d-8144-30cecc01a2fe None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:21.583228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd118c-bf16-4296-8e8b-7f8cf6791327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:21.583751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd118c-bf16-4296-8e8b-7f8cf6791327 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:21.584025 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd118c-bf16-4296-8e8b-7f8cf6791327 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:21.584339 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd118c-bf16-4296-8e8b-7f8cf6791327 None admin] PATH_INFO: `/v3/projects/acc9b26755b04e9387ec6536e491c79d` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:21.585510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd118c-bf16-4296-8e8b-7f8cf6791327 None admin] RBAC: Authorizing `identity:get_project(project_id=acc9b26755b04e9387ec6536e491c79d)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:21.586966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd118c-bf16-4296-8e8b-7f8cf6791327 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:21.596114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 197/380] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:21 2022] GET /identity/v3/projects/acc9b26755b04e9387ec6536e491c79d => generated 344 bytes in 557 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:21.601120 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd118c-bf16-4296-8e8b-7f8cf6791327 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:21.865378 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:22.014951 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2f119-2883-4d6d-8144-30cecc01a2fe None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:22.073682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd118c-bf16-4296-8e8b-7f8cf6791327 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:22.137779 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd26bc-03e3-41e1-842e-921c6f759027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:22.138701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd26bc-03e3-41e1-842e-921c6f759027 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:22.139147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd26bc-03e3-41e1-842e-921c6f759027 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:22.140188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd26bc-03e3-41e1-842e-921c6f759027 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:22.171851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd26bc-03e3-41e1-842e-921c6f759027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-74cd26bc-03e3-41e1-842e-921c6f759027 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:22.185677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:22.187210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:22.188003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:22.188003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:22.188003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:22.188003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:22.188003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:22.188003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:22.188003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:22.188003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:22.188003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:22.188003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:22.188003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:22.188003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:22.190674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 184/381] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 614 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:22.198818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd26bc-03e3-41e1-842e-921c6f759027 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:22.233449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c7d4c-1fdb-4d8c-9c4a-388148002bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:22.234133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c7d4c-1fdb-4d8c-9c4a-388148002bea None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:22.240180 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c7d4c-1fdb-4d8c-9c4a-388148002bea None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:22.240180 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c7d4c-1fdb-4d8c-9c4a-388148002bea None admin] PATH_INFO: `/v3/groups/1148bfe817374c51846d47219ccb9d37` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:22.248509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:22.276127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c7d4c-1fdb-4d8c-9c4a-388148002bea None admin] RBAC: Authorizing `identity:get_group(group_id=1148bfe817374c51846d47219ccb9d37)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:22.276127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c7d4c-1fdb-4d8c-9c4a-388148002bea None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:22.284122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 198/382] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 29 22:30:21 2022] GET /identity/v3/groups/1148bfe817374c51846d47219ccb9d37 => generated 229 bytes in 681 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:22.296128 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c7d4c-1fdb-4d8c-9c4a-388148002bea None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:22.464214 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd26bc-03e3-41e1-842e-921c6f759027 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:22.496142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c7d4c-1fdb-4d8c-9c4a-388148002bea None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:22.534538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:22.541713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970f6b0-d1a3-4b5d-88b8-2b33d0a18765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:22.543982 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970f6b0-d1a3-4b5d-88b8-2b33d0a18765 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:22.544294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970f6b0-d1a3-4b5d-88b8-2b33d0a18765 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:22.544574 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970f6b0-d1a3-4b5d-88b8-2b33d0a18765 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:22.558509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970f6b0-d1a3-4b5d-88b8-2b33d0a18765 None admin] RBAC: Adding query filter params (name=member) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:22.558509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970f6b0-d1a3-4b5d-88b8-2b33d0a18765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:22.558509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970f6b0-d1a3-4b5d-88b8-2b33d0a18765 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:22.562945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 185/383] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:22.562945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229763c-d4b5-4cbe-997a-298d4a099804 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:22.562945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229763c-d4b5-4cbe-997a-298d4a099804 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:22.562945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229763c-d4b5-4cbe-997a-298d4a099804 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:22.562945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 186/384] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:22.573119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229763c-d4b5-4cbe-997a-298d4a099804 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:22.594699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824d9a1-f66d-4b7e-89d8-382222050d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:22.595349 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d9a1-f66d-4b7e-89d8-382222050d01 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:22.596154 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d9a1-f66d-4b7e-89d8-382222050d01 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:22.596438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d9a1-f66d-4b7e-89d8-382222050d01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:22.597184 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824d9a1-f66d-4b7e-89d8-382222050d01 None admin] RBAC: Adding query filter params (group.id=1148bfe817374c51846d47219ccb9d37, role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=acc9b26755b04e9387ec6536e491c79d) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:22.597490 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824d9a1-f66d-4b7e-89d8-382222050d01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:22.603877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824d9a1-f66d-4b7e-89d8-382222050d01 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:22.628753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 199/385] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 29 22:30:22 2022] GET /identity/v3/role_assignments?group.id=1148bfe817374c51846d47219ccb9d37&scope.project.id=acc9b26755b04e9387ec6536e491c79d&role.id=a7d59d2982de4bfeb758dce70808029f => generated 260 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:22.630150 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b8dad-fc4d-4cdd-b01f-6ee87c773b50 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:22.630446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b8dad-fc4d-4cdd-b01f-6ee87c773b50 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:22.630713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b8dad-fc4d-4cdd-b01f-6ee87c773b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:22.697322 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-3a5b8dad-fc4d-4cdd-b01f-6ee87c773b50 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:22.699605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3a5b8dad-fc4d-4cdd-b01f-6ee87c773b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:22.832833 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:22.934614 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229763c-d4b5-4cbe-997a-298d4a099804 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:22.941506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 200/386] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:23.031377 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d472be4-bb9c-41f5-9cdb-3311e7f54e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:23.032471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d472be4-bb9c-41f5-9cdb-3311e7f54e01 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:23.033224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d472be4-bb9c-41f5-9cdb-3311e7f54e01 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:23.033717 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d472be4-bb9c-41f5-9cdb-3311e7f54e01 None admin] PATH_INFO: `/v3/groups/24b292470f914e9ba61ff8d9eb65a176` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:23.041026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d472be4-bb9c-41f5-9cdb-3311e7f54e01 None admin] RBAC: Authorizing `identity:get_group(group_id=24b292470f914e9ba61ff8d9eb65a176)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:23.042849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d472be4-bb9c-41f5-9cdb-3311e7f54e01 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:23.045204 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 187/387] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 29 22:30:22 2022] GET /identity/v3/groups/24b292470f914e9ba61ff8d9eb65a176 => generated 226 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:23.053226 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b8dad-fc4d-4cdd-b01f-6ee87c773b50 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:23.215809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e6f7f-6bad-4fe3-9311-2d2df1325f73 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:23.215809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e6f7f-6bad-4fe3-9311-2d2df1325f73 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:23.215809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e6f7f-6bad-4fe3-9311-2d2df1325f73 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:23.215809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 188/388] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:23.230023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc59b19-e414-42d5-9d0c-fe67d63658a4 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:23.230023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc59b19-e414-42d5-9d0c-fe67d63658a4 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:23.230023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc59b19-e414-42d5-9d0c-fe67d63658a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:23.280190 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b8dad-fc4d-4cdd-b01f-6ee87c773b50 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:23.304041 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:23.329494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-4bc59b19-e414-42d5-9d0c-fe67d63658a4 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:23.336292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4bc59b19-e414-42d5-9d0c-fe67d63658a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:23.349251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3a2ab-4e9b-4744-8aff-77193a841508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:23.352319 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3a2ab-4e9b-4744-8aff-77193a841508 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:23.353043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3a2ab-4e9b-4744-8aff-77193a841508 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:23.353325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3a2ab-4e9b-4744-8aff-77193a841508 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:23.360404 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3a2ab-4e9b-4744-8aff-77193a841508 None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:23.360404 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3a2ab-4e9b-4744-8aff-77193a841508 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:23.371230 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 201/389] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:23 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:23.379293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3a2ab-4e9b-4744-8aff-77193a841508 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:23.540341 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 189/390] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:23.541203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc59b19-e414-42d5-9d0c-fe67d63658a4 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:23.655496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:23.664179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3a2ab-4e9b-4744-8aff-77193a841508 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:23.682932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc59b19-e414-42d5-9d0c-fe67d63658a4 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:23.719851 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739135a0-5ad5-4ecd-9ad1-5a399c6eb24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:23.721313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739135a0-5ad5-4ecd-9ad1-5a399c6eb24e None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:23.721874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739135a0-5ad5-4ecd-9ad1-5a399c6eb24e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:23.722162 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739135a0-5ad5-4ecd-9ad1-5a399c6eb24e None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555/groups/24b292470f914e9ba61ff8d9eb65a176/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:23.723328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e15e62-aa9a-41eb-bba3-6b76039f7394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:23.724114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739135a0-5ad5-4ecd-9ad1-5a399c6eb24e None admin] RBAC: Authorizing `identity:create_grant(project_id=71ed3cc8b5a141bda65164dab60ee555, group_id=24b292470f914e9ba61ff8d9eb65a176, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:23.724647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e15e62-aa9a-41eb-bba3-6b76039f7394 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:23.725157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e15e62-aa9a-41eb-bba3-6b76039f7394 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:23.725570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739135a0-5ad5-4ecd-9ad1-5a399c6eb24e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:23.725830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e15e62-aa9a-41eb-bba3-6b76039f7394 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:23.737561 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e15e62-aa9a-41eb-bba3-6b76039f7394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-24e15e62-aa9a-41eb-bba3-6b76039f7394 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:23.742976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:23.743901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:23.744736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:23.744736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:23.744736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:23.744736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:23.744736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:23.744736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:23.744736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:23.744736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:23.744736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:23.744736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:23.744736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:23.744736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:23.744736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 190/391] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:30:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:23.748230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e5cd2-5dc5-4943-8abe-1f93ab853ebe None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:23.749353 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e5cd2-5dc5-4943-8abe-1f93ab853ebe None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:23.750413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e5cd2-5dc5-4943-8abe-1f93ab853ebe None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:23.751919 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 191/392] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:23.752844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e5cd2-5dc5-4943-8abe-1f93ab853ebe None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:23.807516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 202/393] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Aug 29 22:30:23 2022] PUT /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555/groups/24b292470f914e9ba61ff8d9eb65a176/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:30:23.808933 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6c0e2-3ba6-4c48-ac93-512db697e1f7 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:23.809235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6c0e2-3ba6-4c48-ac93-512db697e1f7 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:23.809479 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6c0e2-3ba6-4c48-ac93-512db697e1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:23.832649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-efe6c0e2-3ba6-4c48-ac93-512db697e1f7 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:23.834389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-efe6c0e2-3ba6-4c48-ac93-512db697e1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:23.886278 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:23.915190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e5cd2-5dc5-4943-8abe-1f93ab853ebe None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:23.929811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 203/394] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:23.930508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6c0e2-3ba6-4c48-ac93-512db697e1f7 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:23.966541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8f65c-df8e-4801-88d1-416eba46d9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:23.967778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8f65c-df8e-4801-88d1-416eba46d9ea None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:23.968327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8f65c-df8e-4801-88d1-416eba46d9ea None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:23.968821 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8f65c-df8e-4801-88d1-416eba46d9ea None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:23.969769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8f65c-df8e-4801-88d1-416eba46d9ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:23.970842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8f65c-df8e-4801-88d1-416eba46d9ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:23.972881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8f65c-df8e-4801-88d1-416eba46d9ea None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:23.976101 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:23.984651 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 192/395] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:23.992628 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8f65c-df8e-4801-88d1-416eba46d9ea None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:24.142353 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8f65c-df8e-4801-88d1-416eba46d9ea None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:24.154089 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6c0e2-3ba6-4c48-ac93-512db697e1f7 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:24.194327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad01b38-a809-47e6-adb0-b44ef9d795c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:24.194971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad01b38-a809-47e6-adb0-b44ef9d795c2 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:24.195248 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad01b38-a809-47e6-adb0-b44ef9d795c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:24.195525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad01b38-a809-47e6-adb0-b44ef9d795c2 None admin] PATH_INFO: `/v3/groups/24b292470f914e9ba61ff8d9eb65a176` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:24.196889 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad01b38-a809-47e6-adb0-b44ef9d795c2 None admin] RBAC: Authorizing `identity:get_group(group_id=24b292470f914e9ba61ff8d9eb65a176)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:24.199489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad01b38-a809-47e6-adb0-b44ef9d795c2 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:24.202799 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 193/396] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 29 22:30:23 2022] GET /identity/v3/groups/24b292470f914e9ba61ff8d9eb65a176 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:30:24.208520 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad01b38-a809-47e6-adb0-b44ef9d795c2 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:24.227457 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783f651-192e-4fc4-9e7c-78fe844a7c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:24.228178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783f651-192e-4fc4-9e7c-78fe844a7c62 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:24.228461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783f651-192e-4fc4-9e7c-78fe844a7c62 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:24.228729 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783f651-192e-4fc4-9e7c-78fe844a7c62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:24.257128 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783f651-192e-4fc4-9e7c-78fe844a7c62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-9783f651-192e-4fc4-9e7c-78fe844a7c62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:24.264907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:24.265882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:24.266797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:24.266797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:24.266797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:24.266797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:24.266797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:24.266797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:24.266797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:24.266797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:24.266797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:24.266797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:24.266797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:24.266797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:24.266797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 204/397] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:24.271110 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783f651-192e-4fc4-9e7c-78fe844a7c62 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:24.301941 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:24.313960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:24.344635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad01b38-a809-47e6-adb0-b44ef9d795c2 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:24.390381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360f758-3efa-492e-bb46-d611d09667cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:24.391443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360f758-3efa-492e-bb46-d611d09667cd None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:24.391994 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360f758-3efa-492e-bb46-d611d09667cd None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:24.392583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360f758-3efa-492e-bb46-d611d09667cd None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:24.393977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360f758-3efa-492e-bb46-d611d09667cd None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:24.395766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360f758-3efa-492e-bb46-d611d09667cd None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:24.397810 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 194/398] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:24 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:24.398952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360f758-3efa-492e-bb46-d611d09667cd None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:24.409220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783f651-192e-4fc4-9e7c-78fe844a7c62 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:24.451812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23e179-8a30-431f-9912-a1b62bf07f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:24.458104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23e179-8a30-431f-9912-a1b62bf07f51 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:24.458104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23e179-8a30-431f-9912-a1b62bf07f51 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:24.458104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23e179-8a30-431f-9912-a1b62bf07f51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:24.468750 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23e179-8a30-431f-9912-a1b62bf07f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-4f23e179-8a30-431f-9912-a1b62bf07f51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:24.476072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:24.477271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:24.478265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:24.478265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:24.478265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:24.478265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:24.478265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:24.478265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:24.478265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:24.478265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:24.478265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:24.478265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:24.478265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:24.478265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:24.480442 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 205/399] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:30:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:24.484798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23e179-8a30-431f-9912-a1b62bf07f51 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:24.545008 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360f758-3efa-492e-bb46-d611d09667cd None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:24.593612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac605e7-e05b-40c2-832b-97427c85c849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:24.594425 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac605e7-e05b-40c2-832b-97427c85c849 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:24.594875 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac605e7-e05b-40c2-832b-97427c85c849 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:24.595329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac605e7-e05b-40c2-832b-97427c85c849 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:24.596211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac605e7-e05b-40c2-832b-97427c85c849 None admin] RBAC: Adding query filter params (name=member) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:24.596699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac605e7-e05b-40c2-832b-97427c85c849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:24.598889 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac605e7-e05b-40c2-832b-97427c85c849 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:24.601032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:24.612755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 195/400] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:24.615943 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac605e7-e05b-40c2-832b-97427c85c849 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:24.617628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:24.630543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23e179-8a30-431f-9912-a1b62bf07f51 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:24.670069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238d8af-ccea-4ddd-93e1-c7f8b67d1c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:24.672071 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238d8af-ccea-4ddd-93e1-c7f8b67d1c4a None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:24.672534 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238d8af-ccea-4ddd-93e1-c7f8b67d1c4a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:24.672946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238d8af-ccea-4ddd-93e1-c7f8b67d1c4a None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555/groups/24b292470f914e9ba61ff8d9eb65a176/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:24.676184 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238d8af-ccea-4ddd-93e1-c7f8b67d1c4a None admin] RBAC: Authorizing `identity:create_grant(project_id=71ed3cc8b5a141bda65164dab60ee555, group_id=24b292470f914e9ba61ff8d9eb65a176, role_id=dcd0c9dbe86e4660b3d7ab1bce4762b1)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:24.679045 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238d8af-ccea-4ddd-93e1-c7f8b67d1c4a None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:24.728703 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac605e7-e05b-40c2-832b-97427c85c849 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:24.763457 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 206/401] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Aug 29 22:30:24 2022] PUT /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555/groups/24b292470f914e9ba61ff8d9eb65a176/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:24.764808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238d8af-ccea-4ddd-93e1-c7f8b67d1c4a None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:24.766922 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad49a9-b8dd-42d7-b746-9f6f2aa5a713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:24.767963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad49a9-b8dd-42d7-b746-9f6f2aa5a713 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:24.768272 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad49a9-b8dd-42d7-b746-9f6f2aa5a713 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:24.768634 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad49a9-b8dd-42d7-b746-9f6f2aa5a713 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:24.770356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad49a9-b8dd-42d7-b746-9f6f2aa5a713 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:24.770356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad49a9-b8dd-42d7-b746-9f6f2aa5a713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:24.771817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad49a9-b8dd-42d7-b746-9f6f2aa5a713 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:24.783491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 196/402] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:24.792074 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad49a9-b8dd-42d7-b746-9f6f2aa5a713 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:24.905250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238d8af-ccea-4ddd-93e1-c7f8b67d1c4a None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:24.965392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ca318-f202-4df9-977d-22509a7d83e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:24.966416 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ca318-f202-4df9-977d-22509a7d83e9 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:24.966892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ca318-f202-4df9-977d-22509a7d83e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:24.967403 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ca318-f202-4df9-977d-22509a7d83e9 None admin] PATH_INFO: `/v3/groups/24b292470f914e9ba61ff8d9eb65a176` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:24.968293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:24.973064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ca318-f202-4df9-977d-22509a7d83e9 None admin] RBAC: Authorizing `identity:get_group(group_id=24b292470f914e9ba61ff8d9eb65a176)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:24.974931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ca318-f202-4df9-977d-22509a7d83e9 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:24.980175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 207/403] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 29 22:30:24 2022] GET /identity/v3/groups/24b292470f914e9ba61ff8d9eb65a176 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:24.989950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ca318-f202-4df9-977d-22509a7d83e9 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:25.039118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:25.041812 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad49a9-b8dd-42d7-b746-9f6f2aa5a713 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:25.089063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3360c75-df2c-4560-90b0-217d40948086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:25.089940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3360c75-df2c-4560-90b0-217d40948086 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:25.090309 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3360c75-df2c-4560-90b0-217d40948086 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:25.090686 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3360c75-df2c-4560-90b0-217d40948086 None admin] PATH_INFO: `/v3/groups/24b292470f914e9ba61ff8d9eb65a176` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:25.092250 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3360c75-df2c-4560-90b0-217d40948086 None admin] RBAC: Authorizing `identity:get_group(group_id=24b292470f914e9ba61ff8d9eb65a176)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:25.100205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3360c75-df2c-4560-90b0-217d40948086 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:25.100205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 197/404] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 29 22:30:24 2022] GET /identity/v3/groups/24b292470f914e9ba61ff8d9eb65a176 => generated 226 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:25.100205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff63608-5515-4884-9410-0585038ec98a None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:25.100205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff63608-5515-4884-9410-0585038ec98a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:25.100205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff63608-5515-4884-9410-0585038ec98a None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:25.100205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 198/405] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:25.104231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff63608-5515-4884-9410-0585038ec98a None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:25.163410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ca318-f202-4df9-977d-22509a7d83e9 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:25.204611 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e56db0-9931-499b-8116-f8427d542a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:25.205612 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e56db0-9931-499b-8116-f8427d542a31 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:25.206138 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e56db0-9931-499b-8116-f8427d542a31 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:25.206624 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e56db0-9931-499b-8116-f8427d542a31 None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:25.208562 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e56db0-9931-499b-8116-f8427d542a31 None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:25.210731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e56db0-9931-499b-8116-f8427d542a31 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:25.213846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 208/406] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:24 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:30:25.215476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dfc47-fb24-4a99-8266-d5bb77e40b44 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:25.215963 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dfc47-fb24-4a99-8266-d5bb77e40b44 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:25.216457 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dfc47-fb24-4a99-8266-d5bb77e40b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:25.241086 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-2a7dfc47-fb24-4a99-8266-d5bb77e40b44 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:25.242882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-2a7dfc47-fb24-4a99-8266-d5bb77e40b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:25.243014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff63608-5515-4884-9410-0585038ec98a None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:25.281138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:25.290914 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0cfa3-5658-4b5f-8b6b-d3ad0ddaad11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:25.292562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0cfa3-5658-4b5f-8b6b-d3ad0ddaad11 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:25.292562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0cfa3-5658-4b5f-8b6b-d3ad0ddaad11 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:25.292562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0cfa3-5658-4b5f-8b6b-d3ad0ddaad11 None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:25.303285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0cfa3-5658-4b5f-8b6b-d3ad0ddaad11 None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:25.303285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0cfa3-5658-4b5f-8b6b-d3ad0ddaad11 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:25.303285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 199/407] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:25 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:25.303285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0cfa3-5658-4b5f-8b6b-d3ad0ddaad11 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:25.344237 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 209/408] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:25.345159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dfc47-fb24-4a99-8266-d5bb77e40b44 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:25.394334 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:25.463404 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0cfa3-5658-4b5f-8b6b-d3ad0ddaad11 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:25.541293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46671f3-62b3-42b9-96d7-e071176d4bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:25.541944 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46671f3-62b3-42b9-96d7-e071176d4bfe None admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:25.542250 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46671f3-62b3-42b9-96d7-e071176d4bfe None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:25.542529 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46671f3-62b3-42b9-96d7-e071176d4bfe None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080/groups/24b292470f914e9ba61ff8d9eb65a176/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:25.548689 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46671f3-62b3-42b9-96d7-e071176d4bfe None admin] RBAC: Authorizing `identity:create_grant(project_id=95503c3913594436a874debf8bd8d080, group_id=24b292470f914e9ba61ff8d9eb65a176, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:25.550408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46671f3-62b3-42b9-96d7-e071176d4bfe None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:25.559677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dfc47-fb24-4a99-8266-d5bb77e40b44 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:25.607974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446b718-4f6e-402c-8637-788e513e5fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:25.616134 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446b718-4f6e-402c-8637-788e513e5fde None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:25.616134 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446b718-4f6e-402c-8637-788e513e5fde None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:25.616134 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446b718-4f6e-402c-8637-788e513e5fde None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080/groups/24b292470f914e9ba61ff8d9eb65a176/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:25.616134 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446b718-4f6e-402c-8637-788e513e5fde None admin] RBAC: Authorizing `identity:create_grant(project_id=95503c3913594436a874debf8bd8d080, group_id=24b292470f914e9ba61ff8d9eb65a176, role_id=dcd0c9dbe86e4660b3d7ab1bce4762b1)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:25.616134 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446b718-4f6e-402c-8637-788e513e5fde None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:25.640835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 200/409] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Aug 29 22:30:25 2022] PUT /identity/v3/projects/95503c3913594436a874debf8bd8d080/groups/24b292470f914e9ba61ff8d9eb65a176/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:25.644532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46671f3-62b3-42b9-96d7-e071176d4bfe None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:25.699981 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 210/410] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Aug 29 22:30:25 2022] PUT /identity/v3/projects/95503c3913594436a874debf8bd8d080/groups/24b292470f914e9ba61ff8d9eb65a176/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:25.719604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:25.774997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46671f3-62b3-42b9-96d7-e071176d4bfe None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:25.815151 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb8ebe-86c8-48e4-8fea-45a6ac90c89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:25.815832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb8ebe-86c8-48e4-8fea-45a6ac90c89e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:25.816143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb8ebe-86c8-48e4-8fea-45a6ac90c89e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:25.816429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb8ebe-86c8-48e4-8fea-45a6ac90c89e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:25.829847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb8ebe-86c8-48e4-8fea-45a6ac90c89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-c5eb8ebe-86c8-48e4-8fea-45a6ac90c89e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:25.835773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:25.837115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:25.837953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:25.837953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:25.837953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:25.837953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:25.837953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:25.837953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:25.837953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:25.837953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:25.837953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:25.837953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:25.837953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:30:25.837953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:25.837953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 201/411] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:30:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:25.845993 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446b718-4f6e-402c-8637-788e513e5fde None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:25.992133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:26.033483 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446b718-4f6e-402c-8637-788e513e5fde None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:26.049732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777a27f-9383-4420-822d-24b59541d07c None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:26.050395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777a27f-9383-4420-822d-24b59541d07c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:26.050919 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777a27f-9383-4420-822d-24b59541d07c None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:26.052910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 202/412] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:30:26.059142 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57405-999a-436b-b228-3e17abaf3b39 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:26.059731 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57405-999a-436b-b228-3e17abaf3b39 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:26.060271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57405-999a-436b-b228-3e17abaf3b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:26.090040 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-08d57405-999a-436b-b228-3e17abaf3b39 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:26.091572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-08d57405-999a-436b-b228-3e17abaf3b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:26.150536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dba631-dac0-4883-9d12-d9b77dedfea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:26.150902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dba631-dac0-4883-9d12-d9b77dedfea6 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:26.151189 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dba631-dac0-4883-9d12-d9b77dedfea6 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:26.151455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dba631-dac0-4883-9d12-d9b77dedfea6 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:26.152278 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dba631-dac0-4883-9d12-d9b77dedfea6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:26.152586 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dba631-dac0-4883-9d12-d9b77dedfea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:26.153961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dba631-dac0-4883-9d12-d9b77dedfea6 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:26.166752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 203/413] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:30:26.172672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 211/414] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:26.178202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d57405-999a-436b-b228-3e17abaf3b39 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:26.276482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:26.330484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d57405-999a-436b-b228-3e17abaf3b39 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:26.366753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737e9ce-4e85-47c8-aa7a-d915613a792c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:26.367747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737e9ce-4e85-47c8-aa7a-d915613a792c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:26.368276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737e9ce-4e85-47c8-aa7a-d915613a792c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:26.368758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737e9ce-4e85-47c8-aa7a-d915613a792c None admin] PATH_INFO: `/v3/groups/1148bfe817374c51846d47219ccb9d37` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:26.370172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737e9ce-4e85-47c8-aa7a-d915613a792c None admin] RBAC: Authorizing `identity:get_group(group_id=1148bfe817374c51846d47219ccb9d37)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:26.371921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737e9ce-4e85-47c8-aa7a-d915613a792c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:26.374377 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 204/415] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 29 22:30:26 2022] GET /identity/v3/groups/1148bfe817374c51846d47219ccb9d37 => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:26.380434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dba631-dac0-4883-9d12-d9b77dedfea6 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:26.530739 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dba631-dac0-4883-9d12-d9b77dedfea6 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:26.568396 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737e9ce-4e85-47c8-aa7a-d915613a792c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:26.601841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e59b0b-6068-47db-8328-91916110a4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:26.602788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e59b0b-6068-47db-8328-91916110a4f5 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:26.607438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e59b0b-6068-47db-8328-91916110a4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:26.608260 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e59b0b-6068-47db-8328-91916110a4f5 None admin] PATH_INFO: `/v3/projects/acc9b26755b04e9387ec6536e491c79d` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:26.615064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e59b0b-6068-47db-8328-91916110a4f5 None admin] RBAC: Authorizing `identity:get_project(project_id=acc9b26755b04e9387ec6536e491c79d)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:26.615064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e59b0b-6068-47db-8328-91916110a4f5 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:26.617331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 212/416] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:26 2022] GET /identity/v3/projects/acc9b26755b04e9387ec6536e491c79d => generated 344 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:26.622736 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e59b0b-6068-47db-8328-91916110a4f5 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:26.644741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:26.784444 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737e9ce-4e85-47c8-aa7a-d915613a792c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:26.812059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:26.838576 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e59b0b-6068-47db-8328-91916110a4f5 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:26.856221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdeeab-ba9b-4538-92cc-f4e0c97b2613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:26.856862 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdeeab-ba9b-4538-92cc-f4e0c97b2613 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:26.857141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdeeab-ba9b-4538-92cc-f4e0c97b2613 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:26.857421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdeeab-ba9b-4538-92cc-f4e0c97b2613 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:26.882611 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdeeab-ba9b-4538-92cc-f4e0c97b2613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-ddfdeeab-ba9b-4538-92cc-f4e0c97b2613 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:26.887990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:26.889018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:26.890310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:26.890310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:26.890310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:26.890310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:26.890310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:26.890310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:26.890310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:26.890310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:26.890310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:26.890310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:26.890310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:26.890310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:26.890310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 205/417] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:30:26.897177 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdeeab-ba9b-4538-92cc-f4e0c97b2613 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:26.913217 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fa36f-a4b9-4a59-b921-242048d2de74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:26.913886 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fa36f-a4b9-4a59-b921-242048d2de74 None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:26.914168 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fa36f-a4b9-4a59-b921-242048d2de74 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:26.914446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fa36f-a4b9-4a59-b921-242048d2de74 None admin] PATH_INFO: `/v3/projects/acc9b26755b04e9387ec6536e491c79d/groups/1148bfe817374c51846d47219ccb9d37/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:26.916452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fa36f-a4b9-4a59-b921-242048d2de74 None admin] RBAC: Authorizing `identity:create_grant(project_id=acc9b26755b04e9387ec6536e491c79d, group_id=1148bfe817374c51846d47219ccb9d37, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:26.917954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fa36f-a4b9-4a59-b921-242048d2de74 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:27.010047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 213/418] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Aug 29 22:30:26 2022] PUT /identity/v3/projects/acc9b26755b04e9387ec6536e491c79d/groups/1148bfe817374c51846d47219ccb9d37/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:27.039812 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdeeab-ba9b-4538-92cc-f4e0c97b2613 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:27.093842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7e9b4-324c-48d9-acef-6a63021efed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:27.094651 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7e9b4-324c-48d9-acef-6a63021efed3 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:27.095146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7e9b4-324c-48d9-acef-6a63021efed3 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:27.095707 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7e9b4-324c-48d9-acef-6a63021efed3 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:27.096675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7e9b4-324c-48d9-acef-6a63021efed3 None admin] RBAC: Adding query filter params (name=member) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:27.097117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7e9b4-324c-48d9-acef-6a63021efed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:27.098734 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7e9b4-324c-48d9-acef-6a63021efed3 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:27.114359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 206/419] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:27.115832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fa36f-a4b9-4a59-b921-242048d2de74 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:27.118296 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5142c2-ef27-4b23-b631-ac116760db9f None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:27.118698 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5142c2-ef27-4b23-b631-ac116760db9f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:27.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5142c2-ef27-4b23-b631-ac116760db9f None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:27.124138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 207/420] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:27.128559 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c31ae6-9b3d-4248-b59e-5c384e2266c2 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:27.128837 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c31ae6-9b3d-4248-b59e-5c384e2266c2 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:27.129117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c31ae6-9b3d-4248-b59e-5c384e2266c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:27.165608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-56c31ae6-9b3d-4248-b59e-5c384e2266c2 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:27.166779 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-56c31ae6-9b3d-4248-b59e-5c384e2266c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:27.224791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:27.243495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:27.272440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 208/421] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:27.294295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fa36f-a4b9-4a59-b921-242048d2de74 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:27.334772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8229b13-3844-49b2-b7c1-f662f04ec1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:27.335529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8229b13-3844-49b2-b7c1-f662f04ec1ff None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:27.335820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8229b13-3844-49b2-b7c1-f662f04ec1ff None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:27.336113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8229b13-3844-49b2-b7c1-f662f04ec1ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:27.413672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8229b13-3844-49b2-b7c1-f662f04ec1ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:27.415165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8229b13-3844-49b2-b7c1-f662f04ec1ff None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:27.526708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:27.560425 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 214/422] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:27.569213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c31ae6-9b3d-4248-b59e-5c384e2266c2 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:27.677085 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8229b13-3844-49b2-b7c1-f662f04ec1ff None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:27.752314 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c31ae6-9b3d-4248-b59e-5c384e2266c2 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:27.809525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9043f0-494d-44a1-a61e-52cf8b1dfdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:27.809525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9043f0-494d-44a1-a61e-52cf8b1dfdd9 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:27.809525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9043f0-494d-44a1-a61e-52cf8b1dfdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:27.809525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9043f0-494d-44a1-a61e-52cf8b1dfdd9 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:27.813918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9043f0-494d-44a1-a61e-52cf8b1dfdd9 None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:27.813918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9043f0-494d-44a1-a61e-52cf8b1dfdd9 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:27.814357 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 209/423] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:27 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:27.833514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9043f0-494d-44a1-a61e-52cf8b1dfdd9 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:27.898188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:27.942050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8229b13-3844-49b2-b7c1-f662f04ec1ff None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:28.023800 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6febadb-d9b4-4f67-b738-34aaa19551fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:28.024583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6febadb-d9b4-4f67-b738-34aaa19551fd None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:28.024865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6febadb-d9b4-4f67-b738-34aaa19551fd None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:28.025140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6febadb-d9b4-4f67-b738-34aaa19551fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:28.042092 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9043f0-494d-44a1-a61e-52cf8b1dfdd9 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:28.049947 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6febadb-d9b4-4f67-b738-34aaa19551fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-a6febadb-d9b4-4f67-b738-34aaa19551fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:28.062875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:28.063859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:28.064738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:28.064738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:28.064738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:28.064738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:28.064738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:28.064738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:28.064738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:28.064738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:28.064738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:28.064738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:28.064738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:28.064738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:28.064738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 215/424] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:30:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:30:28.069765 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6febadb-d9b4-4f67-b738-34aaa19551fd None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:28.105204 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:28.108895 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c47c95-d807-420c-9881-6f0585bb181d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:28.109556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c47c95-d807-420c-9881-6f0585bb181d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:28.109834 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c47c95-d807-420c-9881-6f0585bb181d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:28.112125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c47c95-d807-420c-9881-6f0585bb181d None admin] PATH_INFO: `/v3/groups/24b292470f914e9ba61ff8d9eb65a176` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:28.115024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c47c95-d807-420c-9881-6f0585bb181d None admin] RBAC: Authorizing `identity:get_group(group_id=24b292470f914e9ba61ff8d9eb65a176)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:28.116543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c47c95-d807-420c-9881-6f0585bb181d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:28.118384 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 210/425] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 29 22:30:27 2022] GET /identity/v3/groups/24b292470f914e9ba61ff8d9eb65a176 => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:30:28.119574 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d94bf6-1155-4b3a-9b47-b8235bdccaae None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:28.119856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d94bf6-1155-4b3a-9b47-b8235bdccaae None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:28.127915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d94bf6-1155-4b3a-9b47-b8235bdccaae None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:28.127915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 211/426] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:28.129436 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d94bf6-1155-4b3a-9b47-b8235bdccaae None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:28.198295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6febadb-d9b4-4f67-b738-34aaa19551fd None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:28.238342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa6610-ee16-43d4-b98c-e89ecb64f001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:28.239054 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa6610-ee16-43d4-b98c-e89ecb64f001 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:28.239332 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa6610-ee16-43d4-b98c-e89ecb64f001 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:28.239674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:28.240737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa6610-ee16-43d4-b98c-e89ecb64f001 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:28.241362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa6610-ee16-43d4-b98c-e89ecb64f001 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:28.241667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa6610-ee16-43d4-b98c-e89ecb64f001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:28.243116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa6610-ee16-43d4-b98c-e89ecb64f001 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:28.243622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d94bf6-1155-4b3a-9b47-b8235bdccaae None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:28.256458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 216/427] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:28.257764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef91e7-b367-4535-9a4c-00a1eb151716 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:28.258049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef91e7-b367-4535-9a4c-00a1eb151716 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:28.258326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef91e7-b367-4535-9a4c-00a1eb151716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:28.277439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-f0ef91e7-b367-4535-9a4c-00a1eb151716 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:28.278732 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-f0ef91e7-b367-4535-9a4c-00a1eb151716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:28.278985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ef426-e46d-4657-aefa-b6d2ca425e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:28.280452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ef426-e46d-4657-aefa-b6d2ca425e1f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:28.280730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ef426-e46d-4657-aefa-b6d2ca425e1f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:28.281263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ef426-e46d-4657-aefa-b6d2ca425e1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:28.282231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ef426-e46d-4657-aefa-b6d2ca425e1f None admin] RBAC: Adding query filter params (group.id=24b292470f914e9ba61ff8d9eb65a176, role.id=7cca4e8860b3437e801ffbf8429da7dd, scope.project.id=71ed3cc8b5a141bda65164dab60ee555) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:28.282549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ef426-e46d-4657-aefa-b6d2ca425e1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:28.283993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ef426-e46d-4657-aefa-b6d2ca425e1f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:28.290499 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 212/428] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 29 22:30:28 2022] GET /identity/v3/role_assignments?group.id=24b292470f914e9ba61ff8d9eb65a176&scope.project.id=71ed3cc8b5a141bda65164dab60ee555&role.id=7cca4e8860b3437e801ffbf8429da7dd => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:28.291749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9d602-3820-4e7a-bb1e-19eb42462138 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:28.292139 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9d602-3820-4e7a-bb1e-19eb42462138 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:28.292417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9d602-3820-4e7a-bb1e-19eb42462138 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:28.296143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 213/429] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:28.296143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9d602-3820-4e7a-bb1e-19eb42462138 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:28.382322 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 217/430] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:28.383772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819ed56-3edb-47bd-8b02-cb920dccfeeb None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:28.384057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819ed56-3edb-47bd-8b02-cb920dccfeeb None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:28.384353 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819ed56-3edb-47bd-8b02-cb920dccfeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:28.423133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-f819ed56-3edb-47bd-8b02-cb920dccfeeb None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:28.428129 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-f819ed56-3edb-47bd-8b02-cb920dccfeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:28.464163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:28.488160 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9d602-3820-4e7a-bb1e-19eb42462138 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:28.539736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f3db5-6b89-4623-b99b-a927b11d5af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:28.540757 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f3db5-6b89-4623-b99b-a927b11d5af2 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:28.541248 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f3db5-6b89-4623-b99b-a927b11d5af2 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:28.541657 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f3db5-6b89-4623-b99b-a927b11d5af2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:28.553026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 218/431] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:28.579966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:28.636549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f3db5-6b89-4623-b99b-a927b11d5af2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:28.637916 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f3db5-6b89-4623-b99b-a927b11d5af2 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:28.702764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819ed56-3edb-47bd-8b02-cb920dccfeeb None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:28.775083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 214/432] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:28.788113 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f3db5-6b89-4623-b99b-a927b11d5af2 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:28.839731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819ed56-3edb-47bd-8b02-cb920dccfeeb None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:28.876127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:28.885265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900af91f-0739-425d-8461-302520cdd68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:28.885900 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900af91f-0739-425d-8461-302520cdd68f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:28.886178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900af91f-0739-425d-8461-302520cdd68f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:28.893935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900af91f-0739-425d-8461-302520cdd68f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:28.898408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900af91f-0739-425d-8461-302520cdd68f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-900af91f-0739-425d-8461-302520cdd68f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:28.903688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:28.905382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:28.906188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:28.906188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:28.906188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:28.906188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:28.906188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:28.906188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:28.906188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:28.906188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:28.906188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:28.906188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:28.906188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:28.906188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:28.906188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 219/433] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:30:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:28.907864 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900af91f-0739-425d-8461-302520cdd68f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:28.920176 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:28.930254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f3db5-6b89-4623-b99b-a927b11d5af2 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:28.973668 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92260e9-95b0-47aa-a621-96b3cdc90fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:28.974264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92260e9-95b0-47aa-a621-96b3cdc90fe3 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:28.974512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92260e9-95b0-47aa-a621-96b3cdc90fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:28.974791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92260e9-95b0-47aa-a621-96b3cdc90fe3 None admin] PATH_INFO: `/v3/projects/71ed3cc8b5a141bda65164dab60ee555` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:28.975977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92260e9-95b0-47aa-a621-96b3cdc90fe3 None admin] RBAC: Authorizing `identity:get_project(project_id=71ed3cc8b5a141bda65164dab60ee555)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:28.977681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92260e9-95b0-47aa-a621-96b3cdc90fe3 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:28.979732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 215/434] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:28 2022] GET /identity/v3/projects/71ed3cc8b5a141bda65164dab60ee555 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:28.981989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92260e9-95b0-47aa-a621-96b3cdc90fe3 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:29.055704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900af91f-0739-425d-8461-302520cdd68f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:29.100597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3cbca-d689-4d29-bd04-ae2f457bb189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:29.101726 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3cbca-d689-4d29-bd04-ae2f457bb189 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:29.102436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3cbca-d689-4d29-bd04-ae2f457bb189 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:29.102892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3cbca-d689-4d29-bd04-ae2f457bb189 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:29.105153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92260e9-95b0-47aa-a621-96b3cdc90fe3 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:29.115495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3cbca-d689-4d29-bd04-ae2f457bb189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-3cf3cbca-d689-4d29-bd04-ae2f457bb189 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:29.120244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:29.121137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:29.121966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:29.121966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:29.121966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:29.121966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:29.121966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:29.121966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:29.121966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:29.121966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:29.121966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:29.121966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:29.121966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:30:29.121966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:29.121966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 220/435] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:29.123930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3cbca-d689-4d29-bd04-ae2f457bb189 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:29.141505 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:29.146421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355b305-ae23-4cb9-ba86-2909bb65847f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:29.146962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355b305-ae23-4cb9-ba86-2909bb65847f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:29.147247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355b305-ae23-4cb9-ba86-2909bb65847f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:29.147510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355b305-ae23-4cb9-ba86-2909bb65847f None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:29.148227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355b305-ae23-4cb9-ba86-2909bb65847f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:29.148519 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355b305-ae23-4cb9-ba86-2909bb65847f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:29.149899 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355b305-ae23-4cb9-ba86-2909bb65847f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:29.159351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 216/436] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:29.168898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355b305-ae23-4cb9-ba86-2909bb65847f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:29.227104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:29.268027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3cbca-d689-4d29-bd04-ae2f457bb189 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:29.276135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355b305-ae23-4cb9-ba86-2909bb65847f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:29.310041 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745df7d-56f4-43f7-a1dd-dc726e1a0127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:29.311368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745df7d-56f4-43f7-a1dd-dc726e1a0127 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:29.311684 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745df7d-56f4-43f7-a1dd-dc726e1a0127 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:29.311970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745df7d-56f4-43f7-a1dd-dc726e1a0127 None admin] PATH_INFO: `/v3/groups/24b292470f914e9ba61ff8d9eb65a176` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:29.313201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745df7d-56f4-43f7-a1dd-dc726e1a0127 None admin] RBAC: Authorizing `identity:get_group(group_id=24b292470f914e9ba61ff8d9eb65a176)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:29.314644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745df7d-56f4-43f7-a1dd-dc726e1a0127 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:29.316584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 221/437] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 29 22:30:29 2022] GET /identity/v3/groups/24b292470f914e9ba61ff8d9eb65a176 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:29.316691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39acad-90a6-4b7b-a0b1-4412f8d62347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:29.317141 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745df7d-56f4-43f7-a1dd-dc726e1a0127 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:29.321947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39acad-90a6-4b7b-a0b1-4412f8d62347 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:29.322235 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39acad-90a6-4b7b-a0b1-4412f8d62347 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:29.322543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39acad-90a6-4b7b-a0b1-4412f8d62347 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:29.323231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39acad-90a6-4b7b-a0b1-4412f8d62347 None admin] RBAC: Adding query filter params (name=member) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:29.323545 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39acad-90a6-4b7b-a0b1-4412f8d62347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:29.324979 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39acad-90a6-4b7b-a0b1-4412f8d62347 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:29.334334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 217/438] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:30:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:29.335251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39acad-90a6-4b7b-a0b1-4412f8d62347 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:29.396654 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:29.430002 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745df7d-56f4-43f7-a1dd-dc726e1a0127 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:29.444808 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39acad-90a6-4b7b-a0b1-4412f8d62347 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:29.465287 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e1b4a-d8ef-4d35-a9f6-06f48d72e611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:29.465894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e1b4a-d8ef-4d35-a9f6-06f48d72e611 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:29.466178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e1b4a-d8ef-4d35-a9f6-06f48d72e611 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:29.466455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e1b4a-d8ef-4d35-a9f6-06f48d72e611 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:29.475141 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:29.481263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3332d2-0944-4541-9ec7-47bc54722398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:29.481871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3332d2-0944-4541-9ec7-47bc54722398 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:29.482147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3332d2-0944-4541-9ec7-47bc54722398 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:29.482414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3332d2-0944-4541-9ec7-47bc54722398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:29.483624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3332d2-0944-4541-9ec7-47bc54722398 None admin] RBAC: Adding query filter params (group.id=24b292470f914e9ba61ff8d9eb65a176, role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1, scope.project.id=71ed3cc8b5a141bda65164dab60ee555) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:29.483924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3332d2-0944-4541-9ec7-47bc54722398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:29.485381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3332d2-0944-4541-9ec7-47bc54722398 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:29.491293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 218/439] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 29 22:30:29 2022] GET /identity/v3/role_assignments?group.id=24b292470f914e9ba61ff8d9eb65a176&scope.project.id=71ed3cc8b5a141bda65164dab60ee555&role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:29.492470 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9975024-fa7b-4471-92e4-d5c601b7f014 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:29.492749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9975024-fa7b-4471-92e4-d5c601b7f014 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:29.493092 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9975024-fa7b-4471-92e4-d5c601b7f014 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:29.496352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 219/440] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:29.496352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9975024-fa7b-4471-92e4-d5c601b7f014 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:29.550127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e1b4a-d8ef-4d35-a9f6-06f48d72e611 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:29.551749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e1b4a-d8ef-4d35-a9f6-06f48d72e611 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:29.640681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9975024-fa7b-4471-92e4-d5c601b7f014 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:29.668988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:29.681209 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 222/441] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:29.682424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7c9ef-9a72-4d24-85d9-f98f4486c28f None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:29.685679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7c9ef-9a72-4d24-85d9-f98f4486c28f None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:29.685679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7c9ef-9a72-4d24-85d9-f98f4486c28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:29.691666 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9bdfe-c1ca-43a4-a1e1-00db763f0d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:29.692324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9bdfe-c1ca-43a4-a1e1-00db763f0d58 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:29.692609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9bdfe-c1ca-43a4-a1e1-00db763f0d58 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:29.692888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9bdfe-c1ca-43a4-a1e1-00db763f0d58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:29.703446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-e3a7c9ef-9a72-4d24-85d9-f98f4486c28f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:29.704689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e3a7c9ef-9a72-4d24-85d9-f98f4486c28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:29.751314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:29.789742 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9bdfe-c1ca-43a4-a1e1-00db763f0d58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:29.790044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9bdfe-c1ca-43a4-a1e1-00db763f0d58 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:29.796556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 223/442] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:29.796871 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7c9ef-9a72-4d24-85d9-f98f4486c28f None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:29.930882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7c9ef-9a72-4d24-85d9-f98f4486c28f None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:29.931211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 220/443] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:29.936993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9bdfe-c1ca-43a4-a1e1-00db763f0d58 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:29.961490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:29.978640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacd99f-6ea6-4e21-b676-dbd7f037384b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:29.989983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacd99f-6ea6-4e21-b676-dbd7f037384b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:29.989983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacd99f-6ea6-4e21-b676-dbd7f037384b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:29.989983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacd99f-6ea6-4e21-b676-dbd7f037384b None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:29.989983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacd99f-6ea6-4e21-b676-dbd7f037384b None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:29.989983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacd99f-6ea6-4e21-b676-dbd7f037384b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:29.989983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 224/444] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:29 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:29.990914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacd99f-6ea6-4e21-b676-dbd7f037384b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:30.032562 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:30.045936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9bdfe-c1ca-43a4-a1e1-00db763f0d58 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:30.084255 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aaccd3-0b0a-4ef2-9c3e-6805a4f29542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:30.084887 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaccd3-0b0a-4ef2-9c3e-6805a4f29542 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:30.085165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaccd3-0b0a-4ef2-9c3e-6805a4f29542 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:30.085437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaccd3-0b0a-4ef2-9c3e-6805a4f29542 None admin] PATH_INFO: `/v3/projects/95503c3913594436a874debf8bd8d080` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:30.086561 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aaccd3-0b0a-4ef2-9c3e-6805a4f29542 None admin] RBAC: Authorizing `identity:get_project(project_id=95503c3913594436a874debf8bd8d080)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:30.088104 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aaccd3-0b0a-4ef2-9c3e-6805a4f29542 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:30.091530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 221/445] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:29 2022] GET /identity/v3/projects/95503c3913594436a874debf8bd8d080 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:30.092391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aaccd3-0b0a-4ef2-9c3e-6805a4f29542 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:30.109342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacd99f-6ea6-4e21-b676-dbd7f037384b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:30.145042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d95986-efc9-4a74-9c42-87d515343ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:30.145674 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d95986-efc9-4a74-9c42-87d515343ae9 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:30.145950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d95986-efc9-4a74-9c42-87d515343ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:30.146217 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d95986-efc9-4a74-9c42-87d515343ae9 None admin] PATH_INFO: `/v3/groups/24b292470f914e9ba61ff8d9eb65a176` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:30.147339 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d95986-efc9-4a74-9c42-87d515343ae9 None admin] RBAC: Authorizing `identity:get_group(group_id=24b292470f914e9ba61ff8d9eb65a176)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:30.148860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d95986-efc9-4a74-9c42-87d515343ae9 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:30.150346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 225/446] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 29 22:30:29 2022] GET /identity/v3/groups/24b292470f914e9ba61ff8d9eb65a176 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:30.151103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d95986-efc9-4a74-9c42-87d515343ae9 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:30.192869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:30.206078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aaccd3-0b0a-4ef2-9c3e-6805a4f29542 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:30.243914 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e680a1a-4a36-4acd-938d-7e13213be766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:30.244579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e680a1a-4a36-4acd-938d-7e13213be766 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:30.244861 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e680a1a-4a36-4acd-938d-7e13213be766 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:30.245134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e680a1a-4a36-4acd-938d-7e13213be766 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:30.256374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e680a1a-4a36-4acd-938d-7e13213be766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:30.260545 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d95986-efc9-4a74-9c42-87d515343ae9 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-8e680a1a-4a36-4acd-938d-7e13213be766 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:30.261219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:30.262302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:30.263287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:30.263287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:30.263287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:30.263287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:30.263287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:30.263287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:30.263287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:30.263287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:30.263287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:30.263287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:30.263287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:30:30.263287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:30.263287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 222/447] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:30:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:30.263287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e680a1a-4a36-4acd-938d-7e13213be766 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:30.265619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:30.300322 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd074d-fce7-47dc-a054-2f6fd712ff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:30.300980 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd074d-fce7-47dc-a054-2f6fd712ff18 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:30.301463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd074d-fce7-47dc-a054-2f6fd712ff18 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:30.301898 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd074d-fce7-47dc-a054-2f6fd712ff18 None admin] PATH_INFO: `/v3/groups/24b292470f914e9ba61ff8d9eb65a176` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:30.303307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd074d-fce7-47dc-a054-2f6fd712ff18 None admin] RBAC: Authorizing `identity:get_group(group_id=24b292470f914e9ba61ff8d9eb65a176)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:30.304787 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd074d-fce7-47dc-a054-2f6fd712ff18 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:30.306352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 226/448] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 29 22:30:30 2022] GET /identity/v3/groups/24b292470f914e9ba61ff8d9eb65a176 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:30.307113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd074d-fce7-47dc-a054-2f6fd712ff18 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:30.369074 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e680a1a-4a36-4acd-938d-7e13213be766 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:30.406495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894319a-528c-465d-9d43-6604860f40db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:30.407112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894319a-528c-465d-9d43-6604860f40db None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:30.407411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894319a-528c-465d-9d43-6604860f40db None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:30.407685 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894319a-528c-465d-9d43-6604860f40db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:30.408630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894319a-528c-465d-9d43-6604860f40db None admin] RBAC: Adding query filter params (group.id=24b292470f914e9ba61ff8d9eb65a176, role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1, scope.project.id=95503c3913594436a874debf8bd8d080) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:30.408937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894319a-528c-465d-9d43-6604860f40db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:30.410424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894319a-528c-465d-9d43-6604860f40db None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:30.415973 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd074d-fce7-47dc-a054-2f6fd712ff18 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:30.417027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 223/449] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 29 22:30:30 2022] GET /identity/v3/role_assignments?group.id=24b292470f914e9ba61ff8d9eb65a176&scope.project.id=95503c3913594436a874debf8bd8d080&role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:30.417817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894319a-528c-465d-9d43-6604860f40db None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:30.447614 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:30.458647 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ede701-4716-4111-9360-649f5940df9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:30.459267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ede701-4716-4111-9360-649f5940df9d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:30.460568 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ede701-4716-4111-9360-649f5940df9d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:30.460568 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ede701-4716-4111-9360-649f5940df9d None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:30.460568 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ede701-4716-4111-9360-649f5940df9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:30.460858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ede701-4716-4111-9360-649f5940df9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:30.462281 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ede701-4716-4111-9360-649f5940df9d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:30.472179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 227/450] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:30.478677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ede701-4716-4111-9360-649f5940df9d None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:30.519219 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:30.555108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894319a-528c-465d-9d43-6604860f40db None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:30.603714 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d5ca5-84f4-46e1-b843-a8ea5e8c4fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:30.604368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d5ca5-84f4-46e1-b843-a8ea5e8c4fff None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:30.607439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ede701-4716-4111-9360-649f5940df9d None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:30.608137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d5ca5-84f4-46e1-b843-a8ea5e8c4fff None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:30.608137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d5ca5-84f4-46e1-b843-a8ea5e8c4fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:30.608137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d5ca5-84f4-46e1-b843-a8ea5e8c4fff None admin] RBAC: Adding query filter params (group.id=24b292470f914e9ba61ff8d9eb65a176, role.id=7cca4e8860b3437e801ffbf8429da7dd, scope.project.id=95503c3913594436a874debf8bd8d080) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:30.608137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d5ca5-84f4-46e1-b843-a8ea5e8c4fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:30.608399 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d5ca5-84f4-46e1-b843-a8ea5e8c4fff None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:30.619336 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 224/451] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 29 22:30:30 2022] GET /identity/v3/role_assignments?group.id=24b292470f914e9ba61ff8d9eb65a176&scope.project.id=95503c3913594436a874debf8bd8d080&role.id=7cca4e8860b3437e801ffbf8429da7dd => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:30.650044 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76364278-508e-4430-a768-ac43c31634d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:30.650664 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76364278-508e-4430-a768-ac43c31634d4 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:30.650941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76364278-508e-4430-a768-ac43c31634d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:30.651212 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76364278-508e-4430-a768-ac43c31634d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:30.730977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76364278-508e-4430-a768-ac43c31634d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:30.732350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76364278-508e-4430-a768-ac43c31634d4 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:30.768889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:30.846613 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 228/452] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 22:30:30.852760 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d5ca5-84f4-46e1-b843-a8ea5e8c4fff None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:30.945458 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:30.969632 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d5ca5-84f4-46e1-b843-a8ea5e8c4fff None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:31.009187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac71264-1db9-4431-988f-80d3775a785a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:31.009758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac71264-1db9-4431-988f-80d3775a785a None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:31.010039 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac71264-1db9-4431-988f-80d3775a785a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:31.010373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac71264-1db9-4431-988f-80d3775a785a None admin] PATH_INFO: `/v3/projects/acc9b26755b04e9387ec6536e491c79d` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:31.011453 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac71264-1db9-4431-988f-80d3775a785a None admin] RBAC: Authorizing `identity:get_project(project_id=acc9b26755b04e9387ec6536e491c79d)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:31.012969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac71264-1db9-4431-988f-80d3775a785a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:31.014740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 225/453] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:30:30 2022] GET /identity/v3/projects/acc9b26755b04e9387ec6536e491c79d => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:31.021754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76364278-508e-4430-a768-ac43c31634d4 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:31.130586 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76364278-508e-4430-a768-ac43c31634d4 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:31.167312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebc2a7-9818-411a-95d1-7cb63d7a39af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:31.167953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebc2a7-9818-411a-95d1-7cb63d7a39af None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:31.168262 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebc2a7-9818-411a-95d1-7cb63d7a39af None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:31.168532 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebc2a7-9818-411a-95d1-7cb63d7a39af None admin] PATH_INFO: `/v3/groups/1148bfe817374c51846d47219ccb9d37` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:31.169617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebc2a7-9818-411a-95d1-7cb63d7a39af None admin] RBAC: Authorizing `identity:get_group(group_id=1148bfe817374c51846d47219ccb9d37)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:31.171122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebc2a7-9818-411a-95d1-7cb63d7a39af None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:31.172825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 229/454] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 29 22:30:31 2022] GET /identity/v3/groups/1148bfe817374c51846d47219ccb9d37 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:30:31.178987 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac71264-1db9-4431-988f-80d3775a785a None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:31.287354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac71264-1db9-4431-988f-80d3775a785a None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:31.319867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33935ab-1a0d-4b1b-94b8-49609173e9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:31.320502 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33935ab-1a0d-4b1b-94b8-49609173e9c2 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:31.320777 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33935ab-1a0d-4b1b-94b8-49609173e9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:31.321094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33935ab-1a0d-4b1b-94b8-49609173e9c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:31.321765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33935ab-1a0d-4b1b-94b8-49609173e9c2 None admin] RBAC: Adding query filter params (group.id=1148bfe817374c51846d47219ccb9d37, role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=acc9b26755b04e9387ec6536e491c79d) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:31.322070 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33935ab-1a0d-4b1b-94b8-49609173e9c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:31.323488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33935ab-1a0d-4b1b-94b8-49609173e9c2 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:31.329630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 226/455] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 29 22:30:31 2022] GET /identity/v3/role_assignments?group.id=1148bfe817374c51846d47219ccb9d37&scope.project.id=acc9b26755b04e9387ec6536e491c79d&role.id=a7d59d2982de4bfeb758dce70808029f => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:33.728850 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e9b3f-6c0a-45f9-9707-1b25c78edfb4 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:33.729357 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e9b3f-6c0a-45f9-9707-1b25c78edfb4 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:33.729484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e9b3f-6c0a-45f9-9707-1b25c78edfb4 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:33.730898 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 230/456] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:33.744048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0dee1-7995-47e8-99f6-f132bbcc34be None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:33.744533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0dee1-7995-47e8-99f6-f132bbcc34be None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:33.747203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0dee1-7995-47e8-99f6-f132bbcc34be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:33.772476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-5bb0dee1-7995-47e8-99f6-f132bbcc34be None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:33.773998 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-5bb0dee1-7995-47e8-99f6-f132bbcc34be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:33.776317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:33.910739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 227/457] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:33.987457 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be531f8d-2fcf-4e57-a38c-be4c70bd6624 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:33.987970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be531f8d-2fcf-4e57-a38c-be4c70bd6624 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:33.988438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be531f8d-2fcf-4e57-a38c-be4c70bd6624 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:33.989927 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 231/458] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:33.995298 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4492009-223d-41e5-a4ed-441b302eb644 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:33.995827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4492009-223d-41e5-a4ed-441b302eb644 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:33.996326 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4492009-223d-41e5-a4ed-441b302eb644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:34.026120 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-b4492009-223d-41e5-a4ed-441b302eb644 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:34.027680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b4492009-223d-41e5-a4ed-441b302eb644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:34.162704 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 228/459] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:34.236425 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be531f8d-2fcf-4e57-a38c-be4c70bd6624 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:34.241352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:34.297718 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca0ca3-e629-4cf8-9fa4-00499fd5f713 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:34.298066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca0ca3-e629-4cf8-9fa4-00499fd5f713 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:34.298280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca0ca3-e629-4cf8-9fa4-00499fd5f713 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:34.299902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 229/460] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:34.308203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d65e2-7778-49ef-8af7-56258f0cfc24 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:34.308493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d65e2-7778-49ef-8af7-56258f0cfc24 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:34.308771 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d65e2-7778-49ef-8af7-56258f0cfc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:34.340364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-af3d65e2-7778-49ef-8af7-56258f0cfc24 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:34.341579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-af3d65e2-7778-49ef-8af7-56258f0cfc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:34.391463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be531f8d-2fcf-4e57-a38c-be4c70bd6624 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:34.469445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ac2d6-93c5-4e2c-9d96-ce4ea7343adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:34.469445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ac2d6-93c5-4e2c-9d96-ce4ea7343adf None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:34.469445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ac2d6-93c5-4e2c-9d96-ce4ea7343adf None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:34.469445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ac2d6-93c5-4e2c-9d96-ce4ea7343adf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:34.482420 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ac2d6-93c5-4e2c-9d96-ce4ea7343adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:34.483899 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ac2d6-93c5-4e2c-9d96-ce4ea7343adf None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:34.489500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:34.497721 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 230/461] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-4b1ac2d6-93c5-4e2c-9d96-ce4ea7343adf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:34.513296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:34.514882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:34.515746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:34.515746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:34.515746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:34.521446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e94f27-42c4-4d98-9693-90e818bfe5a1 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:34.521754 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e94f27-42c4-4d98-9693-90e818bfe5a1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:34.522008 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e94f27-42c4-4d98-9693-90e818bfe5a1 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:34.524620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 231/462] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:34.524991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 232/463] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:34.527993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e94f27-42c4-4d98-9693-90e818bfe5a1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:34.528931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50f961-9c69-4c87-9d09-9921ddc87c96 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:34.529285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50f961-9c69-4c87-9d09-9921ddc87c96 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:34.529592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50f961-9c69-4c87-9d09-9921ddc87c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:34.555157 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-1c50f961-9c69-4c87-9d09-9921ddc87c96 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:34.556787 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1c50f961-9c69-4c87-9d09-9921ddc87c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:34.637047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:34.662367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 233/464] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:34.662367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50f961-9c69-4c87-9d09-9921ddc87c96 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:34.664119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e94f27-42c4-4d98-9693-90e818bfe5a1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:34.746672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69164630-bd02-4b4e-8ad6-7b82440d5648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:34.747305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69164630-bd02-4b4e-8ad6-7b82440d5648 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:34.747486 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69164630-bd02-4b4e-8ad6-7b82440d5648 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:34.747964 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69164630-bd02-4b4e-8ad6-7b82440d5648 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:34.749307 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69164630-bd02-4b4e-8ad6-7b82440d5648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:34.749798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69164630-bd02-4b4e-8ad6-7b82440d5648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:34.751368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69164630-bd02-4b4e-8ad6-7b82440d5648 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:34.779803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 232/465] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:34.783819 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69164630-bd02-4b4e-8ad6-7b82440d5648 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:34.848577 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50f961-9c69-4c87-9d09-9921ddc87c96 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:34.856573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:34.891256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da306df-8fda-49aa-afc7-c1c6925d8894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:34.892177 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da306df-8fda-49aa-afc7-c1c6925d8894 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:34.892602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da306df-8fda-49aa-afc7-c1c6925d8894 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:34.893044 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da306df-8fda-49aa-afc7-c1c6925d8894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:34.903681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69164630-bd02-4b4e-8ad6-7b82440d5648 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:34.906912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da306df-8fda-49aa-afc7-c1c6925d8894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:34.908622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da306df-8fda-49aa-afc7-c1c6925d8894 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-6da306df-8fda-49aa-afc7-c1c6925d8894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:34.928431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:34.929432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:34.930461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:34.930461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:34.930461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:34.932627 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 234/466] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:34.933634 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da306df-8fda-49aa-afc7-c1c6925d8894 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:34.952328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c23a00-abf1-44fd-940d-91bb478beba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:34.952328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23a00-abf1-44fd-940d-91bb478beba3 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:34.952328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23a00-abf1-44fd-940d-91bb478beba3 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:34.952328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23a00-abf1-44fd-940d-91bb478beba3 None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:34.952774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c23a00-abf1-44fd-940d-91bb478beba3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:34.952774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c23a00-abf1-44fd-940d-91bb478beba3 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:34.976195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:35.047242 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da306df-8fda-49aa-afc7-c1c6925d8894 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:35.069237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 233/467] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:30:34 2022] POST /identity/v3/users => generated 246 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:30:35.070344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c23a00-abf1-44fd-940d-91bb478beba3 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:35.105361 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fc45f-1535-47af-a2ce-a7dd26179fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:35.106385 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fc45f-1535-47af-a2ce-a7dd26179fdc None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:35.107122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fc45f-1535-47af-a2ce-a7dd26179fdc None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:35.107696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fc45f-1535-47af-a2ce-a7dd26179fdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:35.121699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fc45f-1535-47af-a2ce-a7dd26179fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:35.123940 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fc45f-1535-47af-a2ce-a7dd26179fdc None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-513fc45f-1535-47af-a2ce-a7dd26179fdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:35.147309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:35.148505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:35.149350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:35.149350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:35.149350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:35.151185 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 235/468] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:35.152449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fc45f-1535-47af-a2ce-a7dd26179fdc None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:35.260692 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c23a00-abf1-44fd-940d-91bb478beba3 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:35.280603 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:35.288903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:35.308485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57183104-1cbe-4ce7-968f-dd7f205e54c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:35.309023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57183104-1cbe-4ce7-968f-dd7f205e54c3 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:35.309275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57183104-1cbe-4ce7-968f-dd7f205e54c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:35.309565 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57183104-1cbe-4ce7-968f-dd7f205e54c3 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:35.310197 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57183104-1cbe-4ce7-968f-dd7f205e54c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:35.311045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57183104-1cbe-4ce7-968f-dd7f205e54c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:35.311548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fc45f-1535-47af-a2ce-a7dd26179fdc None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:35.312467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57183104-1cbe-4ce7-968f-dd7f205e54c3 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:35.335036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 234/469] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:35.335278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57183104-1cbe-4ce7-968f-dd7f205e54c3 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:35.363102 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a2d09-9575-4bf1-ac67-64ea6688a218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:35.363754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a2d09-9575-4bf1-ac67-64ea6688a218 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:35.364042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a2d09-9575-4bf1-ac67-64ea6688a218 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:35.364352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a2d09-9575-4bf1-ac67-64ea6688a218 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:35.378101 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a2d09-9575-4bf1-ac67-64ea6688a218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:35.379592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a2d09-9575-4bf1-ac67-64ea6688a218 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-5b2a2d09-9575-4bf1-ac67-64ea6688a218 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:35.397753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:35.398728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:35.400020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:35.400020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:35.400020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:35.400020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 236/470] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:35.400418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a2d09-9575-4bf1-ac67-64ea6688a218 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:35.470985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57183104-1cbe-4ce7-968f-dd7f205e54c3 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:35.509534 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd60c60-1385-4701-ba04-1aeec3b24d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:35.510086 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd60c60-1385-4701-ba04-1aeec3b24d91 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:35.510375 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd60c60-1385-4701-ba04-1aeec3b24d91 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:35.510637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd60c60-1385-4701-ba04-1aeec3b24d91 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:35.511292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd60c60-1385-4701-ba04-1aeec3b24d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:35.511600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd60c60-1385-4701-ba04-1aeec3b24d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:35.513015 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd60c60-1385-4701-ba04-1aeec3b24d91 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:35.522324 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a2d09-9575-4bf1-ac67-64ea6688a218 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:35.529431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 235/471] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:35.529431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208a1be-5426-4ba3-954e-f10c9711341a None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:35.529431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208a1be-5426-4ba3-954e-f10c9711341a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:35.529431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208a1be-5426-4ba3-954e-f10c9711341a None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:35.529431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 236/472] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:35.529431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208a1be-5426-4ba3-954e-f10c9711341a None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:35.570817 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf78de-bd2b-4083-a998-2f690d8cdcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:35.571854 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf78de-bd2b-4083-a998-2f690d8cdcb8 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:35.572418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf78de-bd2b-4083-a998-2f690d8cdcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:35.572892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf78de-bd2b-4083-a998-2f690d8cdcb8 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:35.573616 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf78de-bd2b-4083-a998-2f690d8cdcb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:35.575065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf78de-bd2b-4083-a998-2f690d8cdcb8 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:35.576801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:35.588650 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:35.649265 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208a1be-5426-4ba3-954e-f10c9711341a None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:35.691320 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 237/473] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:30:35 2022] POST /identity/v3/users => generated 248 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:30:35.691553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649082b-36d5-46cb-869c-0f648f755726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:35.691659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf78de-bd2b-4083-a998-2f690d8cdcb8 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:35.691731 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649082b-36d5-46cb-869c-0f648f755726 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:35.691731 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649082b-36d5-46cb-869c-0f648f755726 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:35.691731 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649082b-36d5-46cb-869c-0f648f755726 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:35.691731 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649082b-36d5-46cb-869c-0f648f755726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:35.691731 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649082b-36d5-46cb-869c-0f648f755726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:35.691731 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649082b-36d5-46cb-869c-0f648f755726 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:35.712593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 237/474] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:35.715637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfebb6-0dc3-4d18-b2b9-ac260efa45bb None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:35.715926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfebb6-0dc3-4d18-b2b9-ac260efa45bb None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:35.716229 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfebb6-0dc3-4d18-b2b9-ac260efa45bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:35.742711 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-4cdfebb6-0dc3-4d18-b2b9-ac260efa45bb None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:35.745160 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4cdfebb6-0dc3-4d18-b2b9-ac260efa45bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:35.831995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf78de-bd2b-4083-a998-2f690d8cdcb8 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:35.852683 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 238/475] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:35.853527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfebb6-0dc3-4d18-b2b9-ac260efa45bb None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:35.889696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:35.889883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e964a26-6d14-4c31-bf52-83663a24ca32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:35.891154 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e964a26-6d14-4c31-bf52-83663a24ca32 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:35.891444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e964a26-6d14-4c31-bf52-83663a24ca32 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:35.891753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e964a26-6d14-4c31-bf52-83663a24ca32 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:35.892533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e964a26-6d14-4c31-bf52-83663a24ca32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:35.894178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e964a26-6d14-4c31-bf52-83663a24ca32 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:36.017358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfebb6-0dc3-4d18-b2b9-ac260efa45bb None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:36.022509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 238/476] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:30:35 2022] POST /identity/v3/users => generated 248 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:30:36.064788 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b46058-03d4-41de-af35-aca34817711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:36.065425 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b46058-03d4-41de-af35-aca34817711e None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:36.065736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b46058-03d4-41de-af35-aca34817711e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:36.066180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b46058-03d4-41de-af35-aca34817711e None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:36.067074 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b46058-03d4-41de-af35-aca34817711e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:36.068986 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b46058-03d4-41de-af35-aca34817711e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:36.187554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 239/477] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:30:35 2022] POST /identity/v3/users => generated 249 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:30:36.196713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e964a26-6d14-4c31-bf52-83663a24ca32 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:36.271436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:36.334830 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e964a26-6d14-4c31-bf52-83663a24ca32 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:36.377953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18515658-125f-431b-9c46-defab5fb2681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:36.378954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18515658-125f-431b-9c46-defab5fb2681 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:36.379451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18515658-125f-431b-9c46-defab5fb2681 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:36.379913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18515658-125f-431b-9c46-defab5fb2681 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:36.380818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18515658-125f-431b-9c46-defab5fb2681 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:36.382425 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18515658-125f-431b-9c46-defab5fb2681 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:36.422987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.sql.core [None req-18515658-125f-431b-9c46-defab5fb2681 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 22:30:36.422987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 22:30:36.422987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [parameters: {'id': '615eab09b5524cb9ac9a5745c687bf47', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 22:30:36.422987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82236) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 22:30:36.445392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-18515658-125f-431b-9c46-defab5fb2681 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 22:30:36.445392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:36.445392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:30:36.445392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:30:36.445392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:30:36.445392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:30:36.445392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:30:36.445392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:30:36.445392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:30:36.445392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:30:36.445392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:30:36.445392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:30:36.445392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:30:36.445392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application result.read() Aug 29 22:30:36.445392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:30:36.446312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application yield resource Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise self.value Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application session.commit() Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 22:30:36.447252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self.session.flush() Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application compat.raise_( Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 22:30:36.448159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:30:36.449069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application result.read() Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:30:36.450029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [parameters: {'id': '615eab09b5524cb9ac9a5745c687bf47', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:36.450905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 22:30:36.453705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:36.457810 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 239/478] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Aug 29 22:30:36 2022] POST /identity/v3/roles => generated 144 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:36.466276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b46058-03d4-41de-af35-aca34817711e None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:36.568954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:36.590266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b46058-03d4-41de-af35-aca34817711e None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:36.628624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49056d6b-47b4-4249-a7a8-c5843a099e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:36.629270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056d6b-47b4-4249-a7a8-c5843a099e9c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:36.629564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056d6b-47b4-4249-a7a8-c5843a099e9c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:36.629830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056d6b-47b4-4249-a7a8-c5843a099e9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:36.640667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49056d6b-47b4-4249-a7a8-c5843a099e9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-49056d6b-47b4-4249-a7a8-c5843a099e9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:36.645547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:36.646439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:36.647234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:36.647234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:36.647234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:36.647234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:36.647234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:36.647234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:36.647234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:36.647234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:36.647234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:36.647234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:36.647234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:30:36.647234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:36.647234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 240/479] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:30:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:36.652563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18515658-125f-431b-9c46-defab5fb2681 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:36.870147 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18515658-125f-431b-9c46-defab5fb2681 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:36.897447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:36.958408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783a559-9484-42ce-b150-fdab8b03ecc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:36.959028 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783a559-9484-42ce-b150-fdab8b03ecc5 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:36.959313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783a559-9484-42ce-b150-fdab8b03ecc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:36.959591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783a559-9484-42ce-b150-fdab8b03ecc5 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:36.960313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783a559-9484-42ce-b150-fdab8b03ecc5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:36.960641 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783a559-9484-42ce-b150-fdab8b03ecc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:36.962467 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783a559-9484-42ce-b150-fdab8b03ecc5 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:36.988932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 240/480] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:37.492599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084f083-3a8b-423e-a4d1-12d283a2f049 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:37.493071 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084f083-3a8b-423e-a4d1-12d283a2f049 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:37.493071 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084f083-3a8b-423e-a4d1-12d283a2f049 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:37.495282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 241/481] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:37.502210 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf508c94-63eb-41b6-894d-2a5ecd6a5b1c None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:37.502502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf508c94-63eb-41b6-894d-2a5ecd6a5b1c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:37.502784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf508c94-63eb-41b6-894d-2a5ecd6a5b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:37.534654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-bf508c94-63eb-41b6-894d-2a5ecd6a5b1c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:37.535892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-bf508c94-63eb-41b6-894d-2a5ecd6a5b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:37.690365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 241/482] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:38.147651 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084f083-3a8b-423e-a4d1-12d283a2f049 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:38.421798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb9078-070d-434e-ba5c-3618d505e96e None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:38.422307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb9078-070d-434e-ba5c-3618d505e96e None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:38.422307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb9078-070d-434e-ba5c-3618d505e96e None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:38.423955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 242/483] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:38.430214 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26fd73-a3b5-4f36-95cf-09c4909a2980 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:38.430512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26fd73-a3b5-4f36-95cf-09c4909a2980 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:38.430761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26fd73-a3b5-4f36-95cf-09c4909a2980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:38.437041 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084f083-3a8b-423e-a4d1-12d283a2f049 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:38.455167 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-ac26fd73-a3b5-4f36-95cf-09c4909a2980 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:38.456517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ac26fd73-a3b5-4f36-95cf-09c4909a2980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:38.569801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 243/484] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:30:38.621239 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d6003-9105-4abb-bd8d-d5c779c7b25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:38.622410 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d6003-9105-4abb-bd8d-d5c779c7b25a None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:38.623568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d6003-9105-4abb-bd8d-d5c779c7b25a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:38.623962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d6003-9105-4abb-bd8d-d5c779c7b25a None admin] PATH_INFO: `/v3/roles/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:38.662242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:38.673709 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d6003-9105-4abb-bd8d-d5c779c7b25a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-cd5d6003-9105-4abb-bd8d-d5c779c7b25a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:38.688123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:38.689426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:38.690881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:38.690881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:38.690881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:38.690881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:38.690881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:38.690881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:38.690881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:38.690881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:38.690881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:38.690881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:38.690881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:38.690881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:38.690881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 242/485] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 542 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:38.702141 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26fd73-a3b5-4f36-95cf-09c4909a2980 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:38.818320 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:38.836871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac4d97-8f77-4894-baed-7abbd87061d5 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:38.837174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac4d97-8f77-4894-baed-7abbd87061d5 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:38.837558 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac4d97-8f77-4894-baed-7abbd87061d5 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:38.839346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 243/486] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:38.846942 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d0b1a-f163-43d6-9292-ec580be95881 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:38.847276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d0b1a-f163-43d6-9292-ec580be95881 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:38.850207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d0b1a-f163-43d6-9292-ec580be95881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:38.902733 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-526d0b1a-f163-43d6-9292-ec580be95881 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:38.903939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-526d0b1a-f163-43d6-9292-ec580be95881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:38.954974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26fd73-a3b5-4f36-95cf-09c4909a2980 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:39.002740 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b03d6b-7d55-428d-b396-d24e0b0036c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:39.003374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b03d6b-7d55-428d-b396-d24e0b0036c2 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:39.003650 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b03d6b-7d55-428d-b396-d24e0b0036c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:39.003929 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b03d6b-7d55-428d-b396-d24e0b0036c2 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:39.004658 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b03d6b-7d55-428d-b396-d24e0b0036c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:39.004957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b03d6b-7d55-428d-b396-d24e0b0036c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:39.006709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b03d6b-7d55-428d-b396-d24e0b0036c2 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:39.016745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 244/487] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:30:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:39.022970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4960eaa-932e-4357-ba55-c224b7468d62 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:39.023297 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4960eaa-932e-4357-ba55-c224b7468d62 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:39.023508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4960eaa-932e-4357-ba55-c224b7468d62 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:39.025137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 245/488] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:39.026001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4960eaa-932e-4357-ba55-c224b7468d62 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:39.057198 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 244/489] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:39.067916 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d0b1a-f163-43d6-9292-ec580be95881 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:39.217395 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:39.221648 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4960eaa-932e-4357-ba55-c224b7468d62 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:39.269781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e06f7-467e-483f-b818-c1ffefddd390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:39.270827 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e06f7-467e-483f-b818-c1ffefddd390 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:39.271318 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e06f7-467e-483f-b818-c1ffefddd390 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:39.271815 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e06f7-467e-483f-b818-c1ffefddd390 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:39.287162 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e06f7-467e-483f-b818-c1ffefddd390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-0c2e06f7-467e-483f-b818-c1ffefddd390 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:39.295649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:39.296730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:39.297553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:39.297553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:39.297553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:39.297553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:39.297553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:39.297553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:39.297553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:39.297553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:39.297553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:39.297553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:39.297553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:39.297553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:39.298167 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d0b1a-f163-43d6-9292-ec580be95881 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:39.300687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 246/490] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:39.302205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a1440-58a0-4cdf-89b4-547ac07dcdb0 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:39.302704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a1440-58a0-4cdf-89b4-547ac07dcdb0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:39.303273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a1440-58a0-4cdf-89b4-547ac07dcdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:39.327691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-485a1440-58a0-4cdf-89b4-547ac07dcdb0 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:39.329331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-485a1440-58a0-4cdf-89b4-547ac07dcdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:39.368917 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:39.393237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6f669-bfc3-49c2-a3dd-09a45c28c41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:39.394281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6f669-bfc3-49c2-a3dd-09a45c28c41a None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:39.395147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6f669-bfc3-49c2-a3dd-09a45c28c41a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:39.396983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6f669-bfc3-49c2-a3dd-09a45c28c41a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:39.424686 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 247/491] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:39.426447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a1440-58a0-4cdf-89b4-547ac07dcdb0 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:39.453171 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6f669-bfc3-49c2-a3dd-09a45c28c41a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:39.455148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6f669-bfc3-49c2-a3dd-09a45c28c41a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-97a6f669-bfc3-49c2-a3dd-09a45c28c41a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:39.502859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:39.503805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:39.504700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:39.504700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:39.504700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:39.504700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 245/492] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:39.510007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6f669-bfc3-49c2-a3dd-09a45c28c41a None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:39.571679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:39.590635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a1440-58a0-4cdf-89b4-547ac07dcdb0 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:39.644239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357f345-f936-4c2c-a7bf-e18f9d01b4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:39.645351 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357f345-f936-4c2c-a7bf-e18f9d01b4c3 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:39.645846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357f345-f936-4c2c-a7bf-e18f9d01b4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:39.646330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357f345-f936-4c2c-a7bf-e18f9d01b4c3 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:39.647250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357f345-f936-4c2c-a7bf-e18f9d01b4c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:39.647769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357f345-f936-4c2c-a7bf-e18f9d01b4c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:39.649586 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357f345-f936-4c2c-a7bf-e18f9d01b4c3 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:39.661001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 248/493] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:30:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:39.662269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357f345-f936-4c2c-a7bf-e18f9d01b4c3 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:39.772026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6f669-bfc3-49c2-a3dd-09a45c28c41a None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:39.807353 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357f345-f936-4c2c-a7bf-e18f9d01b4c3 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:39.837357 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9f276-b6d4-4e0c-b5f2-9b8556260aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:39.838293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9f276-b6d4-4e0c-b5f2-9b8556260aa9 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:39.838752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9f276-b6d4-4e0c-b5f2-9b8556260aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:39.839027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9f276-b6d4-4e0c-b5f2-9b8556260aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:39.839700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9f276-b6d4-4e0c-b5f2-9b8556260aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:39.840055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9f276-b6d4-4e0c-b5f2-9b8556260aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:39.842011 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9f276-b6d4-4e0c-b5f2-9b8556260aa9 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:39.854001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4b4f4-d536-4322-96fd-14c3a5ef60e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:39.854660 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4b4f4-d536-4322-96fd-14c3a5ef60e9 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:39.854942 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4b4f4-d536-4322-96fd-14c3a5ef60e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:39.855218 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4b4f4-d536-4322-96fd-14c3a5ef60e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:39.859461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 246/494] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:39.860556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9f276-b6d4-4e0c-b5f2-9b8556260aa9 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:39.868539 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4b4f4-d536-4322-96fd-14c3a5ef60e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-1ed4b4f4-d536-4322-96fd-14c3a5ef60e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:39.873884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:39.874894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:39.875846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:39.875846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:39.875846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:39.875846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:39.875846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:39.875846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:39.875846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:39.875846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:39.875846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:39.875846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:39.875846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:39.875846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:39.875846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 249/495] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:39.878970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4b4f4-d536-4322-96fd-14c3a5ef60e9 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:39.898604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:39.931434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:40.022700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9f276-b6d4-4e0c-b5f2-9b8556260aa9 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:40.023605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4b4f4-d536-4322-96fd-14c3a5ef60e9 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:40.066825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edbe48-970b-40fc-891b-7cdf89f29b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:40.067459 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edbe48-970b-40fc-891b-7cdf89f29b0e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:40.067737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edbe48-970b-40fc-891b-7cdf89f29b0e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:40.068008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edbe48-970b-40fc-891b-7cdf89f29b0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:40.078773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040d296-4cb0-4c7e-aa3f-b46570eb962d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:40.079787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040d296-4cb0-4c7e-aa3f-b46570eb962d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:40.080013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edbe48-970b-40fc-891b-7cdf89f29b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:40.080305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040d296-4cb0-4c7e-aa3f-b46570eb962d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:40.080761 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040d296-4cb0-4c7e-aa3f-b46570eb962d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-79edbe48-970b-40fc-891b-7cdf89f29b0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:40.085368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:40.086418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:40.087437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:40.087437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:40.087437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:40.087437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:40.087437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:40.087437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:40.087437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:40.087437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:40.087437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:40.087437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:40.087437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:40.087437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:40.087437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 250/496] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:40.087437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edbe48-970b-40fc-891b-7cdf89f29b0e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:40.101422 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040d296-4cb0-4c7e-aa3f-b46570eb962d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:40.102935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040d296-4cb0-4c7e-aa3f-b46570eb962d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-3040d296-4cb0-4c7e-aa3f-b46570eb962d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:40.119456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:40.120555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:40.127435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:40.127435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:40.127435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:40.127435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 247/497] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:40.127435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040d296-4cb0-4c7e-aa3f-b46570eb962d None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:40.186790 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:40.218767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edbe48-970b-40fc-891b-7cdf89f29b0e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:40.235037 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:40.242582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040d296-4cb0-4c7e-aa3f-b46570eb962d None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:40.258649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea53b3-3bfb-437e-b61d-c0e618ae22cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:40.259766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea53b3-3bfb-437e-b61d-c0e618ae22cb None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:40.260333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea53b3-3bfb-437e-b61d-c0e618ae22cb None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:40.260869 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea53b3-3bfb-437e-b61d-c0e618ae22cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:40.275475 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea53b3-3bfb-437e-b61d-c0e618ae22cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:40.278242 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea53b3-3bfb-437e-b61d-c0e618ae22cb None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:40.286698 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2265ad3-91ec-41cc-b04c-ac48193f845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:40.287422 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2265ad3-91ec-41cc-b04c-ac48193f845d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:40.287701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2265ad3-91ec-41cc-b04c-ac48193f845d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:40.287975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2265ad3-91ec-41cc-b04c-ac48193f845d None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:40.288699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2265ad3-91ec-41cc-b04c-ac48193f845d None admin] RBAC: Adding query filter params (name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:40.289000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2265ad3-91ec-41cc-b04c-ac48193f845d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:40.290402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2265ad3-91ec-41cc-b04c-ac48193f845d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-7eea53b3-3bfb-437e-b61d-c0e618ae22cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:30:40.295272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:40.296312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:40.297221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:40.297221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:40.297221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:30:40.297221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:30:40.297221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:30:40.297221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:30:40.297221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:30:40.297221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:30:40.297221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:30:40.297221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:40.297221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 251/498] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 29 22:30:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:40.297786 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8c715-5e43-4a31-8ecb-631d1e89face None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:40.298216 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8c715-5e43-4a31-8ecb-631d1e89face None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:40.298310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8c715-5e43-4a31-8ecb-631d1e89face None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:40.300168 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 252/499] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:40.300876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8c715-5e43-4a31-8ecb-631d1e89face None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:40.314742 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 248/500] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:30:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:40.314742 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2265ad3-91ec-41cc-b04c-ac48193f845d None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:40.438140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8c715-5e43-4a31-8ecb-631d1e89face None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:40.473458 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2265ad3-91ec-41cc-b04c-ac48193f845d None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:40.480651 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:40.489099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b7dc5-1abe-4eb8-92aa-c1d99331bb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:40.490114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b7dc5-1abe-4eb8-92aa-c1d99331bb6c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:40.493570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b7dc5-1abe-4eb8-92aa-c1d99331bb6c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:40.493570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b7dc5-1abe-4eb8-92aa-c1d99331bb6c None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:40.493570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b7dc5-1abe-4eb8-92aa-c1d99331bb6c None admin] RBAC: Adding query filter params (name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:40.493570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b7dc5-1abe-4eb8-92aa-c1d99331bb6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:40.495348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b7dc5-1abe-4eb8-92aa-c1d99331bb6c None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:40.509160 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 253/501] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:30:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:40.510111 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b7dc5-1abe-4eb8-92aa-c1d99331bb6c None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:40.514616 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf005df-047c-4238-b7b0-75bd2821e432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:40.515947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf005df-047c-4238-b7b0-75bd2821e432 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:40.516886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf005df-047c-4238-b7b0-75bd2821e432 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:40.516886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf005df-047c-4238-b7b0-75bd2821e432 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:40.520842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf005df-047c-4238-b7b0-75bd2821e432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:40.520842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf005df-047c-4238-b7b0-75bd2821e432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:40.520842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf005df-047c-4238-b7b0-75bd2821e432 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:40.534517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 249/502] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:40.535829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34d01-b801-4c71-9548-26081283fc16 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:40.536206 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34d01-b801-4c71-9548-26081283fc16 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:40.536483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34d01-b801-4c71-9548-26081283fc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:40.557452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-deb34d01-b801-4c71-9548-26081283fc16 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:40.558661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-deb34d01-b801-4c71-9548-26081283fc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:40.571936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:40.646996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 250/503] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:40.647890 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb34d01-b801-4c71-9548-26081283fc16 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:40.709273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b7dc5-1abe-4eb8-92aa-c1d99331bb6c None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:40.766052 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fcc30-d129-4fbc-98c6-c48b0ae204b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:40.767123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fcc30-d129-4fbc-98c6-c48b0ae204b2 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:40.767697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fcc30-d129-4fbc-98c6-c48b0ae204b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:40.768231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fcc30-d129-4fbc-98c6-c48b0ae204b2 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:40.769631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81fcc30-d129-4fbc-98c6-c48b0ae204b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:40.770203 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81fcc30-d129-4fbc-98c6-c48b0ae204b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:40.773000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81fcc30-d129-4fbc-98c6-c48b0ae204b2 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:40.816342 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb34d01-b801-4c71-9548-26081283fc16 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:40.856321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 254/504] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 29 22:30:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:40.858567 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fcc30-d129-4fbc-98c6-c48b0ae204b2 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:40.865144 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21478873-45db-46c3-9200-83ac4bfa38bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:40.866392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21478873-45db-46c3-9200-83ac4bfa38bb None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:40.866822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21478873-45db-46c3-9200-83ac4bfa38bb None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:40.867242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21478873-45db-46c3-9200-83ac4bfa38bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:40.884385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21478873-45db-46c3-9200-83ac4bfa38bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:40.886131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21478873-45db-46c3-9200-83ac4bfa38bb None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:40.895355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-21478873-45db-46c3-9200-83ac4bfa38bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:40.903992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:40.912348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:40.913219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:40.913219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:40.913219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:40.913219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 251/505] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:40.913219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21478873-45db-46c3-9200-83ac4bfa38bb None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:40.939529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:41.007862 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fcc30-d129-4fbc-98c6-c48b0ae204b2 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:41.036426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21478873-45db-46c3-9200-83ac4bfa38bb None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:41.050228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f3a46-e9c5-45c7-b791-d964f829df40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:41.051748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f3a46-e9c5-45c7-b791-d964f829df40 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:41.051748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f3a46-e9c5-45c7-b791-d964f829df40 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:41.051934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f3a46-e9c5-45c7-b791-d964f829df40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:41.063463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f3a46-e9c5-45c7-b791-d964f829df40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:41.065357 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f3a46-e9c5-45c7-b791-d964f829df40 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:41.078729 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61887118-dfe0-42b7-a553-d3bbee0bd6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:41.079395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61887118-dfe0-42b7-a553-d3bbee0bd6f5 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:41.079745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61887118-dfe0-42b7-a553-d3bbee0bd6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:41.080269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61887118-dfe0-42b7-a553-d3bbee0bd6f5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-1b1f3a46-e9c5-45c7-b791-d964f829df40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:41.084386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:41.085466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:41.086621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:41.086621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:41.086621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:41.092362 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61887118-dfe0-42b7-a553-d3bbee0bd6f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:41.092533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 255/506] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:41.092533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f3a46-e9c5-45c7-b791-d964f829df40 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:41.093291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61887118-dfe0-42b7-a553-d3bbee0bd6f5 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-61887118-dfe0-42b7-a553-d3bbee0bd6f5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:30:41.110438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:41.111397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:41.112401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:41.112401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:41.112401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:30:41.112401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:30:41.112401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:30:41.112401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:30:41.112401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:30:41.112401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:30:41.112401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:30:41.112401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:41.114569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 252/507] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:41.115776 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61887118-dfe0-42b7-a553-d3bbee0bd6f5 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:41.203347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:41.239006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f3a46-e9c5-45c7-b791-d964f829df40 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:41.242135 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:41.249639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61887118-dfe0-42b7-a553-d3bbee0bd6f5 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:41.277499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66e5b6-2b89-4cbd-9f12-b213d5e00cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:41.278142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66e5b6-2b89-4cbd-9f12-b213d5e00cde None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:41.278886 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66e5b6-2b89-4cbd-9f12-b213d5e00cde None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:41.279391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66e5b6-2b89-4cbd-9f12-b213d5e00cde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:41.291826 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349b957-e822-4b79-83a7-62c36d06db0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:41.292562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349b957-e822-4b79-83a7-62c36d06db0c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:41.292910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349b957-e822-4b79-83a7-62c36d06db0c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:41.293114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349b957-e822-4b79-83a7-62c36d06db0c None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:41.293777 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349b957-e822-4b79-83a7-62c36d06db0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:41.294085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349b957-e822-4b79-83a7-62c36d06db0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:41.295932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349b957-e822-4b79-83a7-62c36d06db0c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:41.309440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 253/508] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:41.311073 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349b957-e822-4b79-83a7-62c36d06db0c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:41.373503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66e5b6-2b89-4cbd-9f12-b213d5e00cde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:41.374962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66e5b6-2b89-4cbd-9f12-b213d5e00cde None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:41.449524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349b957-e822-4b79-83a7-62c36d06db0c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:41.479826 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:41.504724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d51e2-c917-4e31-9a48-45f90367d61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:41.505474 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d51e2-c917-4e31-9a48-45f90367d61d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:41.505898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d51e2-c917-4e31-9a48-45f90367d61d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:41.506248 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d51e2-c917-4e31-9a48-45f90367d61d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:41.517586 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 256/509] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:41.518550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66e5b6-2b89-4cbd-9f12-b213d5e00cde None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:41.519516 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d51e2-c917-4e31-9a48-45f90367d61d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:41.521279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d51e2-c917-4e31-9a48-45f90367d61d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:41.525623 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-321d51e2-c917-4e31-9a48-45f90367d61d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:41.545582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:41.546566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:41.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:41.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:41.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:41.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 254/510] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:41.548697 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d51e2-c917-4e31-9a48-45f90367d61d None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:41.650045 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66e5b6-2b89-4cbd-9f12-b213d5e00cde None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:41.694461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d51e2-c917-4e31-9a48-45f90367d61d None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:41.696443 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d67dab-50f8-43b3-b0b7-bdfe69900c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:41.698118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d67dab-50f8-43b3-b0b7-bdfe69900c30 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:41.698405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d67dab-50f8-43b3-b0b7-bdfe69900c30 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:41.698690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d67dab-50f8-43b3-b0b7-bdfe69900c30 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:41.699381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d67dab-50f8-43b3-b0b7-bdfe69900c30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:41.699667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d67dab-50f8-43b3-b0b7-bdfe69900c30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:41.701800 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d67dab-50f8-43b3-b0b7-bdfe69900c30 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:41.723621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 257/511] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:41.724881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d67dab-50f8-43b3-b0b7-bdfe69900c30 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:41.743361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592f238-e2a6-44c5-bb9c-bbec43e9afb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:41.743988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592f238-e2a6-44c5-bb9c-bbec43e9afb4 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:41.744360 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592f238-e2a6-44c5-bb9c-bbec43e9afb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:41.745119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592f238-e2a6-44c5-bb9c-bbec43e9afb4 None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:41.745874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592f238-e2a6-44c5-bb9c-bbec43e9afb4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:41.746188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592f238-e2a6-44c5-bb9c-bbec43e9afb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:41.747699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592f238-e2a6-44c5-bb9c-bbec43e9afb4 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:41.789967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 255/512] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Aug 29 22:30:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:41.790726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592f238-e2a6-44c5-bb9c-bbec43e9afb4 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:41.810043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:41.825408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:41.863940 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d67dab-50f8-43b3-b0b7-bdfe69900c30 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:41.911864 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e2f9e-03ee-4bc7-bfe3-647323c90d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:41.912494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e2f9e-03ee-4bc7-bfe3-647323c90d2e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:41.912777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e2f9e-03ee-4bc7-bfe3-647323c90d2e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:41.913055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e2f9e-03ee-4bc7-bfe3-647323c90d2e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:41.920985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592f238-e2a6-44c5-bb9c-bbec43e9afb4 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:41.922011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e2f9e-03ee-4bc7-bfe3-647323c90d2e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:41.923503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e2f9e-03ee-4bc7-bfe3-647323c90d2e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-944e2f9e-03ee-4bc7-bfe3-647323c90d2e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:30:41.937955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:41.938925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:41.940792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:41.940792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:41.940792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:30:41.940792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:30:41.940792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:30:41.940792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:30:41.940792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:30:41.940792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:30:41.940792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:30:41.940792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:41.940792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 258/513] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:41.940792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e2f9e-03ee-4bc7-bfe3-647323c90d2e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:41.973729 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62ed00-da43-48c1-bf4a-e47d99dbf85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:41.973729 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62ed00-da43-48c1-bf4a-e47d99dbf85b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:41.973729 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62ed00-da43-48c1-bf4a-e47d99dbf85b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:41.973729 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62ed00-da43-48c1-bf4a-e47d99dbf85b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:41.983222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62ed00-da43-48c1-bf4a-e47d99dbf85b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:41.984858 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62ed00-da43-48c1-bf4a-e47d99dbf85b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-6d62ed00-da43-48c1-bf4a-e47d99dbf85b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:42.004083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:42.005187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:42.006049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:42.006049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:42.006049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:42.006049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 256/514] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:42.006049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62ed00-da43-48c1-bf4a-e47d99dbf85b None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:42.075213 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e2f9e-03ee-4bc7-bfe3-647323c90d2e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:42.109366 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:42.111329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:42.120831 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56016da4-2efd-45c5-b7e1-f6ef29f09b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:42.121443 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56016da4-2efd-45c5-b7e1-f6ef29f09b9f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:42.121725 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56016da4-2efd-45c5-b7e1-f6ef29f09b9f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:42.122000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56016da4-2efd-45c5-b7e1-f6ef29f09b9f None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:42.135191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56016da4-2efd-45c5-b7e1-f6ef29f09b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:42.135191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56016da4-2efd-45c5-b7e1-f6ef29f09b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:42.135191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56016da4-2efd-45c5-b7e1-f6ef29f09b9f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:42.138991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 259/515] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:42.138991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56016da4-2efd-45c5-b7e1-f6ef29f09b9f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:42.146397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62ed00-da43-48c1-bf4a-e47d99dbf85b None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:42.191656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce431571-1cc9-49d6-aae9-fef13ec51fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:42.192241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce431571-1cc9-49d6-aae9-fef13ec51fae None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:42.192525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce431571-1cc9-49d6-aae9-fef13ec51fae None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:42.192803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce431571-1cc9-49d6-aae9-fef13ec51fae None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:42.201894 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce431571-1cc9-49d6-aae9-fef13ec51fae None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:42.203831 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce431571-1cc9-49d6-aae9-fef13ec51fae None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-ce431571-1cc9-49d6-aae9-fef13ec51fae None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:30:42.225705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:42.227294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:42.228440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:42.228440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:42.228440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:30:42.228440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:30:42.228440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:30:42.228440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:30:42.228440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:30:42.228440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:30:42.228440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:30:42.228440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:42.228440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 257/516] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:42.228440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce431571-1cc9-49d6-aae9-fef13ec51fae None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:42.277767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56016da4-2efd-45c5-b7e1-f6ef29f09b9f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:42.316430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbbfa4-7da6-4d1f-a389-5a3493763416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:42.317067 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbbfa4-7da6-4d1f-a389-5a3493763416 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:42.317340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbbfa4-7da6-4d1f-a389-5a3493763416 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:42.317608 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbbfa4-7da6-4d1f-a389-5a3493763416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:42.350223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce431571-1cc9-49d6-aae9-fef13ec51fae None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:42.382131 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:42.393064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0f369-36c8-4e48-a648-0c3309c3fc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:42.393730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0f369-36c8-4e48-a648-0c3309c3fc0f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:42.394028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0f369-36c8-4e48-a648-0c3309c3fc0f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:42.394300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0f369-36c8-4e48-a648-0c3309c3fc0f None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:42.395073 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0f369-36c8-4e48-a648-0c3309c3fc0f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:42.395382 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0f369-36c8-4e48-a648-0c3309c3fc0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:42.396869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0f369-36c8-4e48-a648-0c3309c3fc0f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:42.403073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adbbfa4-7da6-4d1f-a389-5a3493763416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:42.405347 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adbbfa4-7da6-4d1f-a389-5a3493763416 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:42.408135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:42.416751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 258/517] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Aug 29 22:30:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:42.417702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0f369-36c8-4e48-a648-0c3309c3fc0f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:42.517874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 260/518] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:42.518455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbbfa4-7da6-4d1f-a389-5a3493763416 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:42.538599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0f369-36c8-4e48-a648-0c3309c3fc0f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:42.582201 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0be530-3984-49c2-816d-d295fd7b71a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:42.582853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0be530-3984-49c2-816d-d295fd7b71a6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:42.583138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0be530-3984-49c2-816d-d295fd7b71a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:42.583721 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0be530-3984-49c2-816d-d295fd7b71a6 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:42.584264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0be530-3984-49c2-816d-d295fd7b71a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:42.584451 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0be530-3984-49c2-816d-d295fd7b71a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:42.587227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0be530-3984-49c2-816d-d295fd7b71a6 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:42.608309 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 259/519] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:42.609352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0be530-3984-49c2-816d-d295fd7b71a6 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:42.636443 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:42.655122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbbfa4-7da6-4d1f-a389-5a3493763416 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:42.678822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:42.695500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e81c91-cf33-4486-825d-1f00956a01f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:42.696130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e81c91-cf33-4486-825d-1f00956a01f1 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:42.696414 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e81c91-cf33-4486-825d-1f00956a01f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:42.696694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e81c91-cf33-4486-825d-1f00956a01f1 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:42.697335 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e81c91-cf33-4486-825d-1f00956a01f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:42.698770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e81c91-cf33-4486-825d-1f00956a01f1 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:42.724210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0be530-3984-49c2-816d-d295fd7b71a6 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:42.760917 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ead161-d353-4cbd-9525-8f17a655e29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:42.761533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ead161-d353-4cbd-9525-8f17a655e29a None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:42.761820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ead161-d353-4cbd-9525-8f17a655e29a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:42.762094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ead161-d353-4cbd-9525-8f17a655e29a None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:42.762842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ead161-d353-4cbd-9525-8f17a655e29a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:42.763150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ead161-d353-4cbd-9525-8f17a655e29a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:42.765241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ead161-d353-4cbd-9525-8f17a655e29a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:42.784263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 260/520] 10.222.0.62 () {56 vars in 1139 bytes} [Mon Aug 29 22:30:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:42.785334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ead161-d353-4cbd-9525-8f17a655e29a None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:42.807434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 261/521] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:30:42 2022] POST /identity/v3/users => generated 247 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:30:42.808338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e81c91-cf33-4486-825d-1f00956a01f1 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:42.962250 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ead161-d353-4cbd-9525-8f17a655e29a None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:42.963179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e81c91-cf33-4486-825d-1f00956a01f1 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:42.987750 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:43.009914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5e4db-0051-4ef1-b541-37e611151a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:43.011132 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5e4db-0051-4ef1-b541-37e611151a93 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:43.011614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5e4db-0051-4ef1-b541-37e611151a93 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:43.012080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5e4db-0051-4ef1-b541-37e611151a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:43.012313 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951061db-65c2-460f-b8bf-35ebf5d33b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:43.012997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951061db-65c2-460f-b8bf-35ebf5d33b9a None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:43.013389 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951061db-65c2-460f-b8bf-35ebf5d33b9a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:43.013656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951061db-65c2-460f-b8bf-35ebf5d33b9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:43.024465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:43.028135 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5e4db-0051-4ef1-b541-37e611151a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:43.028750 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5e4db-0051-4ef1-b541-37e611151a93 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-30c5e4db-0051-4ef1-b541-37e611151a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:43.062264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:43.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:43.064903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:43.064903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:43.064903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:43.064903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 262/522] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:43.064903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5e4db-0051-4ef1-b541-37e611151a93 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:43.108879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951061db-65c2-460f-b8bf-35ebf5d33b9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:43.110403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951061db-65c2-460f-b8bf-35ebf5d33b9a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:43.221598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5e4db-0051-4ef1-b541-37e611151a93 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:43.239367 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 261/523] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:43.240030 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951061db-65c2-460f-b8bf-35ebf5d33b9a None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:43.272531 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:43.287621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd91da-e896-4344-8b72-b587661918be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:43.296137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd91da-e896-4344-8b72-b587661918be None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:43.296137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd91da-e896-4344-8b72-b587661918be None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:43.296137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd91da-e896-4344-8b72-b587661918be None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:43.307213 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd91da-e896-4344-8b72-b587661918be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:43.309451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd91da-e896-4344-8b72-b587661918be None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:43.325338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-d1dd91da-e896-4344-8b72-b587661918be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:43.325338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:43.325338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:43.325338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:43.325338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:43.325338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:43.325338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:43.325338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:43.325338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:43.325338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:43.325338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:43.325338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:43.325338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:30:43.325338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:30:43.325338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:43.326386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:43.327256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:30:43.327256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:30:43.327256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:30:43.327256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:30:43.327256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:30:43.327256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:30:43.327256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:43.327256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:43.327256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 263/524] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:43.328352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd91da-e896-4344-8b72-b587661918be None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:43.397620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951061db-65c2-460f-b8bf-35ebf5d33b9a None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:43.408118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:43.452461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf41b1-f055-49ea-b9ba-68361936809e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:43.453089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf41b1-f055-49ea-b9ba-68361936809e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:43.456131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf41b1-f055-49ea-b9ba-68361936809e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:43.456131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf41b1-f055-49ea-b9ba-68361936809e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:43.465722 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd91da-e896-4344-8b72-b587661918be None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:43.508026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd338d7-e5c4-4712-adf6-662423c11d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:43.508476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd338d7-e5c4-4712-adf6-662423c11d2e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:43.508823 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd338d7-e5c4-4712-adf6-662423c11d2e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:43.509098 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd338d7-e5c4-4712-adf6-662423c11d2e None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:43.510092 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd338d7-e5c4-4712-adf6-662423c11d2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:43.510826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd338d7-e5c4-4712-adf6-662423c11d2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:43.512267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd338d7-e5c4-4712-adf6-662423c11d2e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:43.529407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 264/525] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:43.530303 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd338d7-e5c4-4712-adf6-662423c11d2e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:43.540521 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf41b1-f055-49ea-b9ba-68361936809e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:43.542500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf41b1-f055-49ea-b9ba-68361936809e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:43.561706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:43.670546 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd338d7-e5c4-4712-adf6-662423c11d2e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:43.675356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 262/526] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:43.677230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf41b1-f055-49ea-b9ba-68361936809e None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:43.693597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:43.727538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36c439-2b66-480e-b8bc-dfd60f8e771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:43.728211 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36c439-2b66-480e-b8bc-dfd60f8e771a None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:43.728497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36c439-2b66-480e-b8bc-dfd60f8e771a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:43.728774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36c439-2b66-480e-b8bc-dfd60f8e771a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:43.747137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36c439-2b66-480e-b8bc-dfd60f8e771a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:43.750819 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36c439-2b66-480e-b8bc-dfd60f8e771a None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-4d36c439-2b66-480e-b8bc-dfd60f8e771a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:43.769956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:43.770974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:43.776778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:43.776778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:43.776778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:43.776778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 265/527] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:43.776778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36c439-2b66-480e-b8bc-dfd60f8e771a None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:43.823698 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf41b1-f055-49ea-b9ba-68361936809e None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:43.849951 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:43.874699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647df7b8-bc58-4bf7-8cdf-c6a8d2429fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:43.875328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647df7b8-bc58-4bf7-8cdf-c6a8d2429fe0 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:43.875631 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647df7b8-bc58-4bf7-8cdf-c6a8d2429fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:43.875886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647df7b8-bc58-4bf7-8cdf-c6a8d2429fe0 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:43.876634 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647df7b8-bc58-4bf7-8cdf-c6a8d2429fe0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:43.876944 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647df7b8-bc58-4bf7-8cdf-c6a8d2429fe0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:43.878549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647df7b8-bc58-4bf7-8cdf-c6a8d2429fe0 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:43.901733 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36c439-2b66-480e-b8bc-dfd60f8e771a None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:43.915565 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 263/528] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:30:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:43.916513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647df7b8-bc58-4bf7-8cdf-c6a8d2429fe0 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:43.947748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962fa0c-3b0d-4783-a9c1-0dfeb0f5b2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:43.948468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962fa0c-3b0d-4783-a9c1-0dfeb0f5b2fd None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:43.948752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962fa0c-3b0d-4783-a9c1-0dfeb0f5b2fd None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:43.949300 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962fa0c-3b0d-4783-a9c1-0dfeb0f5b2fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:43.957129 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962fa0c-3b0d-4783-a9c1-0dfeb0f5b2fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:43.958572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962fa0c-3b0d-4783-a9c1-0dfeb0f5b2fd None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:43.971299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-a962fa0c-3b0d-4783-a9c1-0dfeb0f5b2fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:43.971299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:43.971299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:43.971299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:43.971299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:43.971299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:43.971299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:43.971299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:43.971299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:43.971299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:43.971299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:43.971299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:43.971299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:30:43.971299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:30:43.971299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:43.972282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:43.973151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:30:43.973151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:30:43.973151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:30:43.973151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:30:43.973151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:30:43.973151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:30:43.973151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:43.973151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:43.977201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 266/529] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:43.978449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962fa0c-3b0d-4783-a9c1-0dfeb0f5b2fd None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:44.010654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:44.043196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647df7b8-bc58-4bf7-8cdf-c6a8d2429fe0 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:44.088237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35333c4-f1e1-4376-8378-e75bdbf74137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:44.089201 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35333c4-f1e1-4376-8378-e75bdbf74137 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:44.089481 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35333c4-f1e1-4376-8378-e75bdbf74137 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:44.090019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35333c4-f1e1-4376-8378-e75bdbf74137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:44.100348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962fa0c-3b0d-4783-a9c1-0dfeb0f5b2fd None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:44.110551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35333c4-f1e1-4376-8378-e75bdbf74137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:44.112970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35333c4-f1e1-4376-8378-e75bdbf74137 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-a35333c4-f1e1-4376-8378-e75bdbf74137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:44.132847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:44.133793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:44.134667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:44.134667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:44.134667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:44.141293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 264/530] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:44.141293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35333c4-f1e1-4376-8378-e75bdbf74137 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:44.150977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abcca1-6f57-40b0-b226-56b9b4f33e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:44.151628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abcca1-6f57-40b0-b226-56b9b4f33e3c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:44.151909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abcca1-6f57-40b0-b226-56b9b4f33e3c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:44.152217 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abcca1-6f57-40b0-b226-56b9b4f33e3c None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:44.152874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abcca1-6f57-40b0-b226-56b9b4f33e3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:44.153176 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abcca1-6f57-40b0-b226-56b9b4f33e3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:44.155114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abcca1-6f57-40b0-b226-56b9b4f33e3c None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:44.168370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 267/531] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:44.168370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abcca1-6f57-40b0-b226-56b9b4f33e3c None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:44.181135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:44.278287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35333c4-f1e1-4376-8378-e75bdbf74137 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:44.283774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:44.304991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abcca1-6f57-40b0-b226-56b9b4f33e3c None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:44.324378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfbfb0-0430-4188-ae55-dea61dcf63c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:44.325923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfbfb0-0430-4188-ae55-dea61dcf63c4 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:44.326205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfbfb0-0430-4188-ae55-dea61dcf63c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:44.326481 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfbfb0-0430-4188-ae55-dea61dcf63c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:44.327354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfbfb0-0430-4188-ae55-dea61dcf63c4 None admin] RBAC: Adding query filter params (role.id=5f0de9d8946f41e8a26d355448071297, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=f06d910badb84c6aa6b48f3b56b91f82) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:44.327694 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfbfb0-0430-4188-ae55-dea61dcf63c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:44.329298 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfbfb0-0430-4188-ae55-dea61dcf63c4 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:44.340152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 265/532] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:30:44 2022] GET /identity/v3/role_assignments?user.id=f06d910badb84c6aa6b48f3b56b91f82&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=5f0de9d8946f41e8a26d355448071297 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:44.340152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfbfb0-0430-4188-ae55-dea61dcf63c4 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:44.365926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b49cf-f5ea-4fd6-8554-77fde3f38f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:44.367119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b49cf-f5ea-4fd6-8554-77fde3f38f2c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:44.367631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b49cf-f5ea-4fd6-8554-77fde3f38f2c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:44.368365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b49cf-f5ea-4fd6-8554-77fde3f38f2c None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:44.369330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b49cf-f5ea-4fd6-8554-77fde3f38f2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:44.369853 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b49cf-f5ea-4fd6-8554-77fde3f38f2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:44.371536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b49cf-f5ea-4fd6-8554-77fde3f38f2c None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:44.402047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 268/533] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:30:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:44.403272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b49cf-f5ea-4fd6-8554-77fde3f38f2c None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:44.587316 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b49cf-f5ea-4fd6-8554-77fde3f38f2c None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:44.590382 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:44.616079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfbfb0-0430-4188-ae55-dea61dcf63c4 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:44.667170 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae45778-c4ac-4f1c-b128-1030f1f0f605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:44.668045 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae45778-c4ac-4f1c-b128-1030f1f0f605 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:44.669915 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae45778-c4ac-4f1c-b128-1030f1f0f605 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:44.671766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae45778-c4ac-4f1c-b128-1030f1f0f605 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:44.687472 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae45778-c4ac-4f1c-b128-1030f1f0f605 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:44.689560 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae45778-c4ac-4f1c-b128-1030f1f0f605 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:44.694304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2624f-f927-493e-be1c-4db3af60239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:44.695140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2624f-f927-493e-be1c-4db3af60239d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:44.696380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2624f-f927-493e-be1c-4db3af60239d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:44.696818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2624f-f927-493e-be1c-4db3af60239d None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:44.700877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2624f-f927-493e-be1c-4db3af60239d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:44.701404 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2624f-f927-493e-be1c-4db3af60239d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:44.702962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2624f-f927-493e-be1c-4db3af60239d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:44.711834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-1ae45778-c4ac-4f1c-b128-1030f1f0f605 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:44.711834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:44.711834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:44.711834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:44.711834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:44.711834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:44.711834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:44.711834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:44.711834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:44.711834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:44.711834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:44.711834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:44.711834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:30:44.711834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:30:44.711834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:44.713000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:44.713950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:30:44.713950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:30:44.713950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:30:44.713950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:30:44.713950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:30:44.713950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:30:44.713950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:44.713950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:44.730388 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 269/534] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:44.733386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae45778-c4ac-4f1c-b128-1030f1f0f605 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:44.736732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 266/535] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:44.743965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2624f-f927-493e-be1c-4db3af60239d None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:44.746313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:44.912534 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2624f-f927-493e-be1c-4db3af60239d None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:44.929462 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae45778-c4ac-4f1c-b128-1030f1f0f605 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:44.964504 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f283a-410e-4d05-894f-d648a966594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:44.965556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f283a-410e-4d05-894f-d648a966594c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:44.965996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f283a-410e-4d05-894f-d648a966594c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:44.966293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f283a-410e-4d05-894f-d648a966594c None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:44.967009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f283a-410e-4d05-894f-d648a966594c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:44.967629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f283a-410e-4d05-894f-d648a966594c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:44.969281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f283a-410e-4d05-894f-d648a966594c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:44.979314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a26cd-7876-4d57-baab-f58e8b104f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:44.980010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a26cd-7876-4d57-baab-f58e8b104f94 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:44.980846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a26cd-7876-4d57-baab-f58e8b104f94 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:44.980846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a26cd-7876-4d57-baab-f58e8b104f94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:44.981525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a26cd-7876-4d57-baab-f58e8b104f94 None admin] RBAC: Adding query filter params (role.id=5f0de9d8946f41e8a26d355448071297, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=3f7d8a79945a4e73839cd2ad995e016b) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:44.982170 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a26cd-7876-4d57-baab-f58e8b104f94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:44.983882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a26cd-7876-4d57-baab-f58e8b104f94 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:44.984758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 267/536] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:30:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:44.985626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f283a-410e-4d05-894f-d648a966594c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:44.996171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 270/537] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:30:44 2022] GET /identity/v3/role_assignments?user.id=3f7d8a79945a4e73839cd2ad995e016b&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=5f0de9d8946f41e8a26d355448071297 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:44.997209 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e1afd-aef9-4f8a-b696-d66ef0bf80a3 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:44.997493 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e1afd-aef9-4f8a-b696-d66ef0bf80a3 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:44.998301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e1afd-aef9-4f8a-b696-d66ef0bf80a3 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:44.999724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 271/538] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:45.009804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e1afd-aef9-4f8a-b696-d66ef0bf80a3 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:45.020763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:45.171981 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:45.182258 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f283a-410e-4d05-894f-d648a966594c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:45.229174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfedbcb-5fb0-4125-904a-5b1d1df342c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:45.229860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfedbcb-5fb0-4125-904a-5b1d1df342c2 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:45.230144 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfedbcb-5fb0-4125-904a-5b1d1df342c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:45.230792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfedbcb-5fb0-4125-904a-5b1d1df342c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:45.244445 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfedbcb-5fb0-4125-904a-5b1d1df342c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:45.248110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfedbcb-5fb0-4125-904a-5b1d1df342c2 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:45.249444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e1afd-aef9-4f8a-b696-d66ef0bf80a3 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:45.273007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-2cfedbcb-5fb0-4125-904a-5b1d1df342c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:45.273007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:45.273007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:45.273007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:45.273007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:45.273007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:45.273007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:45.273007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:45.273007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:45.273007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:45.273007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:45.273007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:45.273007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:30:45.273007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:30:45.273007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:45.273898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:45.275202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:30:45.275202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:30:45.275202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:30:45.275202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:30:45.275202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:30:45.275202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:30:45.275202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:45.275202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:45.275202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 268/539] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:45.282588 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3922dfd-ad69-4e87-bcbd-368b6e53c25d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:45.282979 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3922dfd-ad69-4e87-bcbd-368b6e53c25d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:45.284166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3922dfd-ad69-4e87-bcbd-368b6e53c25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:45.323808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15e180-2fbf-4de8-91f7-9bb602d3ff75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:45.324493 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15e180-2fbf-4de8-91f7-9bb602d3ff75 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:45.324816 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15e180-2fbf-4de8-91f7-9bb602d3ff75 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:45.325084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15e180-2fbf-4de8-91f7-9bb602d3ff75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:45.326355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15e180-2fbf-4de8-91f7-9bb602d3ff75 None admin] RBAC: Adding query filter params (role.id=5f0de9d8946f41e8a26d355448071297, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=29b630aac21b405eb114f5f1fd1294ce) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:45.326703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15e180-2fbf-4de8-91f7-9bb602d3ff75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:45.331043 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-f3922dfd-ad69-4e87-bcbd-368b6e53c25d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:45.332929 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15e180-2fbf-4de8-91f7-9bb602d3ff75 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:45.334013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f3922dfd-ad69-4e87-bcbd-368b6e53c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:45.354166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 272/540] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:30:44 2022] GET /identity/v3/role_assignments?user.id=29b630aac21b405eb114f5f1fd1294ce&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=5f0de9d8946f41e8a26d355448071297 => generated 259 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:45.355175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15e180-2fbf-4de8-91f7-9bb602d3ff75 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:45.526751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 269/541] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:45.606711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15e180-2fbf-4de8-91f7-9bb602d3ff75 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:45.659325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:45.672819 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20375efa-30a1-45d5-be8e-0fa9b658abcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:45.673980 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20375efa-30a1-45d5-be8e-0fa9b658abcf None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:45.674815 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20375efa-30a1-45d5-be8e-0fa9b658abcf None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:45.675348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20375efa-30a1-45d5-be8e-0fa9b658abcf None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:45.676569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20375efa-30a1-45d5-be8e-0fa9b658abcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:45.677081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20375efa-30a1-45d5-be8e-0fa9b658abcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:45.679269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20375efa-30a1-45d5-be8e-0fa9b658abcf None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:45.704038 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 273/542] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:30:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:45.712443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3922dfd-ad69-4e87-bcbd-368b6e53c25d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:45.718335 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:45.839013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3922dfd-ad69-4e87-bcbd-368b6e53c25d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:45.860171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20375efa-30a1-45d5-be8e-0fa9b658abcf None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:45.879234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9333f3f-40dc-44b9-af4a-7255de3a5640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:45.879847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9333f3f-40dc-44b9-af4a-7255de3a5640 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:45.880228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9333f3f-40dc-44b9-af4a-7255de3a5640 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:45.880504 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9333f3f-40dc-44b9-af4a-7255de3a5640 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:45.881630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9333f3f-40dc-44b9-af4a-7255de3a5640 None admin] RBAC: Adding query filter params (role.id=5f0de9d8946f41e8a26d355448071297, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=d8794e99a0024672974412ca4c045b63) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:45.881630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9333f3f-40dc-44b9-af4a-7255de3a5640 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:45.883095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9333f3f-40dc-44b9-af4a-7255de3a5640 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:45.896340 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 270/543] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:30:45 2022] GET /identity/v3/role_assignments?user.id=d8794e99a0024672974412ca4c045b63&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=5f0de9d8946f41e8a26d355448071297 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:46.087971 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20375efa-30a1-45d5-be8e-0fa9b658abcf None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:46.131658 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4f595-3ed9-4a5d-a679-b4eb8269cfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:46.132321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4f595-3ed9-4a5d-a679-b4eb8269cfa9 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:46.132590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4f595-3ed9-4a5d-a679-b4eb8269cfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:46.132877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4f595-3ed9-4a5d-a679-b4eb8269cfa9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:46.162564 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4f595-3ed9-4a5d-a679-b4eb8269cfa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-c0c4f595-3ed9-4a5d-a679-b4eb8269cfa9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:46.167846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:46.168949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:46.170350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:46.170350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:46.170350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:46.170350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:46.170350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:46.170350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:46.170350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:46.170350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:46.170350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:46.170350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:46.170350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:46.170350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:46.172484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 274/544] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:46.179568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9333f3f-40dc-44b9-af4a-7255de3a5640 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:46.288538 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:46.320506 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9333f3f-40dc-44b9-af4a-7255de3a5640 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:46.358971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc7aff-1dee-41aa-a42b-085c3a0dc59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:46.359694 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc7aff-1dee-41aa-a42b-085c3a0dc59f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:46.359981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc7aff-1dee-41aa-a42b-085c3a0dc59f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:46.360321 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc7aff-1dee-41aa-a42b-085c3a0dc59f None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:46.361006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc7aff-1dee-41aa-a42b-085c3a0dc59f None admin] RBAC: Adding query filter params (name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:46.361309 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc7aff-1dee-41aa-a42b-085c3a0dc59f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:46.362691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc7aff-1dee-41aa-a42b-085c3a0dc59f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:46.377114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 271/545] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:30:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:46.378450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4f595-3ed9-4a5d-a679-b4eb8269cfa9 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:46.487326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:46.582535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4f595-3ed9-4a5d-a679-b4eb8269cfa9 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:46.676846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e762f-1ae2-4d1e-aae2-304e2467460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:46.677477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e762f-1ae2-4d1e-aae2-304e2467460e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:46.677755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e762f-1ae2-4d1e-aae2-304e2467460e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:46.678025 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e762f-1ae2-4d1e-aae2-304e2467460e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:46.702246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e762f-1ae2-4d1e-aae2-304e2467460e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:46.703713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e762f-1ae2-4d1e-aae2-304e2467460e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-4b1e762f-1ae2-4d1e-aae2-304e2467460e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:46.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:46.746469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:46.748001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:46.748001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:46.748001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:46.748001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 275/546] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:46.753379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc7aff-1dee-41aa-a42b-085c3a0dc59f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:46.775960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986d3a3-5792-429d-bafa-dd89097503e0 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:46.776304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986d3a3-5792-429d-bafa-dd89097503e0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:46.776541 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986d3a3-5792-429d-bafa-dd89097503e0 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:46.778242 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 276/547] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:46.787328 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47dc16-297a-4220-ba44-550f7df56e99 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:46.787645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47dc16-297a-4220-ba44-550f7df56e99 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:46.788251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47dc16-297a-4220-ba44-550f7df56e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:46.818696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-3a47dc16-297a-4220-ba44-550f7df56e99 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:46.819898 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3a47dc16-297a-4220-ba44-550f7df56e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:46.968062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc7aff-1dee-41aa-a42b-085c3a0dc59f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:46.975197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 277/548] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:47.029476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:47.035658 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a3890-effd-4525-a4b1-6685f4098773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:47.036340 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a3890-effd-4525-a4b1-6685f4098773 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:47.036630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a3890-effd-4525-a4b1-6685f4098773 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:47.036900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a3890-effd-4525-a4b1-6685f4098773 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:47.037549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a3890-effd-4525-a4b1-6685f4098773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:47.037850 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a3890-effd-4525-a4b1-6685f4098773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:47.039218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a3890-effd-4525-a4b1-6685f4098773 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:47.059041 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 272/549] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:47.064675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47dc16-297a-4220-ba44-550f7df56e99 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:47.125630 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:47.238633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47dc16-297a-4220-ba44-550f7df56e99 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:47.299991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa9344-b95f-4a1a-a8ff-f23fc30d960b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:47.300602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa9344-b95f-4a1a-a8ff-f23fc30d960b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:47.300885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa9344-b95f-4a1a-a8ff-f23fc30d960b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:47.301161 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa9344-b95f-4a1a-a8ff-f23fc30d960b None admin] PATH_INFO: `/v3/users/swift` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:47.320982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa9344-b95f-4a1a-a8ff-f23fc30d960b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:47.322455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa9344-b95f-4a1a-a8ff-f23fc30d960b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-67fa9344-b95f-4a1a-a8ff-f23fc30d960b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:30:47.341708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:47.342728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:47.343782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:47.343782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:47.343782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:30:47.343782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:30:47.343782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:30:47.343782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:30:47.343782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:30:47.343782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:30:47.343782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:30:47.343782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:47.348157 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 278/550] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:30:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:47.349492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a3890-effd-4525-a4b1-6685f4098773 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:47.378028 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa9344-b95f-4a1a-a8ff-f23fc30d960b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:47.588263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a3890-effd-4525-a4b1-6685f4098773 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:47.601863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:47.613407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa9344-b95f-4a1a-a8ff-f23fc30d960b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:47.665687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4ec8a-f422-4167-801f-7c4cae3a3ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:47.666320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4ec8a-f422-4167-801f-7c4cae3a3ade None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:47.666598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4ec8a-f422-4167-801f-7c4cae3a3ade None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:47.666873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4ec8a-f422-4167-801f-7c4cae3a3ade None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:47.667620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4ec8a-f422-4167-801f-7c4cae3a3ade None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:47.667928 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4ec8a-f422-4167-801f-7c4cae3a3ade None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:47.669623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4ec8a-f422-4167-801f-7c4cae3a3ade None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:47.692924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d00ba9-aa4f-42f8-8cde-1e82b99c636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:47.693602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d00ba9-aa4f-42f8-8cde-1e82b99c636a None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:47.693854 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d00ba9-aa4f-42f8-8cde-1e82b99c636a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:47.694194 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d00ba9-aa4f-42f8-8cde-1e82b99c636a None admin] PATH_INFO: `/v3/roles/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:47.697335 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 273/551] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Aug 29 22:30:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:47.698895 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae754d7-3c84-418e-ae85-44bbfad16ce0 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:47.699273 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae754d7-3c84-418e-ae85-44bbfad16ce0 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:47.699559 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae754d7-3c84-418e-ae85-44bbfad16ce0 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:47.711807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 274/552] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:47.711807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae754d7-3c84-418e-ae85-44bbfad16ce0 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:47.715087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d00ba9-aa4f-42f8-8cde-1e82b99c636a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-f9d00ba9-aa4f-42f8-8cde-1e82b99c636a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:47.723717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:47.724678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:47.725580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:47.725580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:47.725580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:47.725580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:47.725580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:47.725580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:47.725580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:47.725580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:47.725580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:47.725580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:47.725580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:47.725580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:47.730419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 279/553] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:47.731780 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78b367-90c2-4b18-abab-c1d3c750d883 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:47.732112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78b367-90c2-4b18-abab-c1d3c750d883 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:47.734160 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78b367-90c2-4b18-abab-c1d3c750d883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:47.774021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-9d78b367-90c2-4b18-abab-c1d3c750d883 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:47.776826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9d78b367-90c2-4b18-abab-c1d3c750d883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:47.832299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:47.899128 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 280/554] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:47.904193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78b367-90c2-4b18-abab-c1d3c750d883 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:47.946290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae754d7-3c84-418e-ae85-44bbfad16ce0 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:48.005365 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdec9a-61b8-4705-9e26-73e635db360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:48.006628 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdec9a-61b8-4705-9e26-73e635db360c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:48.007168 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdec9a-61b8-4705-9e26-73e635db360c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:48.007638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdec9a-61b8-4705-9e26-73e635db360c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:48.035320 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:48.068049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78b367-90c2-4b18-abab-c1d3c750d883 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:48.119517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdec9a-61b8-4705-9e26-73e635db360c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:48.121262 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdec9a-61b8-4705-9e26-73e635db360c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:48.136293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc4077-e835-4e2c-88b4-0a95b83989ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:48.137632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc4077-e835-4e2c-88b4-0a95b83989ea None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:48.139078 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc4077-e835-4e2c-88b4-0a95b83989ea None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:48.139578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc4077-e835-4e2c-88b4-0a95b83989ea None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:48.141470 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc4077-e835-4e2c-88b4-0a95b83989ea None admin] RBAC: Adding query filter params (name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:48.142061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc4077-e835-4e2c-88b4-0a95b83989ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:48.143821 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc4077-e835-4e2c-88b4-0a95b83989ea None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:48.162867 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 281/555] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:30:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:48.165155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141f551-b4be-4191-b822-65d704842c38 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:48.165719 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141f551-b4be-4191-b822-65d704842c38 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:48.166211 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141f551-b4be-4191-b822-65d704842c38 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:48.173150 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 282/556] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:48.174737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141f551-b4be-4191-b822-65d704842c38 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:48.184315 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:48.259976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 275/557] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:48.261343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88facfc-891a-4bb3-bef7-5fe7b78e598a None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:48.261633 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88facfc-891a-4bb3-bef7-5fe7b78e598a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:48.261908 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88facfc-891a-4bb3-bef7-5fe7b78e598a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:48.286640 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-c88facfc-891a-4bb3-bef7-5fe7b78e598a None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:48.287853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c88facfc-891a-4bb3-bef7-5fe7b78e598a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:48.327270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141f551-b4be-4191-b822-65d704842c38 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:48.371747 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d7689-5798-4bc6-baea-3e727677919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:48.372437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d7689-5798-4bc6-baea-3e727677919e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:48.372717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d7689-5798-4bc6-baea-3e727677919e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:48.372987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d7689-5798-4bc6-baea-3e727677919e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:48.375289 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 276/558] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:48.381189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88facfc-891a-4bb3-bef7-5fe7b78e598a None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:48.386459 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d7689-5798-4bc6-baea-3e727677919e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:48.387914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d7689-5798-4bc6-baea-3e727677919e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:48.396883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-813d7689-5798-4bc6-baea-3e727677919e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:48.408592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:48.417668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:48.418532 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:48.418532 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:48.418532 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:48.418532 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 283/559] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:48.418532 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d7689-5798-4bc6-baea-3e727677919e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:48.523411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:48.550721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d7689-5798-4bc6-baea-3e727677919e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:48.554619 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88facfc-891a-4bb3-bef7-5fe7b78e598a None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:48.600279 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa894e39-20a6-46cf-8eb5-7c8280988ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:48.601325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa894e39-20a6-46cf-8eb5-7c8280988ed0 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:48.601834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa894e39-20a6-46cf-8eb5-7c8280988ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:48.604333 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78c266-285b-40d7-8cd3-706e70714642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:48.605169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa894e39-20a6-46cf-8eb5-7c8280988ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:48.607333 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c266-285b-40d7-8cd3-706e70714642 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:48.607697 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c266-285b-40d7-8cd3-706e70714642 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:48.607969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c266-285b-40d7-8cd3-706e70714642 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:48.621646 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa894e39-20a6-46cf-8eb5-7c8280988ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:48.625212 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa894e39-20a6-46cf-8eb5-7c8280988ed0 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:48.633021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78c266-285b-40d7-8cd3-706e70714642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-6a78c266-285b-40d7-8cd3-706e70714642 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:48.641583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:48.643094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:48.644252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:48.644252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:48.644252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:48.644252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:48.644252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:48.644252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:48.644252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:48.644252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:48.644252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:48.644252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:48.644252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:48.644252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:48.644252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 277/560] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:48.644252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f448888-be07-4ea4-9cd2-63896d1acdcb None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:48.648130 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f448888-be07-4ea4-9cd2-63896d1acdcb None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:48.648450 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f448888-be07-4ea4-9cd2-63896d1acdcb None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:48.649885 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 278/561] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:48.650747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f448888-be07-4ea4-9cd2-63896d1acdcb None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-fa894e39-20a6-46cf-8eb5-7c8280988ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:48.653569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:48.655133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:48.656018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:48.656018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:48.656018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:48.657656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 284/562] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:48.658502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa894e39-20a6-46cf-8eb5-7c8280988ed0 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:48.717565 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:48.767127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f448888-be07-4ea4-9cd2-63896d1acdcb None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:48.771514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa894e39-20a6-46cf-8eb5-7c8280988ed0 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:48.811137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d1c9d-3869-416b-a6da-49367e2135cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:48.811746 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d1c9d-3869-416b-a6da-49367e2135cd None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:48.812027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d1c9d-3869-416b-a6da-49367e2135cd None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:48.812327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d1c9d-3869-416b-a6da-49367e2135cd None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:48.812967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d1c9d-3869-416b-a6da-49367e2135cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:48.813268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d1c9d-3869-416b-a6da-49367e2135cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:48.814666 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d1c9d-3869-416b-a6da-49367e2135cd None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:48.815078 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451f68b-edd6-4a31-80a2-9b2bd6317b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:48.815707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451f68b-edd6-4a31-80a2-9b2bd6317b3b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:48.816056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451f68b-edd6-4a31-80a2-9b2bd6317b3b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:48.816309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451f68b-edd6-4a31-80a2-9b2bd6317b3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:48.818524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:48.827404 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451f68b-edd6-4a31-80a2-9b2bd6317b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:48.830768 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 279/563] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:48.831402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d1c9d-3869-416b-a6da-49367e2135cd None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-b451f68b-edd6-4a31-80a2-9b2bd6317b3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:48.837446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:48.838422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:48.839251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:48.839251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:48.839251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:48.839251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:48.839251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:48.839251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:48.839251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:48.839251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:48.839251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:48.839251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:48.839251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:48.839251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:48.839251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 285/564] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:48.840635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c8924-4060-4572-9fe4-2b3294bb012b None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:48.840635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c8924-4060-4572-9fe4-2b3294bb012b None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:48.840635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c8924-4060-4572-9fe4-2b3294bb012b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:48.860380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-a48c8924-4060-4572-9fe4-2b3294bb012b None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:48.861602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a48c8924-4060-4572-9fe4-2b3294bb012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:48.944193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 286/565] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:48.944461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d1c9d-3869-416b-a6da-49367e2135cd None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:48.945615 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c8924-4060-4572-9fe4-2b3294bb012b None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:48.991052 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89167af-749c-43cf-adce-8f9caffd4de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:48.991637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89167af-749c-43cf-adce-8f9caffd4de2 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:48.991922 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89167af-749c-43cf-adce-8f9caffd4de2 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:48.992225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89167af-749c-43cf-adce-8f9caffd4de2 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:48.992901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89167af-749c-43cf-adce-8f9caffd4de2 None admin] RBAC: Adding query filter params (name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:48.993200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89167af-749c-43cf-adce-8f9caffd4de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:48.994563 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89167af-749c-43cf-adce-8f9caffd4de2 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:49.009815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 280/566] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:30:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:49.010913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89167af-749c-43cf-adce-8f9caffd4de2 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:49.050576 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:49.079801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:49.127273 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89167af-749c-43cf-adce-8f9caffd4de2 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:49.166714 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee7a49-8faf-468e-9824-3b4774eac901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:49.167346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee7a49-8faf-468e-9824-3b4774eac901 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:49.167619 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee7a49-8faf-468e-9824-3b4774eac901 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:49.168019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee7a49-8faf-468e-9824-3b4774eac901 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:49.174669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c8924-4060-4572-9fe4-2b3294bb012b None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:49.179475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee7a49-8faf-468e-9824-3b4774eac901 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:49.180977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee7a49-8faf-468e-9824-3b4774eac901 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-73ee7a49-8faf-468e-9824-3b4774eac901 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:30:49.193791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:49.194766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:49.195701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:49.195701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:49.195701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:30:49.195701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:30:49.195701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:30:49.195701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:30:49.195701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:30:49.195701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:30:49.195701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:30:49.195701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:49.200752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 281/567] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 29 22:30:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:49.201865 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee7a49-8faf-468e-9824-3b4774eac901 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:49.256325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d371941-fc85-40e3-8199-e38258b3def4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:49.257585 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d371941-fc85-40e3-8199-e38258b3def4 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:49.258200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d371941-fc85-40e3-8199-e38258b3def4 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:49.258686 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d371941-fc85-40e3-8199-e38258b3def4 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:49.260031 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d371941-fc85-40e3-8199-e38258b3def4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:49.260555 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d371941-fc85-40e3-8199-e38258b3def4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:49.264152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d371941-fc85-40e3-8199-e38258b3def4 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:49.288773 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 287/568] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:49.290268 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d371941-fc85-40e3-8199-e38258b3def4 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:49.334576 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee7a49-8faf-468e-9824-3b4774eac901 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:49.355862 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:49.383749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c2d7d-8fb1-48ea-b3ed-31412e84f13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:49.385293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c2d7d-8fb1-48ea-b3ed-31412e84f13f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:49.385572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c2d7d-8fb1-48ea-b3ed-31412e84f13f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:49.385878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c2d7d-8fb1-48ea-b3ed-31412e84f13f None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:49.386572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c2d7d-8fb1-48ea-b3ed-31412e84f13f None admin] RBAC: Adding query filter params (name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:49.386872 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c2d7d-8fb1-48ea-b3ed-31412e84f13f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:49.388871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c2d7d-8fb1-48ea-b3ed-31412e84f13f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:49.399479 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 282/569] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:30:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:49.404975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c2d7d-8fb1-48ea-b3ed-31412e84f13f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:49.419547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:49.423655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d371941-fc85-40e3-8199-e38258b3def4 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:49.467694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91c2e0-6358-4dd8-996e-bfe38c3a2198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:49.468400 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91c2e0-6358-4dd8-996e-bfe38c3a2198 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:49.468647 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91c2e0-6358-4dd8-996e-bfe38c3a2198 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:49.468924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91c2e0-6358-4dd8-996e-bfe38c3a2198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:49.480120 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91c2e0-6358-4dd8-996e-bfe38c3a2198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:49.481690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91c2e0-6358-4dd8-996e-bfe38c3a2198 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-ba91c2e0-6358-4dd8-996e-bfe38c3a2198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:49.496220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:49.503264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:49.504173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:49.504173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:49.504173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:49.504173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 288/570] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:49.504173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91c2e0-6358-4dd8-996e-bfe38c3a2198 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:49.525274 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c2d7d-8fb1-48ea-b3ed-31412e84f13f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:49.571877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84617c-8af8-47ef-8ca6-a29b73fa5334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:49.572609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84617c-8af8-47ef-8ca6-a29b73fa5334 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:49.572917 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84617c-8af8-47ef-8ca6-a29b73fa5334 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:49.573758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84617c-8af8-47ef-8ca6-a29b73fa5334 None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:49.574559 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84617c-8af8-47ef-8ca6-a29b73fa5334 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:49.574874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84617c-8af8-47ef-8ca6-a29b73fa5334 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:49.577463 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84617c-8af8-47ef-8ca6-a29b73fa5334 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:49.599008 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 283/571] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 29 22:30:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:49.599685 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84617c-8af8-47ef-8ca6-a29b73fa5334 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:49.621050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91c2e0-6358-4dd8-996e-bfe38c3a2198 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:49.644780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:49.657398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2db91-d45b-4171-bbfb-d955314e54b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:49.658025 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2db91-d45b-4171-bbfb-d955314e54b8 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:49.658304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2db91-d45b-4171-bbfb-d955314e54b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:49.660005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2db91-d45b-4171-bbfb-d955314e54b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:49.665244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2db91-d45b-4171-bbfb-d955314e54b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:49.666768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2db91-d45b-4171-bbfb-d955314e54b8 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:49.678137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-f7a2db91-d45b-4171-bbfb-d955314e54b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:49.678137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:49.678137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:49.678137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:49.678137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:49.678137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:49.678137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:49.678137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:49.678137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:49.678137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:49.678137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:49.678137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:49.678137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:30:49.678137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:30:49.678137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:49.679050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:49.679934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:30:49.679934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:30:49.679934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:30:49.679934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:30:49.679934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:30:49.679934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:30:49.679934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:49.679934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:49.683881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 289/572] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:49.684776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2db91-d45b-4171-bbfb-d955314e54b8 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:49.703380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:49.710049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84617c-8af8-47ef-8ca6-a29b73fa5334 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:49.757370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2bd77-e3d1-498b-a59e-cb362e216106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:49.758143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2bd77-e3d1-498b-a59e-cb362e216106 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:49.758425 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2bd77-e3d1-498b-a59e-cb362e216106 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:49.758939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2bd77-e3d1-498b-a59e-cb362e216106 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:49.770661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2bd77-e3d1-498b-a59e-cb362e216106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-a4e2bd77-e3d1-498b-a59e-cb362e216106 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:49.775676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:49.776713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:49.777556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:49.777556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:49.777556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:49.777556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:49.777556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:49.777556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:49.777556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:49.777556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:49.777556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:49.777556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:49.777556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:49.777556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:49.777556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 284/573] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:49.777556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2bd77-e3d1-498b-a59e-cb362e216106 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:49.810634 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2db91-d45b-4171-bbfb-d955314e54b8 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:49.855315 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6517216-1457-4a0b-aeed-e18d0e0d1e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:49.855845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6517216-1457-4a0b-aeed-e18d0e0d1e3f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:49.856187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6517216-1457-4a0b-aeed-e18d0e0d1e3f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:49.856825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6517216-1457-4a0b-aeed-e18d0e0d1e3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:49.868188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6517216-1457-4a0b-aeed-e18d0e0d1e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:49.869696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6517216-1457-4a0b-aeed-e18d0e0d1e3f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:49.884900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-f6517216-1457-4a0b-aeed-e18d0e0d1e3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:49.887313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:49.888803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:49.889696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:49.889696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:49.889696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:49.889696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 290/574] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:49.890349 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6517216-1457-4a0b-aeed-e18d0e0d1e3f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:49.892223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2bd77-e3d1-498b-a59e-cb362e216106 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:49.931012 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a9451-cee4-4605-947d-264951bf4165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:49.931630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a9451-cee4-4605-947d-264951bf4165 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:49.931924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a9451-cee4-4605-947d-264951bf4165 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:49.932225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a9451-cee4-4605-947d-264951bf4165 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:49.932901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a9451-cee4-4605-947d-264951bf4165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:49.933218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a9451-cee4-4605-947d-264951bf4165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:49.934903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a9451-cee4-4605-947d-264951bf4165 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:49.947268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 285/575] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:49.948478 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a9451-cee4-4605-947d-264951bf4165 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:49.959973 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:50.008791 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6517216-1457-4a0b-aeed-e18d0e0d1e3f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:50.053123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d764e2f-033d-4453-86c9-2f937c3c5db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:50.053771 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d764e2f-033d-4453-86c9-2f937c3c5db6 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:50.054048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d764e2f-033d-4453-86c9-2f937c3c5db6 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:50.054321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d764e2f-033d-4453-86c9-2f937c3c5db6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:50.064681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a9451-cee4-4605-947d-264951bf4165 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:50.066263 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d764e2f-033d-4453-86c9-2f937c3c5db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:50.072897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d764e2f-033d-4453-86c9-2f937c3c5db6 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-3d764e2f-033d-4453-86c9-2f937c3c5db6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:50.088405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:50.089570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:50.090649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:50.090649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:50.090649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:50.090649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 291/576] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:50.090649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d764e2f-033d-4453-86c9-2f937c3c5db6 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:50.106235 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131a2bd-eba2-4945-933a-534d18568fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:50.107618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131a2bd-eba2-4945-933a-534d18568fc3 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:50.107979 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131a2bd-eba2-4945-933a-534d18568fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:50.108355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131a2bd-eba2-4945-933a-534d18568fc3 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:50.109063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131a2bd-eba2-4945-933a-534d18568fc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:50.109378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131a2bd-eba2-4945-933a-534d18568fc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:50.110807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131a2bd-eba2-4945-933a-534d18568fc3 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:50.125271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 286/577] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:30:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:50.125271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131a2bd-eba2-4945-933a-534d18568fc3 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:50.146293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:50.198203 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d764e2f-033d-4453-86c9-2f937c3c5db6 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:50.215798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:50.235103 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131a2bd-eba2-4945-933a-534d18568fc3 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:50.235809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67702380-bc0d-428e-b961-084786509548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:50.236444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67702380-bc0d-428e-b961-084786509548 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:50.236726 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67702380-bc0d-428e-b961-084786509548 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:50.236991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67702380-bc0d-428e-b961-084786509548 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:50.237647 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67702380-bc0d-428e-b961-084786509548 None admin] RBAC: Adding query filter params (name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:50.237943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67702380-bc0d-428e-b961-084786509548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:50.239289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67702380-bc0d-428e-b961-084786509548 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:50.252275 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 292/578] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:30:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:50.253010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67702380-bc0d-428e-b961-084786509548 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:50.271478 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed018fe4-b476-4d8e-b395-757dd705f78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:50.272105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed018fe4-b476-4d8e-b395-757dd705f78b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:50.272384 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed018fe4-b476-4d8e-b395-757dd705f78b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:50.272682 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed018fe4-b476-4d8e-b395-757dd705f78b None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:50.273318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed018fe4-b476-4d8e-b395-757dd705f78b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:50.273607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed018fe4-b476-4d8e-b395-757dd705f78b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:50.274963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed018fe4-b476-4d8e-b395-757dd705f78b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:50.287606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 287/579] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:50.288332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed018fe4-b476-4d8e-b395-757dd705f78b None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:50.362043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67702380-bc0d-428e-b961-084786509548 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:50.370301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:50.394926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed018fe4-b476-4d8e-b395-757dd705f78b None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:50.398689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4041d3-9ee0-437c-beaa-10e41c128b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:50.399327 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4041d3-9ee0-437c-beaa-10e41c128b04 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:50.399597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4041d3-9ee0-437c-beaa-10e41c128b04 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:50.399869 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4041d3-9ee0-437c-beaa-10e41c128b04 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:50.409131 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4041d3-9ee0-437c-beaa-10e41c128b04 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:50.411710 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4041d3-9ee0-437c-beaa-10e41c128b04 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-3c4041d3-9ee0-437c-beaa-10e41c128b04 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:30:50.425837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:50.427024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:50.427978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:50.427978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:50.427978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:30:50.427978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:30:50.427978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:30:50.427978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:30:50.427978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:30:50.427978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:30:50.427978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:30:50.427978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:50.427978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 293/580] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:50.427978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4041d3-9ee0-437c-beaa-10e41c128b04 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:50.438602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafce13f-a076-4b8e-842d-7300ad5e92ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:50.439347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafce13f-a076-4b8e-842d-7300ad5e92ea None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:50.439504 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafce13f-a076-4b8e-842d-7300ad5e92ea None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:50.439798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafce13f-a076-4b8e-842d-7300ad5e92ea None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:50.440876 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafce13f-a076-4b8e-842d-7300ad5e92ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:50.441193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafce13f-a076-4b8e-842d-7300ad5e92ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:50.442600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafce13f-a076-4b8e-842d-7300ad5e92ea None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:50.456970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 288/581] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:50.457821 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafce13f-a076-4b8e-842d-7300ad5e92ea None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:50.482773 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:50.559516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4041d3-9ee0-437c-beaa-10e41c128b04 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:50.577203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafce13f-a076-4b8e-842d-7300ad5e92ea None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:50.598832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3f5a9-a1be-409e-8145-5b0e63744d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:50.599446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3f5a9-a1be-409e-8145-5b0e63744d8e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:50.599732 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3f5a9-a1be-409e-8145-5b0e63744d8e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:50.600007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3f5a9-a1be-409e-8145-5b0e63744d8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:50.600760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3f5a9-a1be-409e-8145-5b0e63744d8e None admin] RBAC: Adding query filter params (role.id=5f0de9d8946f41e8a26d355448071297, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=a8cccf561d484373a7cb24c5f111900c) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:50.601067 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3f5a9-a1be-409e-8145-5b0e63744d8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:50.602511 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3f5a9-a1be-409e-8145-5b0e63744d8e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:50.609325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 294/582] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:30:50 2022] GET /identity/v3/role_assignments?user.id=a8cccf561d484373a7cb24c5f111900c&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=5f0de9d8946f41e8a26d355448071297 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:50.610224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3f5a9-a1be-409e-8145-5b0e63744d8e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:50.615593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b5335-e429-4f2b-b995-1dd4b2e92e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:50.616550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b5335-e429-4f2b-b995-1dd4b2e92e5c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:50.617030 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b5335-e429-4f2b-b995-1dd4b2e92e5c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:50.617465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b5335-e429-4f2b-b995-1dd4b2e92e5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:50.626781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:50.635609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b5335-e429-4f2b-b995-1dd4b2e92e5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:50.637455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b5335-e429-4f2b-b995-1dd4b2e92e5c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-e19b5335-e429-4f2b-b995-1dd4b2e92e5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:50.659352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:50.660431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:50.661937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:50.661937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:50.661937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:50.661937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 289/583] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:50.661937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b5335-e429-4f2b-b995-1dd4b2e92e5c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:50.757159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3f5a9-a1be-409e-8145-5b0e63744d8e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:50.758783 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:50.781185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b5335-e429-4f2b-b995-1dd4b2e92e5c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:50.800588 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6763a-8730-4f02-9652-c0119ac9bde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:50.801219 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6763a-8730-4f02-9652-c0119ac9bde7 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:50.801495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6763a-8730-4f02-9652-c0119ac9bde7 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:50.801764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6763a-8730-4f02-9652-c0119ac9bde7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:50.810169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6763a-8730-4f02-9652-c0119ac9bde7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:50.811712 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6763a-8730-4f02-9652-c0119ac9bde7 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:50.821022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11427931-c8bd-460f-92e8-bd15a722f891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:50.821515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11427931-c8bd-460f-92e8-bd15a722f891 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:50.821801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11427931-c8bd-460f-92e8-bd15a722f891 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:50.822077 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11427931-c8bd-460f-92e8-bd15a722f891 None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:50.822815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11427931-c8bd-460f-92e8-bd15a722f891 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:50.823124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11427931-c8bd-460f-92e8-bd15a722f891 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-99c6763a-8730-4f02-9652-c0119ac9bde7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:30:50.823784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:50.824709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:50.826224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:50.826224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:50.826224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:30:50.826224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:30:50.826224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:30:50.826224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:30:50.826224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:30:50.826224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:30:50.826224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:30:50.826224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:50.826758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11427931-c8bd-460f-92e8-bd15a722f891 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:50.827387 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 295/584] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:50.827387 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6763a-8730-4f02-9652-c0119ac9bde7 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:50.854034 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 290/585] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Aug 29 22:30:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:50.854034 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11427931-c8bd-460f-92e8-bd15a722f891 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:50.914042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:50.943347 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6763a-8730-4f02-9652-c0119ac9bde7 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:50.971394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11427931-c8bd-460f-92e8-bd15a722f891 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:50.982510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a21194-5f63-495f-ac39-bc084a0ba4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:50.983368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a21194-5f63-495f-ac39-bc084a0ba4bd None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:50.983460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a21194-5f63-495f-ac39-bc084a0ba4bd None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:50.983678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a21194-5f63-495f-ac39-bc084a0ba4bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:50.990677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a21194-5f63-495f-ac39-bc084a0ba4bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:50.992157 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a21194-5f63-495f-ac39-bc084a0ba4bd None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:51.004559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-f3a21194-5f63-495f-ac39-bc084a0ba4bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:51.004559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:51.004559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:51.004559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:51.004559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:51.004559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:51.004559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:51.004559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:51.004559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:51.004559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:51.004559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:51.004559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:51.004559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:30:51.004559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:30:51.004559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:51.005500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:51.006383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:30:51.006383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:30:51.006383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:30:51.006383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:30:51.006383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:30:51.006383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:30:51.006383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:51.006383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:51.010818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 296/586] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:51.011734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a21194-5f63-495f-ac39-bc084a0ba4bd None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:51.011844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839a51f-328e-4fc7-a12c-134554ea79dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:51.012528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a51f-328e-4fc7-a12c-134554ea79dc None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:51.012855 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a51f-328e-4fc7-a12c-134554ea79dc None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:51.013589 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a51f-328e-4fc7-a12c-134554ea79dc None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:51.014245 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839a51f-328e-4fc7-a12c-134554ea79dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:51.014550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839a51f-328e-4fc7-a12c-134554ea79dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:51.015948 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839a51f-328e-4fc7-a12c-134554ea79dc None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:51.027697 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 291/587] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:51.027697 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839a51f-328e-4fc7-a12c-134554ea79dc None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:51.048624 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:51.130587 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a21194-5f63-495f-ac39-bc084a0ba4bd None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:51.144209 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839a51f-328e-4fc7-a12c-134554ea79dc None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:51.154986 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:51.169242 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce979f-7062-487f-a6b0-f58c515890cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:51.170058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce979f-7062-487f-a6b0-f58c515890cd None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:51.170430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce979f-7062-487f-a6b0-f58c515890cd None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:51.170737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce979f-7062-487f-a6b0-f58c515890cd None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:51.171562 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce979f-7062-487f-a6b0-f58c515890cd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:51.171927 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce979f-7062-487f-a6b0-f58c515890cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:51.173375 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce979f-7062-487f-a6b0-f58c515890cd None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:51.183556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7039d-2a0e-458e-9e21-4068c0a91f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:51.184311 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7039d-2a0e-458e-9e21-4068c0a91f8f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:51.184593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7039d-2a0e-458e-9e21-4068c0a91f8f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:51.184947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7039d-2a0e-458e-9e21-4068c0a91f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:51.192873 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 297/588] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Aug 29 22:30:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:51.194030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce979f-7062-487f-a6b0-f58c515890cd None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:51.201082 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7039d-2a0e-458e-9e21-4068c0a91f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:51.202556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7039d-2a0e-458e-9e21-4068c0a91f8f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-afa7039d-2a0e-458e-9e21-4068c0a91f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:51.217824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:51.218913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:51.219844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:51.219844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:51.219844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:51.219844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 292/589] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:51.219844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7039d-2a0e-458e-9e21-4068c0a91f8f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:51.283577 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:51.305502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce979f-7062-487f-a6b0-f58c515890cd None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:51.337105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7039d-2a0e-458e-9e21-4068c0a91f8f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:51.345126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee1ede-7803-4542-8c98-63b43adab4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:51.345526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee1ede-7803-4542-8c98-63b43adab4c6 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:51.345784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee1ede-7803-4542-8c98-63b43adab4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:51.346057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee1ede-7803-4542-8c98-63b43adab4c6 None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:51.346844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee1ede-7803-4542-8c98-63b43adab4c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:51.347406 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee1ede-7803-4542-8c98-63b43adab4c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:51.349248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee1ede-7803-4542-8c98-63b43adab4c6 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:51.367014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 298/590] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:30:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:51.367014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee1ede-7803-4542-8c98-63b43adab4c6 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:51.382651 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba287be-2451-49dc-a936-c1997503d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:51.383656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba287be-2451-49dc-a936-c1997503d6fb None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:51.384082 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba287be-2451-49dc-a936-c1997503d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:51.384397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba287be-2451-49dc-a936-c1997503d6fb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:51.393109 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba287be-2451-49dc-a936-c1997503d6fb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:51.394565 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba287be-2451-49dc-a936-c1997503d6fb None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-fba287be-2451-49dc-a936-c1997503d6fb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:30:51.405749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:51.407351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:51.408774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:51.408774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:51.408774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:30:51.408774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:30:51.408774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:30:51.408774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:30:51.408774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:30:51.408774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:30:51.408774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:30:51.408774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:51.411645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 293/591] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:51.412520 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba287be-2451-49dc-a936-c1997503d6fb None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:51.437661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:51.477307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee1ede-7803-4542-8c98-63b43adab4c6 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:51.515241 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b417315-bd88-4c03-b8d1-4a4781c2ae59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:51.516302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b417315-bd88-4c03-b8d1-4a4781c2ae59 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:51.516652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b417315-bd88-4c03-b8d1-4a4781c2ae59 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:51.516937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b417315-bd88-4c03-b8d1-4a4781c2ae59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:51.519432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba287be-2451-49dc-a936-c1997503d6fb None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:51.526140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:51.530523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b417315-bd88-4c03-b8d1-4a4781c2ae59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:51.532035 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b417315-bd88-4c03-b8d1-4a4781c2ae59 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-7b417315-bd88-4c03-b8d1-4a4781c2ae59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:51.546454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:51.547609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:51.549432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:51.549432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:51.549432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:51.549432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 299/592] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:51.549432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b417315-bd88-4c03-b8d1-4a4781c2ae59 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:51.559262 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25cee6-05cd-493d-baed-4f86e29e23ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:51.559918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25cee6-05cd-493d-baed-4f86e29e23ea None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:51.560232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25cee6-05cd-493d-baed-4f86e29e23ea None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:51.560508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25cee6-05cd-493d-baed-4f86e29e23ea None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:51.561195 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25cee6-05cd-493d-baed-4f86e29e23ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:51.561468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25cee6-05cd-493d-baed-4f86e29e23ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:51.562847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25cee6-05cd-493d-baed-4f86e29e23ea None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:51.575331 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 294/593] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:51.576692 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25cee6-05cd-493d-baed-4f86e29e23ea None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:51.674481 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:51.684040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b417315-bd88-4c03-b8d1-4a4781c2ae59 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:51.702809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25cee6-05cd-493d-baed-4f86e29e23ea None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:51.739143 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e3b59-aabd-4646-be6a-e839593d8522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:51.739846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3b59-aabd-4646-be6a-e839593d8522 None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:51.740149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3b59-aabd-4646-be6a-e839593d8522 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:51.740391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3b59-aabd-4646-be6a-e839593d8522 None admin] PATH_INFO: `/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/f06d910badb84c6aa6b48f3b56b91f82/roles/5f0de9d8946f41e8a26d355448071297` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:51.757895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e3b59-aabd-4646-be6a-e839593d8522 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdd2d14c7e884b8b8f340183a79fd481, user_id=f06d910badb84c6aa6b48f3b56b91f82, role_id=5f0de9d8946f41e8a26d355448071297)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:51.758349 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cdebb-f329-4b83-b88e-d420a20d8806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:51.758965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cdebb-f329-4b83-b88e-d420a20d8806 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:51.759242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cdebb-f329-4b83-b88e-d420a20d8806 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:51.759512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cdebb-f329-4b83-b88e-d420a20d8806 None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:51.760287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cdebb-f329-4b83-b88e-d420a20d8806 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:51.760593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cdebb-f329-4b83-b88e-d420a20d8806 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:51.761205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e3b59-aabd-4646-be6a-e839593d8522 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:51.762363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cdebb-f329-4b83-b88e-d420a20d8806 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:51.790013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 295/594] 10.222.0.62 () {56 vars in 1139 bytes} [Mon Aug 29 22:30:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:51.790013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cdebb-f329-4b83-b88e-d420a20d8806 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:51.827830 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 300/595] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:30:51 2022] PUT /identity/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/f06d910badb84c6aa6b48f3b56b91f82/roles/5f0de9d8946f41e8a26d355448071297 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:51.828847 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e3b59-aabd-4646-be6a-e839593d8522 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:51.920680 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:51.990165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cdebb-f329-4b83-b88e-d420a20d8806 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:52.041399 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e3b59-aabd-4646-be6a-e839593d8522 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:52.052455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d76f6b-fe20-49b7-9d31-2361a4064586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:52.053236 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d76f6b-fe20-49b7-9d31-2361a4064586 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:52.053527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d76f6b-fe20-49b7-9d31-2361a4064586 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:52.053906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d76f6b-fe20-49b7-9d31-2361a4064586 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:52.054606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d76f6b-fe20-49b7-9d31-2361a4064586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:52.054915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d76f6b-fe20-49b7-9d31-2361a4064586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:52.056475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d76f6b-fe20-49b7-9d31-2361a4064586 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:52.064599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:52.072395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 296/596] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:52.074736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d76f6b-fe20-49b7-9d31-2361a4064586 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:52.094056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e612e5c-6ac3-4c5e-ad6f-ab4e39557cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:52.094996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e612e5c-6ac3-4c5e-ad6f-ab4e39557cad None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:52.095671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e612e5c-6ac3-4c5e-ad6f-ab4e39557cad None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:52.096525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e612e5c-6ac3-4c5e-ad6f-ab4e39557cad None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:52.107636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e612e5c-6ac3-4c5e-ad6f-ab4e39557cad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:52.110034 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e612e5c-6ac3-4c5e-ad6f-ab4e39557cad None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:52.129707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-9e612e5c-6ac3-4c5e-ad6f-ab4e39557cad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:52.129707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:52.129707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:52.129707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:52.129707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:52.129707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:52.129707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:52.129707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:52.129707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:52.129707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:52.129707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:52.129707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:52.129707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:30:52.129707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:30:52.129707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:52.130829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:52.131893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:30:52.131893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:30:52.131893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:30:52.131893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:30:52.131893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:30:52.131893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:30:52.131893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:52.131893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:52.133963 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 301/597] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:52.134911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e612e5c-6ac3-4c5e-ad6f-ab4e39557cad None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:52.206592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d76f6b-fe20-49b7-9d31-2361a4064586 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:52.245946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd726e-3414-42b6-8d07-6385bc1de86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:52.246651 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd726e-3414-42b6-8d07-6385bc1de86e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:52.247027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd726e-3414-42b6-8d07-6385bc1de86e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:52.247943 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd726e-3414-42b6-8d07-6385bc1de86e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:52.248918 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e612e5c-6ac3-4c5e-ad6f-ab4e39557cad None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:52.250872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:52.261152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd726e-3414-42b6-8d07-6385bc1de86e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:52.262804 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd726e-3414-42b6-8d07-6385bc1de86e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-98bd726e-3414-42b6-8d07-6385bc1de86e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:52.279762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:52.281097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:52.282180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:52.282180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:52.282180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:52.283483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 297/598] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:52.284528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd726e-3414-42b6-8d07-6385bc1de86e None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:52.292756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f0d12-5465-4d9e-b888-7d509821907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:52.293652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f0d12-5465-4d9e-b888-7d509821907a None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:52.294102 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f0d12-5465-4d9e-b888-7d509821907a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:52.294552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f0d12-5465-4d9e-b888-7d509821907a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:52.302710 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f0d12-5465-4d9e-b888-7d509821907a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:52.304460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f0d12-5465-4d9e-b888-7d509821907a None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:52.316897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-bf5f0d12-5465-4d9e-b888-7d509821907a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:52.316897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:52.316897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:52.316897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:52.316897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:52.316897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:52.316897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:52.316897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:52.316897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:52.316897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:52.316897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:52.316897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:52.316897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:30:52.316897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:30:52.316897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:52.317938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:52.318841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:30:52.318841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:30:52.318841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:30:52.318841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:30:52.318841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:30:52.318841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:30:52.318841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:52.318841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:52.321495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 302/599] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:52.322675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f0d12-5465-4d9e-b888-7d509821907a None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:52.345147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:52.401353 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd726e-3414-42b6-8d07-6385bc1de86e None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:52.433201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f0d12-5465-4d9e-b888-7d509821907a None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:52.438570 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4654796-5cf4-4460-9013-47bc50957546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:52.439235 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654796-5cf4-4460-9013-47bc50957546 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:52.439528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654796-5cf4-4460-9013-47bc50957546 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:52.439807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654796-5cf4-4460-9013-47bc50957546 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:52.440605 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4654796-5cf4-4460-9013-47bc50957546 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:52.440914 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4654796-5cf4-4460-9013-47bc50957546 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:52.442366 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4654796-5cf4-4460-9013-47bc50957546 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:52.462090 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 298/600] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:30:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:52.463139 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4654796-5cf4-4460-9013-47bc50957546 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:52.478761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fce80-7ec9-4127-a609-5f562190d957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:52.480401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fce80-7ec9-4127-a609-5f562190d957 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:52.481269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fce80-7ec9-4127-a609-5f562190d957 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:52.482087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fce80-7ec9-4127-a609-5f562190d957 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:52.483661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5fce80-7ec9-4127-a609-5f562190d957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:52.484739 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5fce80-7ec9-4127-a609-5f562190d957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:52.487592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5fce80-7ec9-4127-a609-5f562190d957 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:52.514204 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 303/601] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:52.516410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fce80-7ec9-4127-a609-5f562190d957 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:52.548590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:52.573117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4654796-5cf4-4460-9013-47bc50957546 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:52.592288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:52.620138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba44703-78f1-4066-b38d-54243c0e2c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:52.620843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba44703-78f1-4066-b38d-54243c0e2c49 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:52.621080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba44703-78f1-4066-b38d-54243c0e2c49 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:52.621363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba44703-78f1-4066-b38d-54243c0e2c49 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:52.622009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba44703-78f1-4066-b38d-54243c0e2c49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:52.622844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba44703-78f1-4066-b38d-54243c0e2c49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:52.624342 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba44703-78f1-4066-b38d-54243c0e2c49 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:52.635976 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fce80-7ec9-4127-a609-5f562190d957 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:52.640251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 299/602] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:30:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:52.640251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba44703-78f1-4066-b38d-54243c0e2c49 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:52.674880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c125e51-3f80-49eb-8f31-b8a890aa582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:52.675566 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c125e51-3f80-49eb-8f31-b8a890aa582b None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:52.675848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c125e51-3f80-49eb-8f31-b8a890aa582b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:52.676145 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c125e51-3f80-49eb-8f31-b8a890aa582b None admin] PATH_INFO: `/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/3f7d8a79945a4e73839cd2ad995e016b/roles/5f0de9d8946f41e8a26d355448071297` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:52.692592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c125e51-3f80-49eb-8f31-b8a890aa582b None admin] RBAC: Authorizing `identity:create_grant(project_id=fdd2d14c7e884b8b8f340183a79fd481, user_id=3f7d8a79945a4e73839cd2ad995e016b, role_id=5f0de9d8946f41e8a26d355448071297)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:52.694150 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c125e51-3f80-49eb-8f31-b8a890aa582b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:52.749444 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba44703-78f1-4066-b38d-54243c0e2c49 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:52.759784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 304/603] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:30:52 2022] PUT /identity/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/3f7d8a79945a4e73839cd2ad995e016b/roles/5f0de9d8946f41e8a26d355448071297 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:52.769847 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed792dd4-a636-4448-b80a-a8bff4b001d1 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:52.770126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed792dd4-a636-4448-b80a-a8bff4b001d1 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:52.770491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed792dd4-a636-4448-b80a-a8bff4b001d1 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:52.772196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 305/604] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:52 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:52.772853 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed792dd4-a636-4448-b80a-a8bff4b001d1 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:52.814040 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ea839-fe40-4147-9b69-b3873cc5683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:52.815700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ea839-fe40-4147-9b69-b3873cc5683e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:52.816514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ea839-fe40-4147-9b69-b3873cc5683e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:52.817218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ea839-fe40-4147-9b69-b3873cc5683e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:52.832388 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ea839-fe40-4147-9b69-b3873cc5683e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:52.835395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ea839-fe40-4147-9b69-b3873cc5683e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:52.860959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-fb2ea839-fe40-4147-9b69-b3873cc5683e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:52.860959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:52.860959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:52.860959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:52.860959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:52.860959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:52.860959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:52.860959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:52.860959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:52.860959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:52.860959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:52.860959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:52.860959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:30:52.860959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:30:52.860959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:52.863031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:52.865177 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:30:52.865177 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:30:52.865177 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:30:52.865177 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:30:52.865177 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:30:52.865177 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:30:52.865177 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:52.865177 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:52.868835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 300/605] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:52.871555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab25d21-93aa-4154-b41a-b2c146fa217d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:52.872337 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab25d21-93aa-4154-b41a-b2c146fa217d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:52.873262 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab25d21-93aa-4154-b41a-b2c146fa217d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:52.877055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:52.894790 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-5ab25d21-93aa-4154-b41a-b2c146fa217d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:52.896383 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-5ab25d21-93aa-4154-b41a-b2c146fa217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:52.934591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed792dd4-a636-4448-b80a-a8bff4b001d1 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:52.939592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:52.984856 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3ae94-034e-41aa-9f8f-15d44da00015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:52.985980 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3ae94-034e-41aa-9f8f-15d44da00015 None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:52.986356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3ae94-034e-41aa-9f8f-15d44da00015 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:52.986731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3ae94-034e-41aa-9f8f-15d44da00015 None admin] PATH_INFO: `/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/29b630aac21b405eb114f5f1fd1294ce/roles/5f0de9d8946f41e8a26d355448071297` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:52.993321 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 301/606] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:52.994536 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab25d21-93aa-4154-b41a-b2c146fa217d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:53.013854 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3ae94-034e-41aa-9f8f-15d44da00015 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdd2d14c7e884b8b8f340183a79fd481, user_id=29b630aac21b405eb114f5f1fd1294ce, role_id=5f0de9d8946f41e8a26d355448071297)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:53.016743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3ae94-034e-41aa-9f8f-15d44da00015 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:53.113901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 306/607] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:30:52 2022] PUT /identity/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/29b630aac21b405eb114f5f1fd1294ce/roles/5f0de9d8946f41e8a26d355448071297 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:53.131658 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab25d21-93aa-4154-b41a-b2c146fa217d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:53.176308 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce0cf2-51b7-42be-9c8b-a2a318056af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:53.176993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce0cf2-51b7-42be-9c8b-a2a318056af6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:53.177280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce0cf2-51b7-42be-9c8b-a2a318056af6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:53.177570 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce0cf2-51b7-42be-9c8b-a2a318056af6 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:53.178347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce0cf2-51b7-42be-9c8b-a2a318056af6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:53.178733 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce0cf2-51b7-42be-9c8b-a2a318056af6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:53.180379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce0cf2-51b7-42be-9c8b-a2a318056af6 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:53.195338 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 302/608] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:30:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:53.201077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3ae94-034e-41aa-9f8f-15d44da00015 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:53.324458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3ae94-034e-41aa-9f8f-15d44da00015 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:53.350042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:53.363332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce0cf2-51b7-42be-9c8b-a2a318056af6 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:53.364914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860347e-665d-4db0-8ea1-e8a4accff83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:53.365538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860347e-665d-4db0-8ea1-e8a4accff83f None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:53.365821 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860347e-665d-4db0-8ea1-e8a4accff83f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:53.366238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860347e-665d-4db0-8ea1-e8a4accff83f None admin] PATH_INFO: `/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/d8794e99a0024672974412ca4c045b63/roles/5f0de9d8946f41e8a26d355448071297` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:53.386757 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:53.388504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860347e-665d-4db0-8ea1-e8a4accff83f None admin] RBAC: Authorizing `identity:create_grant(project_id=fdd2d14c7e884b8b8f340183a79fd481, user_id=d8794e99a0024672974412ca4c045b63, role_id=5f0de9d8946f41e8a26d355448071297)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:53.390289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860347e-665d-4db0-8ea1-e8a4accff83f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:53.478728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 307/609] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:30:53 2022] PUT /identity/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/d8794e99a0024672974412ca4c045b63/roles/5f0de9d8946f41e8a26d355448071297 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:30:53.481415 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce0cf2-51b7-42be-9c8b-a2a318056af6 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:53.521791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f18a1-4dde-4f70-b29c-9aacf377f840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:53.522454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f18a1-4dde-4f70-b29c-9aacf377f840 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:53.522790 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f18a1-4dde-4f70-b29c-9aacf377f840 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:53.523126 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f18a1-4dde-4f70-b29c-9aacf377f840 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:53.536450 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f18a1-4dde-4f70-b29c-9aacf377f840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-080f18a1-4dde-4f70-b29c-9aacf377f840 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:53.541763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:53.542737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:53.543787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:53.543787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:53.543787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:53.543787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:53.543787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:53.543787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:53.543787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:53.543787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:53.543787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:53.543787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:53.543787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:53.543787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:53.543787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 303/610] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:30:53.549641 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860347e-665d-4db0-8ea1-e8a4accff83f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:53.690048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860347e-665d-4db0-8ea1-e8a4accff83f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:53.739780 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe80a3c-894f-420a-8374-4867fdd8868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:53.740426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe80a3c-894f-420a-8374-4867fdd8868b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:53.740707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe80a3c-894f-420a-8374-4867fdd8868b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:53.740979 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe80a3c-894f-420a-8374-4867fdd8868b None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:53.741643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe80a3c-894f-420a-8374-4867fdd8868b None admin] RBAC: Adding query filter params (name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:53.741945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe80a3c-894f-420a-8374-4867fdd8868b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:53.743333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe80a3c-894f-420a-8374-4867fdd8868b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:53.752546 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 308/611] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:30:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:53.758901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f18a1-4dde-4f70-b29c-9aacf377f840 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:53.896178 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:53.920856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f18a1-4dde-4f70-b29c-9aacf377f840 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:53.974252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8120c-2c96-4f34-8823-4c0b64be4ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:53.974830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8120c-2c96-4f34-8823-4c0b64be4ae0 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:53.975111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8120c-2c96-4f34-8823-4c0b64be4ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:53.975382 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8120c-2c96-4f34-8823-4c0b64be4ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:53.992057 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8120c-2c96-4f34-8823-4c0b64be4ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:53.994095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8120c-2c96-4f34-8823-4c0b64be4ae0 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-5bf8120c-2c96-4f34-8823-4c0b64be4ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:54.014770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:54.015769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:54.016690 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:54.016690 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:54.016690 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:54.018567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 304/612] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:54.026330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe80a3c-894f-420a-8374-4867fdd8868b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:54.091641 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:54.182995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe80a3c-894f-420a-8374-4867fdd8868b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:54.223779 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab223388-d0b9-466b-9afa-bc50aaa8fe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:54.224483 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab223388-d0b9-466b-9afa-bc50aaa8fe42 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:54.224709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab223388-d0b9-466b-9afa-bc50aaa8fe42 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:54.224983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab223388-d0b9-466b-9afa-bc50aaa8fe42 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:54.225639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab223388-d0b9-466b-9afa-bc50aaa8fe42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:54.225945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab223388-d0b9-466b-9afa-bc50aaa8fe42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:54.227341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab223388-d0b9-466b-9afa-bc50aaa8fe42 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:54.241326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 309/613] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:54.246883 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8120c-2c96-4f34-8823-4c0b64be4ae0 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:54.253195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e6345-6651-4056-8896-718b6831accc None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:54.253564 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e6345-6651-4056-8896-718b6831accc None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:54.253914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e6345-6651-4056-8896-718b6831accc None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:54.255713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 310/614] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:54.260997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53395c0e-93e9-40e7-9c6f-f9b052c6302f None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:54.261352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53395c0e-93e9-40e7-9c6f-f9b052c6302f None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:54.261694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53395c0e-93e9-40e7-9c6f-f9b052c6302f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:54.289901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-53395c0e-93e9-40e7-9c6f-f9b052c6302f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:54.292547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-53395c0e-93e9-40e7-9c6f-f9b052c6302f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:54.437367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 311/615] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:30:54.472518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8120c-2c96-4f34-8823-4c0b64be4ae0 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:54.515328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:54.530524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909ed9a-d76f-4896-b185-7c1605393c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:54.531193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909ed9a-d76f-4896-b185-7c1605393c7f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:54.531475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909ed9a-d76f-4896-b185-7c1605393c7f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:54.531745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909ed9a-d76f-4896-b185-7c1605393c7f None admin] PATH_INFO: `/v3/users/swift` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:54.542808 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909ed9a-d76f-4896-b185-7c1605393c7f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:54.544851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909ed9a-d76f-4896-b185-7c1605393c7f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-4909ed9a-d76f-4896-b185-7c1605393c7f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:30:54.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:54.565022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:54.566843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:54.566843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:54.566843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:30:54.566843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:30:54.566843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:30:54.566843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:30:54.566843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:30:54.566843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:30:54.566843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:30:54.566843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:54.566843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 305/616] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:30:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:54.573905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53395c0e-93e9-40e7-9c6f-f9b052c6302f None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:54.626516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:54.726892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53395c0e-93e9-40e7-9c6f-f9b052c6302f None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:54.775612 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba81e1-2097-480b-b64b-c648bc99c60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:54.776192 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba81e1-2097-480b-b64b-c648bc99c60d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:54.776473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba81e1-2097-480b-b64b-c648bc99c60d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:54.776746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba81e1-2097-480b-b64b-c648bc99c60d None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:54.777489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba81e1-2097-480b-b64b-c648bc99c60d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:54.777793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba81e1-2097-480b-b64b-c648bc99c60d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:54.779843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba81e1-2097-480b-b64b-c648bc99c60d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:54.807803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 312/617] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Aug 29 22:30:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:54.813470 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909ed9a-d76f-4896-b185-7c1605393c7f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:54.906045 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba81e1-2097-480b-b64b-c648bc99c60d None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:54.968560 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909ed9a-d76f-4896-b185-7c1605393c7f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:55.017794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba81e1-2097-480b-b64b-c648bc99c60d None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:55.040669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:55.065190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd97c7b-11d2-4358-bb69-90a22dad4a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:55.065851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd97c7b-11d2-4358-bb69-90a22dad4a0a None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:55.066128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd97c7b-11d2-4358-bb69-90a22dad4a0a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:55.066398 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd97c7b-11d2-4358-bb69-90a22dad4a0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:55.067056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6498e8-6444-424f-9b4f-b31b758bef3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:55.067954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6498e8-6444-424f-9b4f-b31b758bef3b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:55.069918 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6498e8-6444-424f-9b4f-b31b758bef3b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:55.076124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6498e8-6444-424f-9b4f-b31b758bef3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:55.079434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd97c7b-11d2-4358-bb69-90a22dad4a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:55.081122 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd97c7b-11d2-4358-bb69-90a22dad4a0a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-7dd97c7b-11d2-4358-bb69-90a22dad4a0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:55.100773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:55.102183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:55.103402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:55.103402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:55.103402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:55.103631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6498e8-6444-424f-9b4f-b31b758bef3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-2a6498e8-6444-424f-9b4f-b31b758bef3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:55.112515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:55.113682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:55.114788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:55.114788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:55.114788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:55.114788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:55.114788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:55.114788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:55.114788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:55.114788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:55.114788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:55.114788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:55.114788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:55.114788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:55.115507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 306/618] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:55.115507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd97c7b-11d2-4358-bb69-90a22dad4a0a None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:55.117720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 313/619] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:30:55.124117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6498e8-6444-424f-9b4f-b31b758bef3b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:55.216761 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:55.307323 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd97c7b-11d2-4358-bb69-90a22dad4a0a None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:55.307522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6498e8-6444-424f-9b4f-b31b758bef3b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:55.343803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe652b7f-febd-4549-8c3e-a4d6363c6955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:55.344608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe652b7f-febd-4549-8c3e-a4d6363c6955 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:55.344989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe652b7f-febd-4549-8c3e-a4d6363c6955 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:55.345394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe652b7f-febd-4549-8c3e-a4d6363c6955 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:55.346129 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe652b7f-febd-4549-8c3e-a4d6363c6955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:55.346537 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe652b7f-febd-4549-8c3e-a4d6363c6955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:55.348066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe652b7f-febd-4549-8c3e-a4d6363c6955 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:55.349178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d1dd0-caad-4cb7-b12b-84f46b0c7d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:55.349778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d1dd0-caad-4cb7-b12b-84f46b0c7d21 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:55.350055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d1dd0-caad-4cb7-b12b-84f46b0c7d21 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:55.350325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d1dd0-caad-4cb7-b12b-84f46b0c7d21 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:55.350985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d1dd0-caad-4cb7-b12b-84f46b0c7d21 None admin] RBAC: Adding query filter params (name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:55.351284 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d1dd0-caad-4cb7-b12b-84f46b0c7d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:55.352802 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d1dd0-caad-4cb7-b12b-84f46b0c7d21 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:55.368254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 307/620] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:55.368466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 314/621] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:30:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:55.368466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08296972-ca84-4c54-9761-2035adc82a37 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:55.368466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08296972-ca84-4c54-9761-2035adc82a37 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:55.368466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08296972-ca84-4c54-9761-2035adc82a37 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:55.368466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 315/622] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:55.368466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08296972-ca84-4c54-9761-2035adc82a37 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:55.368953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85638a9-269b-4ae2-85c0-8f19cfc35755 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:55.368953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85638a9-269b-4ae2-85c0-8f19cfc35755 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:55.368953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85638a9-269b-4ae2-85c0-8f19cfc35755 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:55.370069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 308/623] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:55.370873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85638a9-269b-4ae2-85c0-8f19cfc35755 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:55.374455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:55.480379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08296972-ca84-4c54-9761-2035adc82a37 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:55.481988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85638a9-269b-4ae2-85c0-8f19cfc35755 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:55.485398 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:55.516720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2c645-8a44-4210-9393-9375e02b9f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:55.517434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2c645-8a44-4210-9393-9375e02b9f30 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:55.517733 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2c645-8a44-4210-9393-9375e02b9f30 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:55.518009 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2c645-8a44-4210-9393-9375e02b9f30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:55.519473 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078719ca-80cc-4c48-bc72-cc5cb9d3d866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:55.520218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078719ca-80cc-4c48-bc72-cc5cb9d3d866 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:55.520501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078719ca-80cc-4c48-bc72-cc5cb9d3d866 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:55.520775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078719ca-80cc-4c48-bc72-cc5cb9d3d866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:55.525419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2c645-8a44-4210-9393-9375e02b9f30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:55.526849 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2c645-8a44-4210-9393-9375e02b9f30 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:55.532978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078719ca-80cc-4c48-bc72-cc5cb9d3d866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:55.534416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078719ca-80cc-4c48-bc72-cc5cb9d3d866 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:55.538863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-13f2c645-8a44-4210-9393-9375e02b9f30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:55.538863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:55.538863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:55.538863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:55.538863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:55.538863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:55.538863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:55.538863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:55.538863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:55.538863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:55.538863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:55.538863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:55.538863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:30:55.538863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:30:55.538863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:55.539788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:55.545897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:30:55.545897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:30:55.545897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:30:55.545897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:30:55.545897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:30:55.545897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:30:55.545897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:55.545897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:55.545897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 316/624] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:55.545897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf278c4f-d394-4957-b758-68f6fda99868 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:55.545897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf278c4f-d394-4957-b758-68f6fda99868 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:55.546538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf278c4f-d394-4957-b758-68f6fda99868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-078719ca-80cc-4c48-bc72-cc5cb9d3d866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:55.556635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:55.557691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:55.559067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:55.559067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:55.559067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:55.559067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 309/625] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:55.559067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6b857-9f9c-4f66-b694-3182231c3923 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:55.559773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6b857-9f9c-4f66-b694-3182231c3923 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:55.559773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6b857-9f9c-4f66-b694-3182231c3923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:55.566886 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-bf278c4f-d394-4957-b758-68f6fda99868 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:55.568155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-bf278c4f-d394-4957-b758-68f6fda99868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:55.578545 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-15a6b857-9f9c-4f66-b694-3182231c3923 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:55.579723 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-15a6b857-9f9c-4f66-b694-3182231c3923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:55.638012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:55.646888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 317/626] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:55.665032 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf278c4f-d394-4957-b758-68f6fda99868 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:55.670659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 310/627] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:55.672071 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6b857-9f9c-4f66-b694-3182231c3923 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:55.751892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf278c4f-d394-4957-b758-68f6fda99868 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:55.787668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700783c-6486-4e37-81ec-2dac1a107fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:55.788651 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700783c-6486-4e37-81ec-2dac1a107fa3 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:55.789126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700783c-6486-4e37-81ec-2dac1a107fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:55.789579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700783c-6486-4e37-81ec-2dac1a107fa3 None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:55.790521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700783c-6486-4e37-81ec-2dac1a107fa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:55.791018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700783c-6486-4e37-81ec-2dac1a107fa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:55.792643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700783c-6486-4e37-81ec-2dac1a107fa3 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:55.806331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 318/628] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:30:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:55.813266 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700783c-6486-4e37-81ec-2dac1a107fa3 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:55.835407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:55.870403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6b857-9f9c-4f66-b694-3182231c3923 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:55.890869 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:55.924730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71eae86-3170-4e08-bb17-6d7f73ae5927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:55.925347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eae86-3170-4e08-bb17-6d7f73ae5927 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:55.925634 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eae86-3170-4e08-bb17-6d7f73ae5927 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:55.925966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eae86-3170-4e08-bb17-6d7f73ae5927 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:55.926680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71eae86-3170-4e08-bb17-6d7f73ae5927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:55.926996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71eae86-3170-4e08-bb17-6d7f73ae5927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:55.928435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71eae86-3170-4e08-bb17-6d7f73ae5927 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:55.941268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 311/629] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:55.952110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71eae86-3170-4e08-bb17-6d7f73ae5927 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:55.982323 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700783c-6486-4e37-81ec-2dac1a107fa3 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:56.021199 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaecf7-e564-4684-8db6-a1ad94b229cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:56.021868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaecf7-e564-4684-8db6-a1ad94b229cf None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.022161 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaecf7-e564-4684-8db6-a1ad94b229cf None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.022424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaecf7-e564-4684-8db6-a1ad94b229cf None admin] PATH_INFO: `/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/a8cccf561d484373a7cb24c5f111900c/roles/5f0de9d8946f41e8a26d355448071297` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:56.038947 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadaecf7-e564-4684-8db6-a1ad94b229cf None admin] RBAC: Authorizing `identity:create_grant(project_id=fdd2d14c7e884b8b8f340183a79fd481, user_id=a8cccf561d484373a7cb24c5f111900c, role_id=5f0de9d8946f41e8a26d355448071297)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:56.040428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadaecf7-e564-4684-8db6-a1ad94b229cf None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:56.071472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71eae86-3170-4e08-bb17-6d7f73ae5927 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:56.105919 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddd1ff-edba-4686-b203-bbee4fa7e221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:56.107192 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddd1ff-edba-4686-b203-bbee4fa7e221 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.107476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddd1ff-edba-4686-b203-bbee4fa7e221 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.107745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddd1ff-edba-4686-b203-bbee4fa7e221 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:56.115222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddd1ff-edba-4686-b203-bbee4fa7e221 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:56.116679 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddd1ff-edba-4686-b203-bbee4fa7e221 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-9eddd1ff-edba-4686-b203-bbee4fa7e221 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:30:56.127970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:56.141149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:56.142290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:56.142290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:56.142290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:30:56.142290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:30:56.142290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:30:56.142290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:30:56.142290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:30:56.142290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:30:56.142290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:30:56.142290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:56.142290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 312/630] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 29 22:30:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:56.142290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be72dd5-34c8-47d3-9007-e0b55208f92e None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.143089 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 319/631] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:30:55 2022] PUT /identity/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/a8cccf561d484373a7cb24c5f111900c/roles/5f0de9d8946f41e8a26d355448071297 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:30:56.143524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be72dd5-34c8-47d3-9007-e0b55208f92e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.143524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be72dd5-34c8-47d3-9007-e0b55208f92e None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:56.143672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaecf7-e564-4684-8db6-a1ad94b229cf None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:56.143748 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 313/632] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:56.143748 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be72dd5-34c8-47d3-9007-e0b55208f92e None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:56.152989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:56.260069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaecf7-e564-4684-8db6-a1ad94b229cf None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:56.262686 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:56.273555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be72dd5-34c8-47d3-9007-e0b55208f92e None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:56.302707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291d829-526b-4399-8255-e99eeff132cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:56.306409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d829-526b-4399-8255-e99eeff132cf None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.306409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d829-526b-4399-8255-e99eeff132cf None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.306409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d829-526b-4399-8255-e99eeff132cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:56.314474 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac0aaf-8000-4609-8f9e-e8da03561d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:56.315376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac0aaf-8000-4609-8f9e-e8da03561d96 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.315515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291d829-526b-4399-8255-e99eeff132cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:56.315965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac0aaf-8000-4609-8f9e-e8da03561d96 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.316468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac0aaf-8000-4609-8f9e-e8da03561d96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-a291d829-526b-4399-8255-e99eeff132cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:56.320804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:56.321957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:56.322928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:56.322928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:56.322928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:56.322928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:56.322928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:56.322928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:56.322928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:56.322928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:56.322928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:56.322928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:56.322928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:56.322928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:56.322928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 320/633] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:56.322928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291d829-526b-4399-8255-e99eeff132cf None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:56.334360 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac0aaf-8000-4609-8f9e-e8da03561d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-92ac0aaf-8000-4609-8f9e-e8da03561d96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:56.339775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:56.340859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:56.342452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:56.342452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:56.342452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:56.342452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:56.342452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:56.342452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:56.342452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:56.342452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:56.342452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:56.342452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:56.342452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:56.342452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:56.342452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 314/634] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:56.343230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfeb47a-b2cb-4b1a-a8a6-d14839f18384 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.343230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfeb47a-b2cb-4b1a-a8a6-d14839f18384 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.343366 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfeb47a-b2cb-4b1a-a8a6-d14839f18384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:56.362125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-7bfeb47a-b2cb-4b1a-a8a6-d14839f18384 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:56.363261 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-7bfeb47a-b2cb-4b1a-a8a6-d14839f18384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:56.439230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:56.456122 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 315/635] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:56.456122 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfeb47a-b2cb-4b1a-a8a6-d14839f18384 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:56.471460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291d829-526b-4399-8255-e99eeff132cf None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:56.509526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcc6af-a946-4cd6-b0c6-6781c450e6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:56.510295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcc6af-a946-4cd6-b0c6-6781c450e6bb None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.510579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcc6af-a946-4cd6-b0c6-6781c450e6bb None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.510950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcc6af-a946-4cd6-b0c6-6781c450e6bb None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:56.511824 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcc6af-a946-4cd6-b0c6-6781c450e6bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:56.512248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcc6af-a946-4cd6-b0c6-6781c450e6bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:56.514326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcc6af-a946-4cd6-b0c6-6781c450e6bb None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:56.540178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 321/636] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 29 22:30:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:56.541232 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcc6af-a946-4cd6-b0c6-6781c450e6bb None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:56.572835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfeb47a-b2cb-4b1a-a8a6-d14839f18384 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:56.576222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:56.635018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c46517-ab2b-4fc2-8f03-63fec2957873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:56.635859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c46517-ab2b-4fc2-8f03-63fec2957873 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.636304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c46517-ab2b-4fc2-8f03-63fec2957873 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.636675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c46517-ab2b-4fc2-8f03-63fec2957873 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:56.637623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c46517-ab2b-4fc2-8f03-63fec2957873 None admin] RBAC: Adding query filter params (name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:56.638067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c46517-ab2b-4fc2-8f03-63fec2957873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:56.639702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c46517-ab2b-4fc2-8f03-63fec2957873 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:56.649634 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 316/637] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:30:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:56.650740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c46517-ab2b-4fc2-8f03-63fec2957873 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:56.679847 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcc6af-a946-4cd6-b0c6-6781c450e6bb None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:56.719550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49b468-ce73-4a46-b40a-0d25fa4a8869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:56.720350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49b468-ce73-4a46-b40a-0d25fa4a8869 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.720639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49b468-ce73-4a46-b40a-0d25fa4a8869 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.720918 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49b468-ce73-4a46-b40a-0d25fa4a8869 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:56.721602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49b468-ce73-4a46-b40a-0d25fa4a8869 None admin] RBAC: Adding query filter params (name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:56.721911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49b468-ce73-4a46-b40a-0d25fa4a8869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:56.723843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49b468-ce73-4a46-b40a-0d25fa4a8869 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:56.736108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:56.736378 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 322/638] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:30:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:56.736974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49b468-ce73-4a46-b40a-0d25fa4a8869 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:56.812073 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c46517-ab2b-4fc2-8f03-63fec2957873 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:56.831246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:56.848102 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49b468-ce73-4a46-b40a-0d25fa4a8869 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:56.848266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d174f2-f00f-447e-a1fb-cd14821fa929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:56.848719 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d174f2-f00f-447e-a1fb-cd14821fa929 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.849005 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d174f2-f00f-447e-a1fb-cd14821fa929 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.849278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d174f2-f00f-447e-a1fb-cd14821fa929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:56.885125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99906abd-06df-45ff-8584-3bee949e1229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:56.885752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99906abd-06df-45ff-8584-3bee949e1229 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:56.886028 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99906abd-06df-45ff-8584-3bee949e1229 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:56.886298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99906abd-06df-45ff-8584-3bee949e1229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:56.897874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99906abd-06df-45ff-8584-3bee949e1229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:56.899668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99906abd-06df-45ff-8584-3bee949e1229 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-99906abd-06df-45ff-8584-3bee949e1229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:56.917250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:56.918313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:56.919415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:56.919415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:56.919415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:56.919415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 323/639] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:56.920241 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99906abd-06df-45ff-8584-3bee949e1229 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:56.927221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d174f2-f00f-447e-a1fb-cd14821fa929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:56.928737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d174f2-f00f-447e-a1fb-cd14821fa929 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:56.992945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:57.039889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99906abd-06df-45ff-8584-3bee949e1229 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:57.048563 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 317/640] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:57.050469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d174f2-f00f-447e-a1fb-cd14821fa929 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:57.079892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ff8de-5ce6-44ed-ba94-d56e6f6f10ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:57.080559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ff8de-5ce6-44ed-ba94-d56e6f6f10ea None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:57.080841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ff8de-5ce6-44ed-ba94-d56e6f6f10ea None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:57.081127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ff8de-5ce6-44ed-ba94-d56e6f6f10ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:57.086937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:57.099061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ff8de-5ce6-44ed-ba94-d56e6f6f10ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:57.100924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ff8de-5ce6-44ed-ba94-d56e6f6f10ea None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-b54ff8de-5ce6-44ed-ba94-d56e6f6f10ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:57.116424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:57.117430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:57.118307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:57.118307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:57.118307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:57.120732 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 324/641] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:57.121788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ff8de-5ce6-44ed-ba94-d56e6f6f10ea None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:57.181912 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d174f2-f00f-447e-a1fb-cd14821fa929 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:57.221720 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e083-fcf4-46fe-b14d-cf5736f10306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:57.222357 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e083-fcf4-46fe-b14d-cf5736f10306 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:57.222638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e083-fcf4-46fe-b14d-cf5736f10306 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:57.222915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e083-fcf4-46fe-b14d-cf5736f10306 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:57.234673 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3e083-fcf4-46fe-b14d-cf5736f10306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:57.236973 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ff8de-5ce6-44ed-ba94-d56e6f6f10ea None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-e6c3e083-fcf4-46fe-b14d-cf5736f10306 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:57.239860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:57.241146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:57.242480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:57.242480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:57.242480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:57.242480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:57.242480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:57.242480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:57.242480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:57.242480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:57.242480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:57.242480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:57.242480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:57.242480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:57.242480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 318/642] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:57.242480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e083-fcf4-46fe-b14d-cf5736f10306 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:57.271092 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:57.281798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4f19d-76fd-4251-9454-5ed51fcba79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:57.286486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4f19d-76fd-4251-9454-5ed51fcba79c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:57.286486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4f19d-76fd-4251-9454-5ed51fcba79c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:57.286486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4f19d-76fd-4251-9454-5ed51fcba79c None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:57.286486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4f19d-76fd-4251-9454-5ed51fcba79c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:57.286486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4f19d-76fd-4251-9454-5ed51fcba79c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:57.286486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4f19d-76fd-4251-9454-5ed51fcba79c None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:57.298047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 325/643] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:57.298948 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4f19d-76fd-4251-9454-5ed51fcba79c None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:57.353201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:57.367389 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e083-fcf4-46fe-b14d-cf5736f10306 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:57.404427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e36218-6ffc-4ae9-959a-e1f302127418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:57.405073 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e36218-6ffc-4ae9-959a-e1f302127418 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:57.405353 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e36218-6ffc-4ae9-959a-e1f302127418 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:57.405622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e36218-6ffc-4ae9-959a-e1f302127418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:57.410611 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4f19d-76fd-4251-9454-5ed51fcba79c None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:57.416494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e36218-6ffc-4ae9-959a-e1f302127418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:57.418263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e36218-6ffc-4ae9-959a-e1f302127418 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-f1e36218-6ffc-4ae9-959a-e1f302127418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:57.435613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:57.437550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:57.439643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:57.439643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:57.439643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:57.441501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 319/644] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:57.442467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e36218-6ffc-4ae9-959a-e1f302127418 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:57.457738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9b461-6831-4111-87c6-f15c3b994422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:57.458745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9b461-6831-4111-87c6-f15c3b994422 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:57.458745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9b461-6831-4111-87c6-f15c3b994422 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:57.458954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9b461-6831-4111-87c6-f15c3b994422 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:57.459627 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9b461-6831-4111-87c6-f15c3b994422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:57.459939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9b461-6831-4111-87c6-f15c3b994422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:57.461571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9b461-6831-4111-87c6-f15c3b994422 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:57.476013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 326/645] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:57.477277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9b461-6831-4111-87c6-f15c3b994422 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:57.532829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:57.568240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e36218-6ffc-4ae9-959a-e1f302127418 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:57.601531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9b461-6831-4111-87c6-f15c3b994422 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:57.616753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad8c26-68d4-467e-b7a0-e46ac960ba6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:57.617525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad8c26-68d4-467e-b7a0-e46ac960ba6c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:57.617525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad8c26-68d4-467e-b7a0-e46ac960ba6c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:57.617805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad8c26-68d4-467e-b7a0-e46ac960ba6c None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:57.618475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad8c26-68d4-467e-b7a0-e46ac960ba6c None admin] RBAC: Adding query filter params (name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:57.618777 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad8c26-68d4-467e-b7a0-e46ac960ba6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:57.620201 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad8c26-68d4-467e-b7a0-e46ac960ba6c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:57.621225 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:57.629840 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 320/646] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:30:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:57.632712 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad8c26-68d4-467e-b7a0-e46ac960ba6c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:57.657027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e80003-524a-418f-8634-6064c50eb4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:57.658298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e80003-524a-418f-8634-6064c50eb4a8 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:57.658788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e80003-524a-418f-8634-6064c50eb4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:57.659492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e80003-524a-418f-8634-6064c50eb4a8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:57.671942 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e80003-524a-418f-8634-6064c50eb4a8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:57.673539 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e80003-524a-418f-8634-6064c50eb4a8 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-21e80003-524a-418f-8634-6064c50eb4a8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:30:57.686522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:57.687591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:57.689202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:57.689202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:57.689202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:30:57.689202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:30:57.689202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:30:57.689202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:30:57.689202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:30:57.689202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:30:57.689202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:30:57.689202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:57.689202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 327/647] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:57.689202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e80003-524a-418f-8634-6064c50eb4a8 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:57.751581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad8c26-68d4-467e-b7a0-e46ac960ba6c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:57.789865 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:57.795936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf150b93-444d-4806-b060-bb57ba2d208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:57.796608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf150b93-444d-4806-b060-bb57ba2d208f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:57.796892 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf150b93-444d-4806-b060-bb57ba2d208f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:57.798660 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf150b93-444d-4806-b060-bb57ba2d208f None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:57.798660 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf150b93-444d-4806-b060-bb57ba2d208f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:57.798660 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf150b93-444d-4806-b060-bb57ba2d208f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:57.799769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf150b93-444d-4806-b060-bb57ba2d208f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:57.812987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e80003-524a-418f-8634-6064c50eb4a8 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:57.819554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 321/648] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:57.820824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf150b93-444d-4806-b060-bb57ba2d208f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:57.854798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216f2a3-527a-424f-a4c7-9c00b6405dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:57.855435 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216f2a3-527a-424f-a4c7-9c00b6405dd1 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:57.855718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216f2a3-527a-424f-a4c7-9c00b6405dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:57.855991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216f2a3-527a-424f-a4c7-9c00b6405dd1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:57.864364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216f2a3-527a-424f-a4c7-9c00b6405dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:57.865955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216f2a3-527a-424f-a4c7-9c00b6405dd1 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-a216f2a3-527a-424f-a4c7-9c00b6405dd1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:30:57.878643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:57.879621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:57.880997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:57.880997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:57.880997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:30:57.880997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:30:57.880997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:30:57.880997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:30:57.880997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:30:57.880997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:30:57.880997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:30:57.880997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:57.880997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 328/649] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:30:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:57.880997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216f2a3-527a-424f-a4c7-9c00b6405dd1 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:57.916269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:57.955213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf150b93-444d-4806-b060-bb57ba2d208f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:57.993590 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2206f-ae64-46ea-a53d-1e2287ca39b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:57.994266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2206f-ae64-46ea-a53d-1e2287ca39b6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:57.994527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2206f-ae64-46ea-a53d-1e2287ca39b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:57.994796 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2206f-ae64-46ea-a53d-1e2287ca39b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:58.006791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2206f-ae64-46ea-a53d-1e2287ca39b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:58.008281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2206f-ae64-46ea-a53d-1e2287ca39b6 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:58.016773 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216f2a3-527a-424f-a4c7-9c00b6405dd1 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-f4b2206f-ae64-46ea-a53d-1e2287ca39b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:58.025379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:58.026361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:58.027270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:58.027270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:58.027270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:58.027270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 322/650] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:58.027520 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2206f-ae64-46ea-a53d-1e2287ca39b6 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:58.077162 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:58.080124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8966de-6488-4984-afeb-c0fcfce5e0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:58.081058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8966de-6488-4984-afeb-c0fcfce5e0a9 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:58.081539 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8966de-6488-4984-afeb-c0fcfce5e0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:58.082043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8966de-6488-4984-afeb-c0fcfce5e0a9 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:58.083220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8966de-6488-4984-afeb-c0fcfce5e0a9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:58.083783 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8966de-6488-4984-afeb-c0fcfce5e0a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:58.086638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8966de-6488-4984-afeb-c0fcfce5e0a9 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:58.119367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 329/651] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Aug 29 22:30:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:58.120795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8966de-6488-4984-afeb-c0fcfce5e0a9 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:58.148609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2206f-ae64-46ea-a53d-1e2287ca39b6 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:58.188962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380243b9-8a97-44cc-b8b2-bb2cafd761a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:58.189608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380243b9-8a97-44cc-b8b2-bb2cafd761a4 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:58.189885 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380243b9-8a97-44cc-b8b2-bb2cafd761a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:58.190159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380243b9-8a97-44cc-b8b2-bb2cafd761a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:58.198411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380243b9-8a97-44cc-b8b2-bb2cafd761a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:58.199557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380243b9-8a97-44cc-b8b2-bb2cafd761a4 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:58.212213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-380243b9-8a97-44cc-b8b2-bb2cafd761a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:58.212213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:58.212213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:58.212213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:58.212213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:58.212213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:58.212213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:58.212213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:58.212213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:58.212213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:58.212213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:58.212213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:58.212213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:30:58.212213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:30:58.212213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:58.213457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:58.214346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:30:58.214346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:30:58.214346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:30:58.214346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:30:58.214346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:30:58.214346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:30:58.214346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:30:58.214346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:58.214346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 323/652] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:58.214830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380243b9-8a97-44cc-b8b2-bb2cafd761a4 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:58.236146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:58.250930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8966de-6488-4984-afeb-c0fcfce5e0a9 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:58.287871 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb3d28-ba57-493c-b46b-f082a03fbb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:58.288512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb3d28-ba57-493c-b46b-f082a03fbb96 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:58.288790 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb3d28-ba57-493c-b46b-f082a03fbb96 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:58.289060 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb3d28-ba57-493c-b46b-f082a03fbb96 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:58.289792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb3d28-ba57-493c-b46b-f082a03fbb96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:58.290094 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb3d28-ba57-493c-b46b-f082a03fbb96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:58.291535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb3d28-ba57-493c-b46b-f082a03fbb96 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:58.310834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 330/653] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Aug 29 22:30:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:58.312115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33c5e5-7d10-4a3d-a8c7-7bbb84ebe4f1 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:58.312411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33c5e5-7d10-4a3d-a8c7-7bbb84ebe4f1 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:58.312680 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33c5e5-7d10-4a3d-a8c7-7bbb84ebe4f1 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:58.313905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 331/654] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:30:58.314595 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33c5e5-7d10-4a3d-a8c7-7bbb84ebe4f1 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:58.335105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380243b9-8a97-44cc-b8b2-bb2cafd761a4 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:58.337969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:58.373403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aee6c7-fa30-4e6f-8fb8-c4518dbc26ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:58.374028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aee6c7-fa30-4e6f-8fb8-c4518dbc26ac None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:58.374376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aee6c7-fa30-4e6f-8fb8-c4518dbc26ac None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:58.374894 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aee6c7-fa30-4e6f-8fb8-c4518dbc26ac None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:58.375760 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aee6c7-fa30-4e6f-8fb8-c4518dbc26ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:58.376422 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aee6c7-fa30-4e6f-8fb8-c4518dbc26ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:58.377841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aee6c7-fa30-4e6f-8fb8-c4518dbc26ac None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:58.390450 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 324/655] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:58.391518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aee6c7-fa30-4e6f-8fb8-c4518dbc26ac None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:58.432370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33c5e5-7d10-4a3d-a8c7-7bbb84ebe4f1 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:58.469407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2780b-e88a-47c9-bd38-b330dec1273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:58.470026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2780b-e88a-47c9-bd38-b330dec1273d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:58.470312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2780b-e88a-47c9-bd38-b330dec1273d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:58.470588 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2780b-e88a-47c9-bd38-b330dec1273d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:58.487335 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:58.500659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aee6c7-fa30-4e6f-8fb8-c4518dbc26ac None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:58.536976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4606d4-2f79-4f47-ab73-bfeeb2aa8d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:58.537860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4606d4-2f79-4f47-ab73-bfeeb2aa8d46 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:58.538004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4606d4-2f79-4f47-ab73-bfeeb2aa8d46 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:58.538293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4606d4-2f79-4f47-ab73-bfeeb2aa8d46 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:58.538998 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4606d4-2f79-4f47-ab73-bfeeb2aa8d46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:58.539304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4606d4-2f79-4f47-ab73-bfeeb2aa8d46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:58.540802 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4606d4-2f79-4f47-ab73-bfeeb2aa8d46 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:58.543391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2780b-e88a-47c9-bd38-b330dec1273d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:58.545354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2780b-e88a-47c9-bd38-b330dec1273d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:58.554048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 325/656] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:30:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:58.554874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4606d4-2f79-4f47-ab73-bfeeb2aa8d46 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:58.580397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:58.649637 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 332/657] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:58.650926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0d22-d1f9-478c-9759-1f5da9c910bd None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:58.651212 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0d22-d1f9-478c-9759-1f5da9c910bd None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:58.651513 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0d22-d1f9-478c-9759-1f5da9c910bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:58.663716 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4606d4-2f79-4f47-ab73-bfeeb2aa8d46 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:58.670746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-f6eb0d22-d1f9-478c-9759-1f5da9c910bd None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:30:58.671968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-f6eb0d22-d1f9-478c-9759-1f5da9c910bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:30:58.701123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b11510-564a-4e04-b371-d5a5962063bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:58.701655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b11510-564a-4e04-b371-d5a5962063bb None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:58.701939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b11510-564a-4e04-b371-d5a5962063bb None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:58.702230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b11510-564a-4e04-b371-d5a5962063bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:58.719093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:58.746154 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 333/658] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:30:58.747652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb0d22-d1f9-478c-9759-1f5da9c910bd None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:58.774667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b11510-564a-4e04-b371-d5a5962063bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:58.776836 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b11510-564a-4e04-b371-d5a5962063bb None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:58.816859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:58.877295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb0d22-d1f9-478c-9759-1f5da9c910bd None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:58.910135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 326/659] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:30:58.910135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b11510-564a-4e04-b371-d5a5962063bb None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:58.920752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf13ca9-f626-44f7-8a70-05e841843d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:58.921523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf13ca9-f626-44f7-8a70-05e841843d13 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:58.921873 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf13ca9-f626-44f7-8a70-05e841843d13 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:58.922154 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf13ca9-f626-44f7-8a70-05e841843d13 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:58.930221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf13ca9-f626-44f7-8a70-05e841843d13 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:58.931717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf13ca9-f626-44f7-8a70-05e841843d13 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-daf13ca9-f626-44f7-8a70-05e841843d13 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:30:58.943751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:58.945084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:58.946343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:58.946343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:58.946343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:30:58.946343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:30:58.946343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:30:58.946343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:30:58.946343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:30:58.946343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:30:58.946343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:30:58.946343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:58.946343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 334/660] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:58.946343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf13ca9-f626-44f7-8a70-05e841843d13 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:58.982652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:59.022949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b11510-564a-4e04-b371-d5a5962063bb None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:59.047916 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:59.061036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b3453-6478-413b-93e9-3ba15655aecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:59.061267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf13ca9-f626-44f7-8a70-05e841843d13 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:59.061646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b3453-6478-413b-93e9-3ba15655aecc None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:59.061996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b3453-6478-413b-93e9-3ba15655aecc None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:59.062285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b3453-6478-413b-93e9-3ba15655aecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:59.062978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b3453-6478-413b-93e9-3ba15655aecc None admin] RBAC: Adding query filter params (role.id=5f0de9d8946f41e8a26d355448071297, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=f06d910badb84c6aa6b48f3b56b91f82) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:59.063286 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b3453-6478-413b-93e9-3ba15655aecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:59.064784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b3453-6478-413b-93e9-3ba15655aecc None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:59.070969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 327/661] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:30:58 2022] GET /identity/v3/role_assignments?user.id=f06d910badb84c6aa6b48f3b56b91f82&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=5f0de9d8946f41e8a26d355448071297 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:59.071869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b3453-6478-413b-93e9-3ba15655aecc None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:59.100584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204a402-4b04-4e4f-9dc7-fdf84089ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:59.101247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204a402-4b04-4e4f-9dc7-fdf84089ff14 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:59.101561 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204a402-4b04-4e4f-9dc7-fdf84089ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:59.101838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204a402-4b04-4e4f-9dc7-fdf84089ff14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:59.115582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204a402-4b04-4e4f-9dc7-fdf84089ff14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:59.117128 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204a402-4b04-4e4f-9dc7-fdf84089ff14 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-a204a402-4b04-4e4f-9dc7-fdf84089ff14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:59.134330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:59.135374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:59.136368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:59.136368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:59.136368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:30:59.136368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 335/662] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:59.137268 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204a402-4b04-4e4f-9dc7-fdf84089ff14 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:59.210875 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b3453-6478-413b-93e9-3ba15655aecc None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:59.249537 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:59.257232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bae34-9e6d-4943-b14f-2b7e9e29d61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:59.258190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bae34-9e6d-4943-b14f-2b7e9e29d61b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:59.258477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bae34-9e6d-4943-b14f-2b7e9e29d61b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:59.267892 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bae34-9e6d-4943-b14f-2b7e9e29d61b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:59.268059 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204a402-4b04-4e4f-9dc7-fdf84089ff14 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:59.272256 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bae34-9e6d-4943-b14f-2b7e9e29d61b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:59.274078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bae34-9e6d-4943-b14f-2b7e9e29d61b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-d99bae34-9e6d-4943-b14f-2b7e9e29d61b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:30:59.292655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:59.294977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:30:59.296336 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:30:59.296336 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:30:59.296336 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:59.299295 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 328/663] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:59.300646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bae34-9e6d-4943-b14f-2b7e9e29d61b None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:59.322817 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08472267-c550-44bf-8e9a-184b0665d405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:59.323444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08472267-c550-44bf-8e9a-184b0665d405 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:59.323736 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08472267-c550-44bf-8e9a-184b0665d405 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:59.323994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08472267-c550-44bf-8e9a-184b0665d405 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:59.324956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08472267-c550-44bf-8e9a-184b0665d405 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:59.325109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08472267-c550-44bf-8e9a-184b0665d405 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:59.327422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08472267-c550-44bf-8e9a-184b0665d405 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:59.350318 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 336/664] 10.222.0.62 () {56 vars in 1139 bytes} [Mon Aug 29 22:30:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:59.352150 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08472267-c550-44bf-8e9a-184b0665d405 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:59.374590 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:59.482661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bae34-9e6d-4943-b14f-2b7e9e29d61b None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:59.495608 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08472267-c550-44bf-8e9a-184b0665d405 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:59.526327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983371-7de3-4536-a9fa-5a03529d9b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:59.526964 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983371-7de3-4536-a9fa-5a03529d9b35 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:59.527250 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983371-7de3-4536-a9fa-5a03529d9b35 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:59.527524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983371-7de3-4536-a9fa-5a03529d9b35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:59.542286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71888f3-5ded-4a33-b685-fdf4c0df8185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:59.542539 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02983371-7de3-4536-a9fa-5a03529d9b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:30:59.542664 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71888f3-5ded-4a33-b685-fdf4c0df8185 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:59.543036 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71888f3-5ded-4a33-b685-fdf4c0df8185 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:59.543326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71888f3-5ded-4a33-b685-fdf4c0df8185 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:59.544716 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71888f3-5ded-4a33-b685-fdf4c0df8185 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:59.545731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71888f3-5ded-4a33-b685-fdf4c0df8185 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:59.547026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71888f3-5ded-4a33-b685-fdf4c0df8185 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-02983371-7de3-4536-a9fa-5a03529d9b35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:30:59.547989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:30:59.550552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:30:59.551567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:30:59.551567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:30:59.551567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:30:59.551567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:30:59.551567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:30:59.551567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:30:59.551567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:30:59.551567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:30:59.551567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:30:59.551567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:30:59.551567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:30:59.551567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:30:59.551567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 329/665] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:30:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:30:59.551567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983371-7de3-4536-a9fa-5a03529d9b35 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:59.568468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 337/666] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:59.573474 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71888f3-5ded-4a33-b685-fdf4c0df8185 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:59.578030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:59.711941 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:59.714115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71888f3-5ded-4a33-b685-fdf4c0df8185 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:59.725636 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983371-7de3-4536-a9fa-5a03529d9b35 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:59.760291 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c18521-ff4d-4314-8c75-77496f24f83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:59.761346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c18521-ff4d-4314-8c75-77496f24f83a None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:59.761845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c18521-ff4d-4314-8c75-77496f24f83a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:59.762361 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c18521-ff4d-4314-8c75-77496f24f83a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:59.767026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecda559-50be-4314-9bdf-2e9c0cba20c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:59.767906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecda559-50be-4314-9bdf-2e9c0cba20c7 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:59.768389 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecda559-50be-4314-9bdf-2e9c0cba20c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:59.768892 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecda559-50be-4314-9bdf-2e9c0cba20c7 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:59.769763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecda559-50be-4314-9bdf-2e9c0cba20c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:59.770258 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecda559-50be-4314-9bdf-2e9c0cba20c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:59.771872 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecda559-50be-4314-9bdf-2e9c0cba20c7 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:59.788556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 330/667] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:59.789745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecda559-50be-4314-9bdf-2e9c0cba20c7 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:30:59.874595 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c18521-ff4d-4314-8c75-77496f24f83a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:59.876612 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c18521-ff4d-4314-8c75-77496f24f83a None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:59.879419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:30:59.920946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecda559-50be-4314-9bdf-2e9c0cba20c7 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:30:59.978814 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263610ee-354f-4a9f-85f0-61def478da45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:30:59.979431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263610ee-354f-4a9f-85f0-61def478da45 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:30:59.979740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263610ee-354f-4a9f-85f0-61def478da45 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:30:59.980068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263610ee-354f-4a9f-85f0-61def478da45 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:30:59.980710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263610ee-354f-4a9f-85f0-61def478da45 None admin] RBAC: Adding query filter params (name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:30:59.981014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263610ee-354f-4a9f-85f0-61def478da45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:30:59.982965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263610ee-354f-4a9f-85f0-61def478da45 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:30:59.996963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 331/668] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:30:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:30:59.996963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263610ee-354f-4a9f-85f0-61def478da45 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:00.010540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 338/669] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:30:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:00.011474 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c18521-ff4d-4314-8c75-77496f24f83a None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:00.034103 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:00.129042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c18521-ff4d-4314-8c75-77496f24f83a None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:00.132335 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:00.133239 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263610ee-354f-4a9f-85f0-61def478da45 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:00.170311 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36513cdc-85ac-4072-ac5a-799e762deb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:00.170963 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36513cdc-85ac-4072-ac5a-799e762deb16 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:00.171248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36513cdc-85ac-4072-ac5a-799e762deb16 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:00.171530 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36513cdc-85ac-4072-ac5a-799e762deb16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:00.173837 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04746f8a-8f74-4c20-b852-e34805bd8905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:00.174854 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04746f8a-8f74-4c20-b852-e34805bd8905 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:00.175076 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04746f8a-8f74-4c20-b852-e34805bd8905 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:00.175352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04746f8a-8f74-4c20-b852-e34805bd8905 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:00.179466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36513cdc-85ac-4072-ac5a-799e762deb16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:00.180959 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36513cdc-85ac-4072-ac5a-799e762deb16 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:00.182854 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04746f8a-8f74-4c20-b852-e34805bd8905 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:00.184352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04746f8a-8f74-4c20-b852-e34805bd8905 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:00.193958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-36513cdc-85ac-4072-ac5a-799e762deb16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:00.193958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:00.193958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:00.193958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:00.193958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:00.193958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:00.193958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:00.193958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:00.193958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:00.193958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:00.193958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:00.193958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:00.193958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:00.193958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:00.193958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:00.194943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:00.195835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:00.195835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:00.195835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:00.195835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:00.195835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:00.195835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:00.195835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:00.195835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:00.200078 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 339/670] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:00.200285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-04746f8a-8f74-4c20-b852-e34805bd8905 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:00.200285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:00.200285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:00.200285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:00.200285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:00.200285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:00.200285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:00.200285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:00.200285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:00.200285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:00.200285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:00.200285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:00.200285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:00.200285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:00.200285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:00.204898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:00.208554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:00.208554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:00.208554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:00.208554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:00.208554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:00.208554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:00.208554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:00.208554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:00.209713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36513cdc-85ac-4072-ac5a-799e762deb16 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:00.209884 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 332/671] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:30:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:00.209884 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04746f8a-8f74-4c20-b852-e34805bd8905 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:00.306092 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:00.320139 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36513cdc-85ac-4072-ac5a-799e762deb16 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:00.326664 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04746f8a-8f74-4c20-b852-e34805bd8905 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:00.358176 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7f408-72e3-402a-a7e3-32b8b8d90911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:00.358833 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7f408-72e3-402a-a7e3-32b8b8d90911 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:00.359113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7f408-72e3-402a-a7e3-32b8b8d90911 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:00.359377 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7f408-72e3-402a-a7e3-32b8b8d90911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:00.364221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85853300-6204-49eb-bf97-4b41d2f2e1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:00.364867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85853300-6204-49eb-bf97-4b41d2f2e1b1 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:00.365132 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85853300-6204-49eb-bf97-4b41d2f2e1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:00.365403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85853300-6204-49eb-bf97-4b41d2f2e1b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:00.369883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7f408-72e3-402a-a7e3-32b8b8d90911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:00.371355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7f408-72e3-402a-a7e3-32b8b8d90911 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:00.376327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85853300-6204-49eb-bf97-4b41d2f2e1b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:00.377762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85853300-6204-49eb-bf97-4b41d2f2e1b1 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-35e7f408-72e3-402a-a7e3-32b8b8d90911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:00.386314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:00.387285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:00.388299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:00.388299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:00.388299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:00.392263 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 340/672] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:00.392882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7f408-72e3-402a-a7e3-32b8b8d90911 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-85853300-6204-49eb-bf97-4b41d2f2e1b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:00.396159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:00.397185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:00.398142 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:00.398142 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:00.398142 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:00.398142 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 333/673] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:00.398142 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85853300-6204-49eb-bf97-4b41d2f2e1b1 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:00.416332 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:00.516325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7f408-72e3-402a-a7e3-32b8b8d90911 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:00.520461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85853300-6204-49eb-bf97-4b41d2f2e1b1 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:00.553112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b0903-c84f-481b-9498-79283c229b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:00.553721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b0903-c84f-481b-9498-79283c229b71 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:00.553998 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b0903-c84f-481b-9498-79283c229b71 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:00.554417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b0903-c84f-481b-9498-79283c229b71 None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:00.554961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b0903-c84f-481b-9498-79283c229b71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:00.555265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b0903-c84f-481b-9498-79283c229b71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:00.556751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b0903-c84f-481b-9498-79283c229b71 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:00.557032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427f6df-a6ec-493a-bed0-66b1662816b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:00.557699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427f6df-a6ec-493a-bed0-66b1662816b9 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:00.558041 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427f6df-a6ec-493a-bed0-66b1662816b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:00.558376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427f6df-a6ec-493a-bed0-66b1662816b9 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:00.559419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427f6df-a6ec-493a-bed0-66b1662816b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:00.559543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427f6df-a6ec-493a-bed0-66b1662816b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:00.560888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427f6df-a6ec-493a-bed0-66b1662816b9 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:00.562665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:00.574388 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 341/674] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:00.574388 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b0903-c84f-481b-9498-79283c229b71 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:00.578794 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 334/675] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:00.579706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427f6df-a6ec-493a-bed0-66b1662816b9 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:00.666011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:00.691850 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b0903-c84f-481b-9498-79283c229b71 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:00.695356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427f6df-a6ec-493a-bed0-66b1662816b9 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:00.731197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb17f49-ad1c-41d0-ad89-63d3fae8dd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:00.731826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb17f49-ad1c-41d0-ad89-63d3fae8dd78 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:00.732124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb17f49-ad1c-41d0-ad89-63d3fae8dd78 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:00.732405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb17f49-ad1c-41d0-ad89-63d3fae8dd78 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:00.733112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb17f49-ad1c-41d0-ad89-63d3fae8dd78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:00.733414 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb17f49-ad1c-41d0-ad89-63d3fae8dd78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:00.733998 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a7e23-9ff5-44a6-a678-e318f0326ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:00.734678 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a7e23-9ff5-44a6-a678-e318f0326ef0 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:00.734779 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb17f49-ad1c-41d0-ad89-63d3fae8dd78 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:00.735067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a7e23-9ff5-44a6-a678-e318f0326ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:00.735402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a7e23-9ff5-44a6-a678-e318f0326ef0 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:00.736257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a7e23-9ff5-44a6-a678-e318f0326ef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:00.736632 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a7e23-9ff5-44a6-a678-e318f0326ef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:00.738174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a7e23-9ff5-44a6-a678-e318f0326ef0 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:00.747333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 342/676] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:00.748270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb17f49-ad1c-41d0-ad89-63d3fae8dd78 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:00.757882 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 335/677] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:00.757882 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a7e23-9ff5-44a6-a678-e318f0326ef0 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:00.830850 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:00.876252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb17f49-ad1c-41d0-ad89-63d3fae8dd78 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:00.879828 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a7e23-9ff5-44a6-a678-e318f0326ef0 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:00.917207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dceac1-72fb-47b9-b776-a6557b3d1b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:00.917407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21f4a1-c63d-4857-a77f-f13d7af999ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:00.917732 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dceac1-72fb-47b9-b776-a6557b3d1b50 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:00.918019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dceac1-72fb-47b9-b776-a6557b3d1b50 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:00.918113 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21f4a1-c63d-4857-a77f-f13d7af999ca None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:00.918292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dceac1-72fb-47b9-b776-a6557b3d1b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:00.918556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21f4a1-c63d-4857-a77f-f13d7af999ca None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:00.918916 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21f4a1-c63d-4857-a77f-f13d7af999ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:00.919047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dceac1-72fb-47b9-b776-a6557b3d1b50 None admin] RBAC: Adding query filter params (role.id=5f0de9d8946f41e8a26d355448071297, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=3f7d8a79945a4e73839cd2ad995e016b) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:00.919352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dceac1-72fb-47b9-b776-a6557b3d1b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:00.919926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21f4a1-c63d-4857-a77f-f13d7af999ca None admin] RBAC: Adding query filter params (role.id=5f0de9d8946f41e8a26d355448071297, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=29b630aac21b405eb114f5f1fd1294ce) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:00.920465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21f4a1-c63d-4857-a77f-f13d7af999ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:00.920805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dceac1-72fb-47b9-b776-a6557b3d1b50 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:00.922082 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21f4a1-c63d-4857-a77f-f13d7af999ca None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:00.924569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:00.936139 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 343/678] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:00 2022] GET /identity/v3/role_assignments?user.id=3f7d8a79945a4e73839cd2ad995e016b&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=5f0de9d8946f41e8a26d355448071297 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:00.936358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 336/679] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:00 2022] GET /identity/v3/role_assignments?user.id=29b630aac21b405eb114f5f1fd1294ce&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=5f0de9d8946f41e8a26d355448071297 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:00.936358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21f4a1-c63d-4857-a77f-f13d7af999ca None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:00.939163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dceac1-72fb-47b9-b776-a6557b3d1b50 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:01.134080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dceac1-72fb-47b9-b776-a6557b3d1b50 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:01.143126 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21f4a1-c63d-4857-a77f-f13d7af999ca None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:01.169730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:01.178852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c6fb5-32aa-407f-8c8f-1fb1164e6ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:01.179859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c6fb5-32aa-407f-8c8f-1fb1164e6ee1 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:01.180000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c6fb5-32aa-407f-8c8f-1fb1164e6ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:01.180225 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c6fb5-32aa-407f-8c8f-1fb1164e6ee1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:01.190808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c6fb5-32aa-407f-8c8f-1fb1164e6ee1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:01.192383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c6fb5-32aa-407f-8c8f-1fb1164e6ee1 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:01.193855 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffff762-83ec-4327-a5f9-d4db88337320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:01.194982 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffff762-83ec-4327-a5f9-d4db88337320 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:01.195857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffff762-83ec-4327-a5f9-d4db88337320 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:01.196236 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffff762-83ec-4327-a5f9-d4db88337320 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:01.204321 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffff762-83ec-4327-a5f9-d4db88337320 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:01.205866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffff762-83ec-4327-a5f9-d4db88337320 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-f07c6fb5-32aa-407f-8c8f-1fb1164e6ee1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:01.207486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:01.208636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:01.209772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:01.209772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:01.209772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:01.209772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:01.209772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:01.209772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:01.209772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:01.209772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:01.209772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:31:01.209772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:01.209772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 344/680] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:01.210788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ea179-472c-47ad-b87c-e7db3854affe None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:01.211074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ea179-472c-47ad-b87c-e7db3854affe None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:01.211348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ea179-472c-47ad-b87c-e7db3854affe None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:01.212606 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 345/681] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:01.214551 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ea179-472c-47ad-b87c-e7db3854affe None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:01.223615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-dffff762-83ec-4327-a5f9-d4db88337320 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:01.223615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:01.223615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:01.223615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:01.223615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:01.223615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:01.223615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:01.223615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:01.223615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:01.223615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:01.223615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:01.223615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:01.223615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:01.223615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:01.223615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:01.224722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:01.225638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:01.225638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:01.225638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:01.225638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:01.225638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:01.225638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:01.225638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:01.225638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:01.225638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 337/682] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:01.230303 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cdf48-10db-454f-81bd-773730f43806 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:01.230303 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cdf48-10db-454f-81bd-773730f43806 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:01.230303 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cdf48-10db-454f-81bd-773730f43806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:01.250774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-e03cdf48-10db-454f-81bd-773730f43806 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:01.251976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e03cdf48-10db-454f-81bd-773730f43806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:01.293311 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:01.334230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 338/683] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:01.335408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cdf48-10db-454f-81bd-773730f43806 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:01.363380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ea179-472c-47ad-b87c-e7db3854affe None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:01.417783 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48098abd-21dd-4c9b-a6fc-c189b31176e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:01.418643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48098abd-21dd-4c9b-a6fc-c189b31176e1 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:01.419691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48098abd-21dd-4c9b-a6fc-c189b31176e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:01.420274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48098abd-21dd-4c9b-a6fc-c189b31176e1 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:01.421161 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48098abd-21dd-4c9b-a6fc-c189b31176e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:01.421980 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48098abd-21dd-4c9b-a6fc-c189b31176e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:01.423622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48098abd-21dd-4c9b-a6fc-c189b31176e1 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:01.450542 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 346/684] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Aug 29 22:31:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:01.456537 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48098abd-21dd-4c9b-a6fc-c189b31176e1 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:01.521787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cdf48-10db-454f-81bd-773730f43806 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:01.533581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:01.563186 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dd2a6-087a-4634-8821-ce5bc0b05124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:01.564257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dd2a6-087a-4634-8821-ce5bc0b05124 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:01.564705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dd2a6-087a-4634-8821-ce5bc0b05124 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:01.565117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dd2a6-087a-4634-8821-ce5bc0b05124 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:01.566785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dd2a6-087a-4634-8821-ce5bc0b05124 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:01.567241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dd2a6-087a-4634-8821-ce5bc0b05124 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:01.568839 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dd2a6-087a-4634-8821-ce5bc0b05124 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:01.587807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 339/685] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:01.593664 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dd2a6-087a-4634-8821-ce5bc0b05124 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:01.659579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48098abd-21dd-4c9b-a6fc-c189b31176e1 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:01.686978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:01.706530 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d696188-3713-4698-ad34-37071ddc717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:01.707550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d696188-3713-4698-ad34-37071ddc717b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:01.708354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d696188-3713-4698-ad34-37071ddc717b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:01.708725 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d696188-3713-4698-ad34-37071ddc717b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:01.713874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dd2a6-087a-4634-8821-ce5bc0b05124 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:01.752613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad5602-9eef-4af5-a7c5-8f2814d8fec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:01.753270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad5602-9eef-4af5-a7c5-8f2814d8fec5 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:01.753498 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad5602-9eef-4af5-a7c5-8f2814d8fec5 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:01.753779 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad5602-9eef-4af5-a7c5-8f2814d8fec5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:01.754508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad5602-9eef-4af5-a7c5-8f2814d8fec5 None admin] RBAC: Adding query filter params (role.id=5f0de9d8946f41e8a26d355448071297, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=d8794e99a0024672974412ca4c045b63) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:01.754873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad5602-9eef-4af5-a7c5-8f2814d8fec5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:01.756392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad5602-9eef-4af5-a7c5-8f2814d8fec5 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:01.763279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 340/686] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:01 2022] GET /identity/v3/role_assignments?user.id=d8794e99a0024672974412ca4c045b63&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=5f0de9d8946f41e8a26d355448071297 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:01.764233 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad5602-9eef-4af5-a7c5-8f2814d8fec5 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:01.799759 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d696188-3713-4698-ad34-37071ddc717b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:01.801282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d696188-3713-4698-ad34-37071ddc717b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:01.811357 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:01.908426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad5602-9eef-4af5-a7c5-8f2814d8fec5 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:01.913130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 347/687] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:01.921926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d696188-3713-4698-ad34-37071ddc717b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:01.952793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:01.961593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62461a-89b4-4eb5-8dc5-5557d06b1bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:01.963663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62461a-89b4-4eb5-8dc5-5557d06b1bda None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:01.963663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62461a-89b4-4eb5-8dc5-5557d06b1bda None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:01.963663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62461a-89b4-4eb5-8dc5-5557d06b1bda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:01.983977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62461a-89b4-4eb5-8dc5-5557d06b1bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-cb62461a-89b4-4eb5-8dc5-5557d06b1bda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:01.989038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:01.990924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:01.993004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:01.993004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:01.993004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:01.993004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:01.993004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:01.993004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:01.993004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:01.993004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:01.993004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:01.993004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:01.993004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:01.993004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:01.993004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 341/688] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:01.997578 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62461a-89b4-4eb5-8dc5-5557d06b1bda None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:02.048607 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d696188-3713-4698-ad34-37071ddc717b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:02.085039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cbb3d-942c-4ffa-b7a9-d020e3f8c32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:02.085734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cbb3d-942c-4ffa-b7a9-d020e3f8c32c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:02.086018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cbb3d-942c-4ffa-b7a9-d020e3f8c32c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:02.086298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cbb3d-942c-4ffa-b7a9-d020e3f8c32c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:02.098616 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:02.098809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cbb3d-942c-4ffa-b7a9-d020e3f8c32c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:02.100267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cbb3d-942c-4ffa-b7a9-d020e3f8c32c None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:02.108934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62461a-89b4-4eb5-8dc5-5557d06b1bda None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-cf8cbb3d-942c-4ffa-b7a9-d020e3f8c32c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:02.116935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:02.117930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:02.119317 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:02.119317 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:02.119317 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:02.119317 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 348/689] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:02.123619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cbb3d-942c-4ffa-b7a9-d020e3f8c32c None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:02.149508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bc6e9-6fc6-4ff4-9a73-4e58dafb2660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:02.150422 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bc6e9-6fc6-4ff4-9a73-4e58dafb2660 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:02.150900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bc6e9-6fc6-4ff4-9a73-4e58dafb2660 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:02.151416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bc6e9-6fc6-4ff4-9a73-4e58dafb2660 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:02.152360 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bc6e9-6fc6-4ff4-9a73-4e58dafb2660 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:02.152838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bc6e9-6fc6-4ff4-9a73-4e58dafb2660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:02.154988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bc6e9-6fc6-4ff4-9a73-4e58dafb2660 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:02.165197 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 342/690] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:02.172374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bc6e9-6fc6-4ff4-9a73-4e58dafb2660 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:02.201796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:02.235438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cbb3d-942c-4ffa-b7a9-d020e3f8c32c None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:02.273730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd54a39-1ee2-4cef-b729-ba0def5295f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:02.274368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd54a39-1ee2-4cef-b729-ba0def5295f3 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:02.274652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd54a39-1ee2-4cef-b729-ba0def5295f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:02.274904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd54a39-1ee2-4cef-b729-ba0def5295f3 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:02.275562 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd54a39-1ee2-4cef-b729-ba0def5295f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:02.275865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd54a39-1ee2-4cef-b729-ba0def5295f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:02.277334 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd54a39-1ee2-4cef-b729-ba0def5295f3 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:02.286037 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bc6e9-6fc6-4ff4-9a73-4e58dafb2660 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:02.291947 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 349/691] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:02.297529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd54a39-1ee2-4cef-b729-ba0def5295f3 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:02.323093 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44aba4-8260-42fa-8bb4-9ca12d663d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:02.324065 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44aba4-8260-42fa-8bb4-9ca12d663d02 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:02.324578 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44aba4-8260-42fa-8bb4-9ca12d663d02 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:02.325556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44aba4-8260-42fa-8bb4-9ca12d663d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:02.338222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44aba4-8260-42fa-8bb4-9ca12d663d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:02.340030 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44aba4-8260-42fa-8bb4-9ca12d663d02 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-bc44aba4-8260-42fa-8bb4-9ca12d663d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:02.356552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:02.357645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:02.358543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:02.358543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:02.358543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:02.360433 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 343/692] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:02.366209 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44aba4-8260-42fa-8bb4-9ca12d663d02 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:02.384596 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:02.411261 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd54a39-1ee2-4cef-b729-ba0def5295f3 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:02.441880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:02.448521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6f0f8-1efd-4e68-bebd-9f81667cefe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:02.449231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6f0f8-1efd-4e68-bebd-9f81667cefe6 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:02.449501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6f0f8-1efd-4e68-bebd-9f81667cefe6 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:02.449779 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6f0f8-1efd-4e68-bebd-9f81667cefe6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:02.457596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6f0f8-1efd-4e68-bebd-9f81667cefe6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:02.459126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6f0f8-1efd-4e68-bebd-9f81667cefe6 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:02.472075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-b5b6f0f8-1efd-4e68-bebd-9f81667cefe6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:02.472075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:02.472075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:02.472075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:02.472075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:02.472075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:02.472075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:02.472075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:02.472075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:02.472075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:02.472075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:02.472075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:02.472075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:02.472075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:02.472075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:02.473077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:02.474362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:02.474362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:02.474362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:02.474362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:02.474362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:02.474362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:02.474362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:02.474362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:02.474362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 350/693] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:02.479123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6f0f8-1efd-4e68-bebd-9f81667cefe6 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:02.584838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44aba4-8260-42fa-8bb4-9ca12d663d02 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:02.596111 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6f0f8-1efd-4e68-bebd-9f81667cefe6 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:02.639630 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705dfd3-f946-4745-bad4-c7bd1eb92a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:02.640276 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705dfd3-f946-4745-bad4-c7bd1eb92a35 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:02.640619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705dfd3-f946-4745-bad4-c7bd1eb92a35 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:02.640895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705dfd3-f946-4745-bad4-c7bd1eb92a35 None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:02.642236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705dfd3-f946-4745-bad4-c7bd1eb92a35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:02.642551 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705dfd3-f946-4745-bad4-c7bd1eb92a35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:02.644279 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705dfd3-f946-4745-bad4-c7bd1eb92a35 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:02.650665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d6edb-67d0-41af-a882-3dbced198f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:02.651287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d6edb-67d0-41af-a882-3dbced198f43 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:02.651570 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d6edb-67d0-41af-a882-3dbced198f43 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:02.651847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d6edb-67d0-41af-a882-3dbced198f43 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:02.652537 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d6edb-67d0-41af-a882-3dbced198f43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:02.652844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d6edb-67d0-41af-a882-3dbced198f43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:02.658995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d6edb-67d0-41af-a882-3dbced198f43 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:02.672979 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 351/694] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:02.681357 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705dfd3-f946-4745-bad4-c7bd1eb92a35 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:02.686485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 344/695] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:02.693975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d6edb-67d0-41af-a882-3dbced198f43 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:02.786991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:02.810164 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:02.865152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d6edb-67d0-41af-a882-3dbced198f43 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:02.898489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705dfd3-f946-4745-bad4-c7bd1eb92a35 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:02.931804 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487e4ec-9f5c-4495-aa61-e70b6b70e22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:02.932477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487e4ec-9f5c-4495-aa61-e70b6b70e22b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:02.932756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487e4ec-9f5c-4495-aa61-e70b6b70e22b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:02.933030 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487e4ec-9f5c-4495-aa61-e70b6b70e22b None admin] PATH_INFO: `/v3/users/nova` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:02.951025 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487e4ec-9f5c-4495-aa61-e70b6b70e22b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:02.952525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487e4ec-9f5c-4495-aa61-e70b6b70e22b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:02.972484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc00bae-0424-46b5-b5d0-5333a5e6d8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:02.973091 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc00bae-0424-46b5-b5d0-5333a5e6d8b6 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:02.973374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc00bae-0424-46b5-b5d0-5333a5e6d8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:02.973651 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc00bae-0424-46b5-b5d0-5333a5e6d8b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:02.974437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc00bae-0424-46b5-b5d0-5333a5e6d8b6 None admin] RBAC: Adding query filter params (role.id=5f0de9d8946f41e8a26d355448071297, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=a8cccf561d484373a7cb24c5f111900c) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:02.974757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc00bae-0424-46b5-b5d0-5333a5e6d8b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:02.976200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc00bae-0424-46b5-b5d0-5333a5e6d8b6 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-7487e4ec-9f5c-4495-aa61-e70b6b70e22b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:02.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:02.983299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:02.985528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:02.985528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:02.985528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:02.985528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:02.985528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:02.985528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:02.985528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:02.985528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:02.985528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:31:02.985528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:02.985528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 345/696] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 29 22:31:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:02.988866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487e4ec-9f5c-4495-aa61-e70b6b70e22b None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:02.989078 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 352/697] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:02 2022] GET /identity/v3/role_assignments?user.id=a8cccf561d484373a7cb24c5f111900c&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=5f0de9d8946f41e8a26d355448071297 => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:03.132545 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487e4ec-9f5c-4495-aa61-e70b6b70e22b None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:03.163553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:03.173405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41aed1-25ea-48a1-83aa-b2651cb2b2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:03.174005 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41aed1-25ea-48a1-83aa-b2651cb2b2ed None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:03.174553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41aed1-25ea-48a1-83aa-b2651cb2b2ed None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:03.174829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41aed1-25ea-48a1-83aa-b2651cb2b2ed None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:03.175618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41aed1-25ea-48a1-83aa-b2651cb2b2ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:03.175924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41aed1-25ea-48a1-83aa-b2651cb2b2ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:03.177403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41aed1-25ea-48a1-83aa-b2651cb2b2ed None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:03.205196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 346/698] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 29 22:31:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:03.210986 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc00bae-0424-46b5-b5d0-5333a5e6d8b6 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:03.222051 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74482e6-cd22-4c59-9870-dce3d84a9377 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:03.224891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74482e6-cd22-4c59-9870-dce3d84a9377 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:03.225182 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74482e6-cd22-4c59-9870-dce3d84a9377 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:03.229766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 347/699] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:03.234869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2b8dc-9f71-4ff3-b12d-fe9bdba7bd32 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:03.235149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2b8dc-9f71-4ff3-b12d-fe9bdba7bd32 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:03.235428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2b8dc-9f71-4ff3-b12d-fe9bdba7bd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:03.266437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-e8d2b8dc-9f71-4ff3-b12d-fe9bdba7bd32 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:03.268024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e8d2b8dc-9f71-4ff3-b12d-fe9bdba7bd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:03.345688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc00bae-0424-46b5-b5d0-5333a5e6d8b6 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:03.363751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 348/700] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:03.363942 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:03.365231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50169754-1909-48de-baf0-1bce42e9c05d None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:03.365587 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50169754-1909-48de-baf0-1bce42e9c05d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:03.370905 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50169754-1909-48de-baf0-1bce42e9c05d None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:03.373029 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 349/701] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:03.378350 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d919b51-d5ee-4c91-8c2e-4cd311f82e16 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:03.378642 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d919b51-d5ee-4c91-8c2e-4cd311f82e16 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:03.379056 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d919b51-d5ee-4c91-8c2e-4cd311f82e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:03.385813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa66aa6-6a2a-4929-9b8c-c40549d26c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:03.387341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa66aa6-6a2a-4929-9b8c-c40549d26c18 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:03.388269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa66aa6-6a2a-4929-9b8c-c40549d26c18 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:03.388618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa66aa6-6a2a-4929-9b8c-c40549d26c18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:03.399726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-9d919b51-d5ee-4c91-8c2e-4cd311f82e16 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:03.401116 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9d919b51-d5ee-4c91-8c2e-4cd311f82e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:03.473861 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa66aa6-6a2a-4929-9b8c-c40549d26c18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:03.475328 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa66aa6-6a2a-4929-9b8c-c40549d26c18 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:03.493311 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 350/702] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:31:03.595475 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 353/703] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:03.600714 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d919b51-d5ee-4c91-8c2e-4cd311f82e16 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:03.664650 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:03.696248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa66aa6-6a2a-4929-9b8c-c40549d26c18 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:03.722795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d919b51-d5ee-4c91-8c2e-4cd311f82e16 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:03.733243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:03.759763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c84ac-67a0-48de-8162-899ffafbf805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:03.760402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c84ac-67a0-48de-8162-899ffafbf805 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:03.760683 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c84ac-67a0-48de-8162-899ffafbf805 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:03.760957 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c84ac-67a0-48de-8162-899ffafbf805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:03.779200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c84ac-67a0-48de-8162-899ffafbf805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:03.782985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c84ac-67a0-48de-8162-899ffafbf805 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-5e2c84ac-67a0-48de-8162-899ffafbf805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:03.806424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:03.807416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:03.808358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:03.808358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:03.808358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:03.808358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 351/704] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:03.809058 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c84ac-67a0-48de-8162-899ffafbf805 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:03.864398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa66aa6-6a2a-4929-9b8c-c40549d26c18 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:03.900520 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da050133-7f39-489e-b2a8-1add84c1ea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:03.901220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da050133-7f39-489e-b2a8-1add84c1ea1b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:03.901503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da050133-7f39-489e-b2a8-1add84c1ea1b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:03.901776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da050133-7f39-489e-b2a8-1add84c1ea1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:03.913391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da050133-7f39-489e-b2a8-1add84c1ea1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:03.914877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da050133-7f39-489e-b2a8-1add84c1ea1b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-da050133-7f39-489e-b2a8-1add84c1ea1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:03.931808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:03.932868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:03.934621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:03.934621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:03.934621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:03.934621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 354/705] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:03.934621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da050133-7f39-489e-b2a8-1add84c1ea1b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:03.942339 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:03.952133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c84ac-67a0-48de-8162-899ffafbf805 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:03.989442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abfae6-f8c6-436b-b76a-a14cfa25b531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:03.990193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abfae6-f8c6-436b-b76a-a14cfa25b531 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:03.990457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abfae6-f8c6-436b-b76a-a14cfa25b531 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:03.990872 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abfae6-f8c6-436b-b76a-a14cfa25b531 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:03.991586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abfae6-f8c6-436b-b76a-a14cfa25b531 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:03.993719 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abfae6-f8c6-436b-b76a-a14cfa25b531 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-42abfae6-f8c6-436b-b76a-a14cfa25b531 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:04.006112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:04.007378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:04.008443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:04.008443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:04.008443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:04.008443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:04.008443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:04.008443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:04.008443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:04.008443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:04.008443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:04.008443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:04.008443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:04.008443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:04.008443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:31:04.008443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:04.015566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 352/706] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Aug 29 22:31:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:04.016592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abfae6-f8c6-436b-b76a-a14cfa25b531 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:04.027480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:04.070055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da050133-7f39-489e-b2a8-1add84c1ea1b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:04.117854 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55da15-cf96-4580-9548-329b0aaeefa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:04.118534 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55da15-cf96-4580-9548-329b0aaeefa6 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:04.119367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55da15-cf96-4580-9548-329b0aaeefa6 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:04.119870 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55da15-cf96-4580-9548-329b0aaeefa6 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:04.121918 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55da15-cf96-4580-9548-329b0aaeefa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:04.122232 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55da15-cf96-4580-9548-329b0aaeefa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:04.123901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55da15-cf96-4580-9548-329b0aaeefa6 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:04.135442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abfae6-f8c6-436b-b76a-a14cfa25b531 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:04.140891 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 355/707] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:04.142020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55da15-cf96-4580-9548-329b0aaeefa6 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:04.183281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62faf33-bfe6-4433-9e98-437600cd1402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:04.184167 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62faf33-bfe6-4433-9e98-437600cd1402 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:04.184505 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62faf33-bfe6-4433-9e98-437600cd1402 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:04.184775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62faf33-bfe6-4433-9e98-437600cd1402 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:04.185427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62faf33-bfe6-4433-9e98-437600cd1402 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:04.185726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62faf33-bfe6-4433-9e98-437600cd1402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:04.187770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62faf33-bfe6-4433-9e98-437600cd1402 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:04.205459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 353/708] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:04.206523 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62faf33-bfe6-4433-9e98-437600cd1402 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:04.241582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:04.261061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55da15-cf96-4580-9548-329b0aaeefa6 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:04.290582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:04.301140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c5b48-4119-4892-a8a8-f3f06eebb13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:04.301932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c5b48-4119-4892-a8a8-f3f06eebb13c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:04.302268 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c5b48-4119-4892-a8a8-f3f06eebb13c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:04.304183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c5b48-4119-4892-a8a8-f3f06eebb13c None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:04.304183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c5b48-4119-4892-a8a8-f3f06eebb13c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:04.304183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c5b48-4119-4892-a8a8-f3f06eebb13c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:04.305338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c5b48-4119-4892-a8a8-f3f06eebb13c None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:04.315278 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 356/709] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Aug 29 22:31:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:04.316488 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c5b48-4119-4892-a8a8-f3f06eebb13c None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:04.349201 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62faf33-bfe6-4433-9e98-437600cd1402 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:04.395398 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8129e-051b-463a-a640-461d5000f0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:04.396314 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8129e-051b-463a-a640-461d5000f0a6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:04.396739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8129e-051b-463a-a640-461d5000f0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:04.397593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8129e-051b-463a-a640-461d5000f0a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:04.407190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8129e-051b-463a-a640-461d5000f0a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:04.409328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8129e-051b-463a-a640-461d5000f0a6 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:04.424597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-d6f8129e-051b-463a-a640-461d5000f0a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:04.424597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:04.424597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:04.424597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:04.424597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:04.424597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:04.424597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:04.424597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:04.424597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:04.424597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:04.424597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:04.424597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:04.424597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:04.424597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:04.424597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:04.425724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:04.426866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:04.426866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:04.426866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:04.426866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:04.426866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:04.426866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:04.426866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:04.426866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:04.427389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c5b48-4119-4892-a8a8-f3f06eebb13c None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:04.433729 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 354/710] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:04.433729 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8129e-051b-463a-a640-461d5000f0a6 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:04.479325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229a32b-fcb8-41b2-aea6-18c1882e0b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:04.480814 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229a32b-fcb8-41b2-aea6-18c1882e0b39 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:04.482992 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229a32b-fcb8-41b2-aea6-18c1882e0b39 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:04.483543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229a32b-fcb8-41b2-aea6-18c1882e0b39 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:04.484274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229a32b-fcb8-41b2-aea6-18c1882e0b39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:04.485921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229a32b-fcb8-41b2-aea6-18c1882e0b39 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:04.529813 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:04.552232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8129e-051b-463a-a640-461d5000f0a6 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:04.572066 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 357/711] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:31:04 2022] POST /identity/v3/users => generated 254 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:04.573141 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229a32b-fcb8-41b2-aea6-18c1882e0b39 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:04.609370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750a6f2-07d8-4db7-b8a1-878124f5c1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:04.610149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750a6f2-07d8-4db7-b8a1-878124f5c1e4 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:04.610435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750a6f2-07d8-4db7-b8a1-878124f5c1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:04.610711 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750a6f2-07d8-4db7-b8a1-878124f5c1e4 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:04.611529 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750a6f2-07d8-4db7-b8a1-878124f5c1e4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:04.611844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750a6f2-07d8-4db7-b8a1-878124f5c1e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:04.614251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750a6f2-07d8-4db7-b8a1-878124f5c1e4 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:04.622958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 355/712] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Aug 29 22:31:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:04.625535 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938c89f-5a5c-4c97-b2ea-55f302cfdb0d None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:04.626212 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938c89f-5a5c-4c97-b2ea-55f302cfdb0d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:04.626865 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938c89f-5a5c-4c97-b2ea-55f302cfdb0d None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:04.637009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 356/713] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:04 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:04.642283 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3f289-ed29-49b9-bbfc-80baa18b4c55 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:04.642934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3f289-ed29-49b9-bbfc-80baa18b4c55 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:04.644501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3f289-ed29-49b9-bbfc-80baa18b4c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:04.686403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-64c3f289-ed29-49b9-bbfc-80baa18b4c55 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:04.688262 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:04.690043 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-64c3f289-ed29-49b9-bbfc-80baa18b4c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:04.781685 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229a32b-fcb8-41b2-aea6-18c1882e0b39 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:04.825441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 357/714] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:04.831840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4f1c-66df-4610-925b-b2e3c63583c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:04.832504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4f1c-66df-4610-925b-b2e3c63583c5 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:04.832784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4f1c-66df-4610-925b-b2e3c63583c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:04.833080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4f1c-66df-4610-925b-b2e3c63583c5 None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:04.833767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc4f1c-66df-4610-925b-b2e3c63583c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:04.834068 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc4f1c-66df-4610-925b-b2e3c63583c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:04.835531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc4f1c-66df-4610-925b-b2e3c63583c5 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:04.851629 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 358/715] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:04.858815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3f289-ed29-49b9-bbfc-80baa18b4c55 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:04.940654 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:04.967296 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3f289-ed29-49b9-bbfc-80baa18b4c55 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:05.009754 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ca914-c649-48a3-a17b-cae8d2a60e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:05.010383 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ca914-c649-48a3-a17b-cae8d2a60e1c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:05.010661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ca914-c649-48a3-a17b-cae8d2a60e1c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:05.010930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ca914-c649-48a3-a17b-cae8d2a60e1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:05.011670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ca914-c649-48a3-a17b-cae8d2a60e1c None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=f06d910badb84c6aa6b48f3b56b91f82) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:05.011980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ca914-c649-48a3-a17b-cae8d2a60e1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:05.013513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ca914-c649-48a3-a17b-cae8d2a60e1c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:05.020900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 358/716] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:04 2022] GET /identity/v3/role_assignments?user.id=f06d910badb84c6aa6b48f3b56b91f82&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=a7d59d2982de4bfeb758dce70808029f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:05.125662 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4f1c-66df-4610-925b-b2e3c63583c5 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:05.241774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4f1c-66df-4610-925b-b2e3c63583c5 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:05.252165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:05.283886 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1cf7b-16f3-4928-8ae2-b0647a9958a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:05.284783 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1cf7b-16f3-4928-8ae2-b0647a9958a7 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:05.285063 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1cf7b-16f3-4928-8ae2-b0647a9958a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:05.285632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1cf7b-16f3-4928-8ae2-b0647a9958a7 None admin] PATH_INFO: `/v3/services/network` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:05.286233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1cf7b-16f3-4928-8ae2-b0647a9958a7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:05.287609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1cf7b-16f3-4928-8ae2-b0647a9958a7 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-79a1cf7b-16f3-4928-8ae2-b0647a9958a7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:05.304679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:05.305742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:05.306599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:05.306599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:05.306599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:05.306599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:05.306599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:05.306599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:05.306599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:05.306599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:05.306599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:05.306599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:05.306599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:05.306599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:05.306599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:31:05.306599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:05.306599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 359/717] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:05 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:05.312639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ca914-c649-48a3-a17b-cae8d2a60e1c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:05.464829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ca914-c649-48a3-a17b-cae8d2a60e1c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:05.469155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c75e0-9e3a-4907-92bb-eb4f346f2adf None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:05.469438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c75e0-9e3a-4907-92bb-eb4f346f2adf None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:05.472137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c75e0-9e3a-4907-92bb-eb4f346f2adf None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:05.472137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 360/718] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:05.476331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810ae68-5f61-4983-9034-c85cca1c9965 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:05.476620 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810ae68-5f61-4983-9034-c85cca1c9965 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:05.476898 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810ae68-5f61-4983-9034-c85cca1c9965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:05.507844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673e6f1-6e6e-45e3-a557-3671f54bc102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:05.508405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673e6f1-6e6e-45e3-a557-3671f54bc102 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:05.508683 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673e6f1-6e6e-45e3-a557-3671f54bc102 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:05.508958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673e6f1-6e6e-45e3-a557-3671f54bc102 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:05.509598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673e6f1-6e6e-45e3-a557-3671f54bc102 None admin] RBAC: Adding query filter params (name=network) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:05.509905 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673e6f1-6e6e-45e3-a557-3671f54bc102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:05.511280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673e6f1-6e6e-45e3-a557-3671f54bc102 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:05.516609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 359/719] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 29 22:31:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:05.523527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673e6f1-6e6e-45e3-a557-3671f54bc102 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:05.524890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-7810ae68-5f61-4983-9034-c85cca1c9965 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:05.526096 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-7810ae68-5f61-4983-9034-c85cca1c9965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:05.531372 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:05.650593 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 361/720] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:31:05.693548 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673e6f1-6e6e-45e3-a557-3671f54bc102 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:05.730546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56faf690-fcc6-41ac-b152-d06802118d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:05.731869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faf690-fcc6-41ac-b152-d06802118d06 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:05.732249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faf690-fcc6-41ac-b152-d06802118d06 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:05.732602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faf690-fcc6-41ac-b152-d06802118d06 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:05.733318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56faf690-fcc6-41ac-b152-d06802118d06 None admin] RBAC: Adding query filter params (type=network) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:05.733735 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56faf690-fcc6-41ac-b152-d06802118d06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:05.735236 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56faf690-fcc6-41ac-b152-d06802118d06 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:05.740690 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 360/721] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 29 22:31:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:05.979677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810ae68-5f61-4983-9034-c85cca1c9965 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:06.085660 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:06.089622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810ae68-5f61-4983-9034-c85cca1c9965 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:06.128732 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05830fb4-a84e-4adc-9a17-066c5d19e3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:06.129479 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830fb4-a84e-4adc-9a17-066c5d19e3ef None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:06.129682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830fb4-a84e-4adc-9a17-066c5d19e3ef None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:06.129928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830fb4-a84e-4adc-9a17-066c5d19e3ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:06.142151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05830fb4-a84e-4adc-9a17-066c5d19e3ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-05830fb4-a84e-4adc-9a17-066c5d19e3ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:06.147517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:06.148506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:06.149721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:06.149721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:06.149721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:06.149721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:06.149721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:06.149721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:06.149721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:06.149721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:06.149721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:06.149721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:06.149721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:06.149721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:06.149721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 362/722] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:06.155470 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56faf690-fcc6-41ac-b152-d06802118d06 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:06.232261 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:06.269427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56faf690-fcc6-41ac-b152-d06802118d06 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:06.306847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1fd76-b097-44a8-b257-405049ec9113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:06.307465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1fd76-b097-44a8-b257-405049ec9113 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:06.307749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1fd76-b097-44a8-b257-405049ec9113 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:06.308026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1fd76-b097-44a8-b257-405049ec9113 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:06.308728 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1fd76-b097-44a8-b257-405049ec9113 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:06.309034 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1fd76-b097-44a8-b257-405049ec9113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:06.310966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1fd76-b097-44a8-b257-405049ec9113 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:06.324378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 361/723] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:06.326374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05830fb4-a84e-4adc-9a17-066c5d19e3ef None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:06.475124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05830fb4-a84e-4adc-9a17-066c5d19e3ef None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:06.525921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4ae9e-2a11-41a8-a51d-a4a2a8ef4a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:06.526536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4ae9e-2a11-41a8-a51d-a4a2a8ef4a94 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:06.526796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4ae9e-2a11-41a8-a51d-a4a2a8ef4a94 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:06.527059 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4ae9e-2a11-41a8-a51d-a4a2a8ef4a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:06.544247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4ae9e-2a11-41a8-a51d-a4a2a8ef4a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:06.545756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4ae9e-2a11-41a8-a51d-a4a2a8ef4a94 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-7fc4ae9e-2a11-41a8-a51d-a4a2a8ef4a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:06.565549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:06.566642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:06.568142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:06.568142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:06.568142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:06.568142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 363/724] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:06.572523 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1fd76-b097-44a8-b257-405049ec9113 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:06.722007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1fd76-b097-44a8-b257-405049ec9113 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:06.751226 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:06.758936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9777213-f04d-412d-8d17-3a7645524f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:06.759546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9777213-f04d-412d-8d17-3a7645524f05 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:06.759824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9777213-f04d-412d-8d17-3a7645524f05 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:06.760120 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9777213-f04d-412d-8d17-3a7645524f05 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:06.760780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9777213-f04d-412d-8d17-3a7645524f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:06.761084 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9777213-f04d-412d-8d17-3a7645524f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:06.763563 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9777213-f04d-412d-8d17-3a7645524f05 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:06.779328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 362/725] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:06.784404 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4ae9e-2a11-41a8-a51d-a4a2a8ef4a94 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:06.820498 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:06.930516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4ae9e-2a11-41a8-a51d-a4a2a8ef4a94 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:06.967236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51829eb-eec1-4a6e-b8b0-442d63c252f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:06.967236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51829eb-eec1-4a6e-b8b0-442d63c252f2 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:06.967236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51829eb-eec1-4a6e-b8b0-442d63c252f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:06.967617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51829eb-eec1-4a6e-b8b0-442d63c252f2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:06.975790 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51829eb-eec1-4a6e-b8b0-442d63c252f2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:06.977275 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51829eb-eec1-4a6e-b8b0-442d63c252f2 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-e51829eb-eec1-4a6e-b8b0-442d63c252f2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:06.990012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:06.991039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:06.992682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:06.992682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:06.992682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:06.992682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:06.992682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:06.992682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:06.992682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:06.992682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:06.992682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:31:06.992682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:06.992682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 364/726] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:06.997750 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9777213-f04d-412d-8d17-3a7645524f05 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:07.148953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9777213-f04d-412d-8d17-3a7645524f05 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:07.186673 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d4e81-7fa9-4084-81dd-fbec3657d90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:07.187307 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d4e81-7fa9-4084-81dd-fbec3657d90e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:07.187562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d4e81-7fa9-4084-81dd-fbec3657d90e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:07.187848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d4e81-7fa9-4084-81dd-fbec3657d90e None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:07.188649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d4e81-7fa9-4084-81dd-fbec3657d90e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:07.188960 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d4e81-7fa9-4084-81dd-fbec3657d90e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:07.190437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d4e81-7fa9-4084-81dd-fbec3657d90e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:07.210281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 363/727] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Aug 29 22:31:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:07.215564 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51829eb-eec1-4a6e-b8b0-442d63c252f2 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:07.233915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3ba22-84c8-4ee0-9346-23d3144b5ad8 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:07.234225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3ba22-84c8-4ee0-9346-23d3144b5ad8 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:07.234497 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3ba22-84c8-4ee0-9346-23d3144b5ad8 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:07.236138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 364/728] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:07.244805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1de5ba-a72c-4811-b51b-d33451b94e55 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:07.245093 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1de5ba-a72c-4811-b51b-d33451b94e55 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:07.245444 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1de5ba-a72c-4811-b51b-d33451b94e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:07.277144 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-bf1de5ba-a72c-4811-b51b-d33451b94e55 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:07.278408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-bf1de5ba-a72c-4811-b51b-d33451b94e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:07.328467 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:07.340464 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51829eb-eec1-4a6e-b8b0-442d63c252f2 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:07.340647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:07.365395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 365/729] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:31:07.366686 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10b53a-ecd5-4026-aa16-18174ce008ee None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:07.366974 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10b53a-ecd5-4026-aa16-18174ce008ee None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:07.367275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10b53a-ecd5-4026-aa16-18174ce008ee None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:07.368925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 366/730] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:07.374818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a473a2-3384-4c3e-9009-89fd7f235696 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:07.375387 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a473a2-3384-4c3e-9009-89fd7f235696 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:07.375904 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a473a2-3384-4c3e-9009-89fd7f235696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:07.393398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2a2dd-59d3-457c-b866-b558c5de7fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:07.397011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2a2dd-59d3-457c-b866-b558c5de7fe2 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:07.397490 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2a2dd-59d3-457c-b866-b558c5de7fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:07.398124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2a2dd-59d3-457c-b866-b558c5de7fe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:07.416905 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-19a473a2-3384-4c3e-9009-89fd7f235696 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:07.418412 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-19a473a2-3384-4c3e-9009-89fd7f235696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:07.500295 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 367/731] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:07.501589 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619ae0-9d8e-4c40-9465-5577521577f3 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:07.501874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619ae0-9d8e-4c40-9465-5577521577f3 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:07.502153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619ae0-9d8e-4c40-9465-5577521577f3 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:07.513031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 368/732] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:07 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:07.519316 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e2fb9-41be-42ab-85eb-f95348450b00 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:07.519604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e2fb9-41be-42ab-85eb-f95348450b00 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:07.519882 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e2fb9-41be-42ab-85eb-f95348450b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:07.521122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2a2dd-59d3-457c-b866-b558c5de7fe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:07.522812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2a2dd-59d3-457c-b866-b558c5de7fe2 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:07.564194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-b95e2fb9-41be-42ab-85eb-f95348450b00 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:07.565417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b95e2fb9-41be-42ab-85eb-f95348450b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:07.611814 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:07.650599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 365/733] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:07.656662 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2a2dd-59d3-457c-b866-b558c5de7fe2 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:07.710093 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 369/734] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:07.710855 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e2fb9-41be-42ab-85eb-f95348450b00 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:07.763651 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2a2dd-59d3-457c-b866-b558c5de7fe2 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:07.776717 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:07.801382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa742c-9e0e-47af-996e-2615e1413ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:07.802087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa742c-9e0e-47af-996e-2615e1413ec4 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:07.802365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa742c-9e0e-47af-996e-2615e1413ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:07.802687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa742c-9e0e-47af-996e-2615e1413ec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:07.814868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa742c-9e0e-47af-996e-2615e1413ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:07.816507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa742c-9e0e-47af-996e-2615e1413ec4 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-03aa742c-9e0e-47af-996e-2615e1413ec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:07.833570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:07.834602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:07.835526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:07.835526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:07.835526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:07.839355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 366/735] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:07.840251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa742c-9e0e-47af-996e-2615e1413ec4 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:07.856987 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e2fb9-41be-42ab-85eb-f95348450b00 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:07.870720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:07.895906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad517e-dfcb-41c4-9588-1038a788aee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:07.896889 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad517e-dfcb-41c4-9588-1038a788aee5 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:07.897352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad517e-dfcb-41c4-9588-1038a788aee5 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:07.897780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad517e-dfcb-41c4-9588-1038a788aee5 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:07.898587 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad517e-dfcb-41c4-9588-1038a788aee5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:07.900137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad517e-dfcb-41c4-9588-1038a788aee5 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:07.958215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa742c-9e0e-47af-996e-2615e1413ec4 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:07.999479 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fa06f-22fd-417a-94d7-57058ab5af12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:08.000049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fa06f-22fd-417a-94d7-57058ab5af12 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:08.000355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fa06f-22fd-417a-94d7-57058ab5af12 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:08.000801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fa06f-22fd-417a-94d7-57058ab5af12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:08.013472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 370/736] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 29 22:31:07 2022] POST /identity/v3/services => generated 251 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:08.013817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad517e-dfcb-41c4-9588-1038a788aee5 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:08.021134 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fa06f-22fd-417a-94d7-57058ab5af12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-641fa06f-22fd-417a-94d7-57058ab5af12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:08.034503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:08.035636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:08.036548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:08.036548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:08.036548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:08.036548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:08.036548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:08.036548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:08.036548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:08.036548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:08.036548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:08.036548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:08.036548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:31:08.036548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:08.038379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 367/737] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:31:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:08.044465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fa06f-22fd-417a-94d7-57058ab5af12 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:08.156923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:08.170667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:08.175570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fa06f-22fd-417a-94d7-57058ab5af12 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:08.189854 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad517e-dfcb-41c4-9588-1038a788aee5 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:08.221197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0121aab-8297-4fed-8215-afbdb518036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:08.221826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0121aab-8297-4fed-8215-afbdb518036c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:08.222102 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0121aab-8297-4fed-8215-afbdb518036c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:08.222481 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0121aab-8297-4fed-8215-afbdb518036c None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:08.223037 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0121aab-8297-4fed-8215-afbdb518036c None admin] RBAC: Adding query filter params (name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:08.223341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0121aab-8297-4fed-8215-afbdb518036c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:08.225056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0121aab-8297-4fed-8215-afbdb518036c None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:08.234895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 368/738] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:31:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:08.236045 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0121aab-8297-4fed-8215-afbdb518036c None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:08.241590 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c736334-6a2f-41d1-b15c-46e69b474202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:08.242218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c736334-6a2f-41d1-b15c-46e69b474202 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:08.242498 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c736334-6a2f-41d1-b15c-46e69b474202 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:08.242774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c736334-6a2f-41d1-b15c-46e69b474202 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:08.243446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c736334-6a2f-41d1-b15c-46e69b474202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:08.243988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c736334-6a2f-41d1-b15c-46e69b474202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:08.247745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c736334-6a2f-41d1-b15c-46e69b474202 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:08.261202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 371/739] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:08.266417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c736334-6a2f-41d1-b15c-46e69b474202 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:08.372819 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0121aab-8297-4fed-8215-afbdb518036c None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:08.381350 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c736334-6a2f-41d1-b15c-46e69b474202 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:08.412491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509ef62-e983-42a5-94ec-db8ca094c37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:08.413259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509ef62-e983-42a5-94ec-db8ca094c37e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:08.413544 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509ef62-e983-42a5-94ec-db8ca094c37e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:08.413842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509ef62-e983-42a5-94ec-db8ca094c37e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:08.423110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b693b-cb6d-4600-a860-9a222ad37d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:08.424284 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b693b-cb6d-4600-a860-9a222ad37d16 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:08.424598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b693b-cb6d-4600-a860-9a222ad37d16 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:08.424882 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b693b-cb6d-4600-a860-9a222ad37d16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:08.426691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509ef62-e983-42a5-94ec-db8ca094c37e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-0509ef62-e983-42a5-94ec-db8ca094c37e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:08.432288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:08.433239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:08.434122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:08.434122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:08.434122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:08.434122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:08.434122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:08.434122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:08.434122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:08.434122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:08.434122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:08.434122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:08.434122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:08.434122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:08.434122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 369/740] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:08.435360 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509ef62-e983-42a5-94ec-db8ca094c37e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:08.440462 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b693b-cb6d-4600-a860-9a222ad37d16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:08.440462 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b693b-cb6d-4600-a860-9a222ad37d16 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:08.444744 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-2e7b693b-cb6d-4600-a860-9a222ad37d16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:08.457169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:08.458407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:08.459499 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:08.459499 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:08.459499 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:08.459499 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 372/741] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:08.459499 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b693b-cb6d-4600-a860-9a222ad37d16 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:08.464680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:08.564223 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509ef62-e983-42a5-94ec-db8ca094c37e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:08.571412 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b693b-cb6d-4600-a860-9a222ad37d16 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:08.610522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8523c8-2363-46c1-9cb1-dc4be3ebd113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:08.610939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f922f0-c84e-4860-8211-e391e22d2395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:08.611155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8523c8-2363-46c1-9cb1-dc4be3ebd113 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:08.611546 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8523c8-2363-46c1-9cb1-dc4be3ebd113 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:08.611651 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f922f0-c84e-4860-8211-e391e22d2395 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:08.611725 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8523c8-2363-46c1-9cb1-dc4be3ebd113 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:08.611884 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f922f0-c84e-4860-8211-e391e22d2395 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:08.612105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f922f0-c84e-4860-8211-e391e22d2395 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:08.612789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f922f0-c84e-4860-8211-e391e22d2395 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:08.613095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f922f0-c84e-4860-8211-e391e22d2395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:08.614473 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f922f0-c84e-4860-8211-e391e22d2395 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:08.619092 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8523c8-2363-46c1-9cb1-dc4be3ebd113 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:08.620708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8523c8-2363-46c1-9cb1-dc4be3ebd113 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:08.623706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 373/742] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:08.624962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc2fe-fddb-49a3-8c14-34136d09f5f6 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:08.625254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc2fe-fddb-49a3-8c14-34136d09f5f6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:08.625530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc2fe-fddb-49a3-8c14-34136d09f5f6 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:08.626899 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 374/743] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:08.631544 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cc2fe-fddb-49a3-8c14-34136d09f5f6 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:08.638286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-3e8523c8-2363-46c1-9cb1-dc4be3ebd113 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:08.638286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:08.638286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:08.638286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:08.638286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:08.638286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:08.638286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:08.638286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:08.638286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:08.638286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:08.638286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:08.638286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:08.638286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:08.638286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:08.638286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:08.639206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:08.640175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:08.640175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:08.640175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:08.640175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:08.640175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:08.640175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:08.640175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:08.640175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:08.644183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 370/744] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:08.644962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8523c8-2363-46c1-9cb1-dc4be3ebd113 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:08.707126 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:08.716385 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:08.748542 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cc2fe-fddb-49a3-8c14-34136d09f5f6 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:08.750752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8523c8-2363-46c1-9cb1-dc4be3ebd113 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:08.789058 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e745b-8ad6-4f35-a521-aec664b9984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:08.789684 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e745b-8ad6-4f35-a521-aec664b9984e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:08.790031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e745b-8ad6-4f35-a521-aec664b9984e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:08.790313 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e745b-8ad6-4f35-a521-aec664b9984e None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:08.790971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e745b-8ad6-4f35-a521-aec664b9984e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:08.791280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e745b-8ad6-4f35-a521-aec664b9984e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:08.792219 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db558476-ae51-4d8e-9165-c3a79c727700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:08.792727 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e745b-8ad6-4f35-a521-aec664b9984e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:08.792846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db558476-ae51-4d8e-9165-c3a79c727700 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:08.793117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db558476-ae51-4d8e-9165-c3a79c727700 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:08.793389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db558476-ae51-4d8e-9165-c3a79c727700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:08.806019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 375/745] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:08.807021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf58567-a4c9-4522-a591-62c52fcd3d1c None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:08.807309 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf58567-a4c9-4522-a591-62c52fcd3d1c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:08.807586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf58567-a4c9-4522-a591-62c52fcd3d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:08.811249 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db558476-ae51-4d8e-9165-c3a79c727700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:08.812725 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db558476-ae51-4d8e-9165-c3a79c727700 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:08.826444 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-abf58567-a4c9-4522-a591-62c52fcd3d1c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:08.827664 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-abf58567-a4c9-4522-a591-62c52fcd3d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-db558476-ae51-4d8e-9165-c3a79c727700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:08.829326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:08.830762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:08.832445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:08.832445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:08.832445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:08.832445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 371/746] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:08.832445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db558476-ae51-4d8e-9165-c3a79c727700 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:08.916125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 376/747] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:08.916125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf58567-a4c9-4522-a591-62c52fcd3d1c None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:08.956072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db558476-ae51-4d8e-9165-c3a79c727700 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:08.976222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:08.981975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:08.994341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0144539-84bf-4a0c-ab9e-6cd561337268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:08.995259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0144539-84bf-4a0c-ab9e-6cd561337268 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:08.995641 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0144539-84bf-4a0c-ab9e-6cd561337268 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:08.996020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0144539-84bf-4a0c-ab9e-6cd561337268 None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:08.996876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0144539-84bf-4a0c-ab9e-6cd561337268 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:08.997408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0144539-84bf-4a0c-ab9e-6cd561337268 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:08.998950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0144539-84bf-4a0c-ab9e-6cd561337268 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:09.014310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 372/748] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:09.015247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0144539-84bf-4a0c-ab9e-6cd561337268 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:09.041434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf58567-a4c9-4522-a591-62c52fcd3d1c None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:09.080257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e859bd6-edf2-454d-8bf8-151555e0bd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:09.080952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e859bd6-edf2-454d-8bf8-151555e0bd32 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:09.081233 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e859bd6-edf2-454d-8bf8-151555e0bd32 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:09.081554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e859bd6-edf2-454d-8bf8-151555e0bd32 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:09.089442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e859bd6-edf2-454d-8bf8-151555e0bd32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:09.091723 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e859bd6-edf2-454d-8bf8-151555e0bd32 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-3e859bd6-edf2-454d-8bf8-151555e0bd32 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:09.105224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:09.106251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:09.107185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:09.107185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:09.107185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:09.107185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:09.107185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:09.107185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:09.107185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:09.107185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:09.107185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:31:09.107185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:09.107185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 377/749] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 29 22:31:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:09.107767 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e859bd6-edf2-454d-8bf8-151555e0bd32 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:09.127336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0144539-84bf-4a0c-ab9e-6cd561337268 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:09.165329 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f459731-7afc-4c42-8c1a-50cdbfa7faf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:09.166040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f459731-7afc-4c42-8c1a-50cdbfa7faf9 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:09.166326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f459731-7afc-4c42-8c1a-50cdbfa7faf9 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:09.166603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f459731-7afc-4c42-8c1a-50cdbfa7faf9 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:09.167258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f459731-7afc-4c42-8c1a-50cdbfa7faf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:09.167568 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f459731-7afc-4c42-8c1a-50cdbfa7faf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:09.169945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f459731-7afc-4c42-8c1a-50cdbfa7faf9 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:09.188426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 373/750] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:09.189536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f459731-7afc-4c42-8c1a-50cdbfa7faf9 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:09.219395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e859bd6-edf2-454d-8bf8-151555e0bd32 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:09.233111 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:09.239264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:09.261301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcaaf3-c596-4352-ade5-4e1e00ddd08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:09.261901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcaaf3-c596-4352-ade5-4e1e00ddd08b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:09.262205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcaaf3-c596-4352-ade5-4e1e00ddd08b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:09.262473 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcaaf3-c596-4352-ade5-4e1e00ddd08b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:09.263363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bcaaf3-c596-4352-ade5-4e1e00ddd08b None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=a8cccf561d484373a7cb24c5f111900c) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:09.264525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bcaaf3-c596-4352-ade5-4e1e00ddd08b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:09.266174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bcaaf3-c596-4352-ade5-4e1e00ddd08b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:09.280119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 378/751] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:09 2022] GET /identity/v3/role_assignments?user.id=a8cccf561d484373a7cb24c5f111900c&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=a7d59d2982de4bfeb758dce70808029f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:09.280119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcaaf3-c596-4352-ade5-4e1e00ddd08b None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:09.313860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f459731-7afc-4c42-8c1a-50cdbfa7faf9 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:09.361769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42fa09-4f4d-4f03-9929-b1aa03ae9816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:09.362326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42fa09-4f4d-4f03-9929-b1aa03ae9816 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:09.362608 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42fa09-4f4d-4f03-9929-b1aa03ae9816 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:09.362883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42fa09-4f4d-4f03-9929-b1aa03ae9816 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:09.364276 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42fa09-4f4d-4f03-9929-b1aa03ae9816 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:09.364595 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42fa09-4f4d-4f03-9929-b1aa03ae9816 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:09.366498 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42fa09-4f4d-4f03-9929-b1aa03ae9816 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:09.391642 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcaaf3-c596-4352-ade5-4e1e00ddd08b None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:09.392774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 374/752] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Aug 29 22:31:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:09.393639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42fa09-4f4d-4f03-9929-b1aa03ae9816 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:09.442474 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f57624-6271-444e-8181-ad665a386164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:09.443153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f57624-6271-444e-8181-ad665a386164 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:09.443434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f57624-6271-444e-8181-ad665a386164 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:09.443708 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f57624-6271-444e-8181-ad665a386164 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:09.458880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f57624-6271-444e-8181-ad665a386164 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:09.460640 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f57624-6271-444e-8181-ad665a386164 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-92f57624-6271-444e-8181-ad665a386164 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:09.473127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:09.474119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:09.475661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:09.475661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:09.475661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:09.475661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:09.475661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:09.475661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:09.475661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:09.475661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:09.475661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:31:09.475661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:09.475661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 379/753] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 29 22:31:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:09.475661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f57624-6271-444e-8181-ad665a386164 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:09.526558 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:09.527694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42fa09-4f4d-4f03-9929-b1aa03ae9816 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:09.536775 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:09.567004 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6916493-6438-4943-b6b4-44fdaf3df615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:09.567629 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6916493-6438-4943-b6b4-44fdaf3df615 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:09.567913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6916493-6438-4943-b6b4-44fdaf3df615 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:09.568340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6916493-6438-4943-b6b4-44fdaf3df615 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:09.569014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6916493-6438-4943-b6b4-44fdaf3df615 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:09.570558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6916493-6438-4943-b6b4-44fdaf3df615 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:09.594885 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f57624-6271-444e-8181-ad665a386164 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:09.635361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0313f8-3d75-47ac-a6d5-16b8bca30904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:09.635984 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0313f8-3d75-47ac-a6d5-16b8bca30904 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:09.636314 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0313f8-3d75-47ac-a6d5-16b8bca30904 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:09.636598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0313f8-3d75-47ac-a6d5-16b8bca30904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:09.653539 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 375/754] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 29 22:31:09 2022] POST /identity/v3/services => generated 240 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:09.655846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6916493-6438-4943-b6b4-44fdaf3df615 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:09.761247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0313f8-3d75-47ac-a6d5-16b8bca30904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:09.763306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0313f8-3d75-47ac-a6d5-16b8bca30904 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:09.812337 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6916493-6438-4943-b6b4-44fdaf3df615 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:09.829408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:09.858245 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f35624-c42d-4ffd-aec9-528840d98cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:09.859246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f35624-c42d-4ffd-aec9-528840d98cc5 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:09.859926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f35624-c42d-4ffd-aec9-528840d98cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:09.860673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f35624-c42d-4ffd-aec9-528840d98cc5 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:09.861449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f35624-c42d-4ffd-aec9-528840d98cc5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:09.861922 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f35624-c42d-4ffd-aec9-528840d98cc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:09.863439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f35624-c42d-4ffd-aec9-528840d98cc5 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:09.892140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 376/755] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 29 22:31:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:09.901632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f35624-c42d-4ffd-aec9-528840d98cc5 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:09.915113 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 380/756] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:09 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:09.919279 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:09.920072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0313f8-3d75-47ac-a6d5-16b8bca30904 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:10.055882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f35624-c42d-4ffd-aec9-528840d98cc5 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:10.096243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c019b1-32c7-4057-9f44-a4176ee99f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:10.096883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c019b1-32c7-4057-9f44-a4176ee99f72 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:10.097161 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c019b1-32c7-4057-9f44-a4176ee99f72 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:10.097429 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c019b1-32c7-4057-9f44-a4176ee99f72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:10.097535 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0313f8-3d75-47ac-a6d5-16b8bca30904 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:10.110860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c019b1-32c7-4057-9f44-a4176ee99f72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:10.113137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c019b1-32c7-4057-9f44-a4176ee99f72 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-46c019b1-32c7-4057-9f44-a4176ee99f72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:10.133584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:10.134600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:10.135504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:10.135504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:10.135504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:10.135504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 377/757] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:10.136130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29dae7-fccc-49a6-a643-e0c70aaf8e7f None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:10.136244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29dae7-fccc-49a6-a643-e0c70aaf8e7f None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:10.140110 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29dae7-fccc-49a6-a643-e0c70aaf8e7f None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:10.141812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 378/758] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:10.142664 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29dae7-fccc-49a6-a643-e0c70aaf8e7f None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:10.143004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447da82-89ff-407e-87ac-d3f328f312fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:10.143739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447da82-89ff-407e-87ac-d3f328f312fe None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:10.144108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447da82-89ff-407e-87ac-d3f328f312fe None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:10.144455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447da82-89ff-407e-87ac-d3f328f312fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:10.154918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:10.157759 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447da82-89ff-407e-87ac-d3f328f312fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:10.159493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447da82-89ff-407e-87ac-d3f328f312fe None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-3447da82-89ff-407e-87ac-d3f328f312fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:10.177441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:10.178637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:10.179722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:10.179722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:10.179722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:10.184131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 381/759] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:10.184131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72291a-0c62-4e3a-9209-def028d16c45 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:10.184131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72291a-0c62-4e3a-9209-def028d16c45 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:10.184131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72291a-0c62-4e3a-9209-def028d16c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:10.203488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-9a72291a-0c62-4e3a-9209-def028d16c45 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:10.204842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9a72291a-0c62-4e3a-9209-def028d16c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:10.236779 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:10.284133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 382/760] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:10.284133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72291a-0c62-4e3a-9209-def028d16c45 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:10.304152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29dae7-fccc-49a6-a643-e0c70aaf8e7f None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:10.370305 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28323081-4e65-48ea-9b5f-b9dd07e94a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:10.370924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28323081-4e65-48ea-9b5f-b9dd07e94a07 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:10.371205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28323081-4e65-48ea-9b5f-b9dd07e94a07 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:10.371500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28323081-4e65-48ea-9b5f-b9dd07e94a07 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:10.372179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28323081-4e65-48ea-9b5f-b9dd07e94a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:10.372489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28323081-4e65-48ea-9b5f-b9dd07e94a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:10.373868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28323081-4e65-48ea-9b5f-b9dd07e94a07 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:10.401696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 379/761] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:10.407963 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28323081-4e65-48ea-9b5f-b9dd07e94a07 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:10.446547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72291a-0c62-4e3a-9209-def028d16c45 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:10.474095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:10.490349 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64de2c-f2bf-441e-9398-231c509ab366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:10.490966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64de2c-f2bf-441e-9398-231c509ab366 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:10.491240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64de2c-f2bf-441e-9398-231c509ab366 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:10.491509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64de2c-f2bf-441e-9398-231c509ab366 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:10.492183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64de2c-f2bf-441e-9398-231c509ab366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:10.492485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64de2c-f2bf-441e-9398-231c509ab366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:10.493858 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64de2c-f2bf-441e-9398-231c509ab366 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:10.521681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 383/762] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:10.527337 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64de2c-f2bf-441e-9398-231c509ab366 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:10.636116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28323081-4e65-48ea-9b5f-b9dd07e94a07 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:10.664018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:10.669690 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64de2c-f2bf-441e-9398-231c509ab366 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:10.690090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51b864-2fd3-445b-8dd0-40e36690cbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:10.690748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51b864-2fd3-445b-8dd0-40e36690cbf8 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:10.691028 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51b864-2fd3-445b-8dd0-40e36690cbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:10.691301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51b864-2fd3-445b-8dd0-40e36690cbf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:10.707213 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51b864-2fd3-445b-8dd0-40e36690cbf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:10.708858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51b864-2fd3-445b-8dd0-40e36690cbf8 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:10.730936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-cb51b864-2fd3-445b-8dd0-40e36690cbf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:10.730936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:10.730936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:10.730936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:10.730936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:10.730936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:10.730936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:10.730936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:10.730936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:10.730936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:10.730936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:10.730936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:10.730936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:10.730936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:10.730936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:10.731909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:10.732872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:10.732872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:10.732872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:10.732872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:10.732872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:10.732872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:10.732872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:10.732872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:10.737663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 380/763] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:10.737663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51b864-2fd3-445b-8dd0-40e36690cbf8 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:10.753656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514bc1a-198e-458d-9c20-facd882574ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:10.754704 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514bc1a-198e-458d-9c20-facd882574ef None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:10.755131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514bc1a-198e-458d-9c20-facd882574ef None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:10.755547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514bc1a-198e-458d-9c20-facd882574ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:10.764995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514bc1a-198e-458d-9c20-facd882574ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:10.766743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514bc1a-198e-458d-9c20-facd882574ef None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:10.780573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-d514bc1a-198e-458d-9c20-facd882574ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:10.780573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:10.780573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:10.780573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:10.780573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:10.780573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:10.780573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:10.780573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:10.780573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:10.780573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:10.780573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:10.780573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:10.780573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:10.780573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:10.780573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:10.781562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:10.782465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:10.782465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:10.782465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:10.782465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:10.782465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:10.782465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:10.782465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:10.782465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:10.785901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 384/764] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:10.787180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514bc1a-198e-458d-9c20-facd882574ef None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:10.860514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:10.893846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51b864-2fd3-445b-8dd0-40e36690cbf8 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:10.927240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514bc1a-198e-458d-9c20-facd882574ef None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:10.954639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3f496-dd38-4786-a413-8465bcccc51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:10.955288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f496-dd38-4786-a413-8465bcccc51d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:10.955563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f496-dd38-4786-a413-8465bcccc51d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:10.955914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f496-dd38-4786-a413-8465bcccc51d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:10.956450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3f496-dd38-4786-a413-8465bcccc51d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:10.963976 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3f496-dd38-4786-a413-8465bcccc51d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:10.966735 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac5858-87e7-43be-95c6-19b001118fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:10.967695 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac5858-87e7-43be-95c6-19b001118fea None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:10.968214 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac5858-87e7-43be-95c6-19b001118fea None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:10.968777 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac5858-87e7-43be-95c6-19b001118fea None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:10.969687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac5858-87e7-43be-95c6-19b001118fea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:10.970322 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac5858-87e7-43be-95c6-19b001118fea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:10.972035 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac5858-87e7-43be-95c6-19b001118fea None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-05b3f496-dd38-4786-a413-8465bcccc51d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:10.990519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:10.991663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:10.992769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:10.992769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:10.992769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:10.992769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:10.992769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:10.992769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:10.992769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:10.992769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:10.992769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:10.992769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:10.992769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:10.992769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:10.992769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:31:10.992769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:10.994289 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 385/765] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:10.995857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac5858-87e7-43be-95c6-19b001118fea None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:10.998257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 381/766] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Aug 29 22:31:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:10.999201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3f496-dd38-4786-a413-8465bcccc51d None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:11.106638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:11.117623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac5858-87e7-43be-95c6-19b001118fea None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:11.128860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:11.157072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27930fe-ce34-4fc3-87ce-3335ef8a23a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:11.158095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27930fe-ce34-4fc3-87ce-3335ef8a23a8 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:11.158677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27930fe-ce34-4fc3-87ce-3335ef8a23a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:11.159149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27930fe-ce34-4fc3-87ce-3335ef8a23a8 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:11.160144 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27930fe-ce34-4fc3-87ce-3335ef8a23a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:11.160647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27930fe-ce34-4fc3-87ce-3335ef8a23a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:11.162340 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27930fe-ce34-4fc3-87ce-3335ef8a23a8 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:11.176051 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 386/767] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:11.177324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27930fe-ce34-4fc3-87ce-3335ef8a23a8 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:11.253746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3f496-dd38-4786-a413-8465bcccc51d None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:11.291618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27930fe-ce34-4fc3-87ce-3335ef8a23a8 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:11.332810 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9723a6-89ae-419b-aa96-dea6cb800274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:11.333919 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9723a6-89ae-419b-aa96-dea6cb800274 None admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:11.334403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9723a6-89ae-419b-aa96-dea6cb800274 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:11.334877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9723a6-89ae-419b-aa96-dea6cb800274 None admin] PATH_INFO: `/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/f06d910badb84c6aa6b48f3b56b91f82/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:11.337184 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4333a-41c9-4fe3-b291-af3b4bb2265b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:11.337588 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9723a6-89ae-419b-aa96-dea6cb800274 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdd2d14c7e884b8b8f340183a79fd481, user_id=f06d910badb84c6aa6b48f3b56b91f82, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:11.337810 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4333a-41c9-4fe3-b291-af3b4bb2265b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:11.338099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4333a-41c9-4fe3-b291-af3b4bb2265b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:11.338374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4333a-41c9-4fe3-b291-af3b4bb2265b None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:11.339011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4333a-41c9-4fe3-b291-af3b4bb2265b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:11.339318 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4333a-41c9-4fe3-b291-af3b4bb2265b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:11.340308 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9723a6-89ae-419b-aa96-dea6cb800274 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:11.346015 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4333a-41c9-4fe3-b291-af3b4bb2265b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:11.353736 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 382/768] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Aug 29 22:31:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:11.356413 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4333a-41c9-4fe3-b291-af3b4bb2265b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:11.436623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 387/769] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:31:11 2022] PUT /identity/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/f06d910badb84c6aa6b48f3b56b91f82/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:31:11.438083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9723a6-89ae-419b-aa96-dea6cb800274 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:11.485444 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:11.489914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4333a-41c9-4fe3-b291-af3b4bb2265b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:11.505988 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:11.535466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3187a4-af95-4630-871c-0428eabf424a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:11.536108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3187a4-af95-4630-871c-0428eabf424a None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:11.536391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3187a4-af95-4630-871c-0428eabf424a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:11.536662 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3187a4-af95-4630-871c-0428eabf424a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:11.537401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3187a4-af95-4630-871c-0428eabf424a None admin] RBAC: Adding query filter params (role.id=5f0de9d8946f41e8a26d355448071297, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=7506b634db8843d3b0651b1f4fbc4498) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:11.537762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3187a4-af95-4630-871c-0428eabf424a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:11.539289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3187a4-af95-4630-871c-0428eabf424a None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:11.552608 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 383/770] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:11 2022] GET /identity/v3/role_assignments?user.id=7506b634db8843d3b0651b1f4fbc4498&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=5f0de9d8946f41e8a26d355448071297 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:11.554243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4599ee2-b805-4e67-a671-68814a443a09 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:11.554529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4599ee2-b805-4e67-a671-68814a443a09 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:11.554799 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4599ee2-b805-4e67-a671-68814a443a09 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:11.556359 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 384/771] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:11.566949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f03104-2a40-43a9-990b-98450d284595 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:11.567636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f03104-2a40-43a9-990b-98450d284595 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:11.568192 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f03104-2a40-43a9-990b-98450d284595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:11.625273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-24f03104-2a40-43a9-990b-98450d284595 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:11.627295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-24f03104-2a40-43a9-990b-98450d284595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:11.644798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9723a6-89ae-419b-aa96-dea6cb800274 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:11.695982 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459b054-16b5-4211-ae04-60ba879e764f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:11.696996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459b054-16b5-4211-ae04-60ba879e764f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:11.697387 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459b054-16b5-4211-ae04-60ba879e764f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:11.697749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459b054-16b5-4211-ae04-60ba879e764f None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:11.700747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459b054-16b5-4211-ae04-60ba879e764f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:11.701308 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459b054-16b5-4211-ae04-60ba879e764f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:11.702893 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459b054-16b5-4211-ae04-60ba879e764f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:11.709335 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 388/772] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Aug 29 22:31:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:11.716325 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459b054-16b5-4211-ae04-60ba879e764f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:11.731673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 385/773] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:11.817422 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:11.833065 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459b054-16b5-4211-ae04-60ba879e764f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:11.875330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4590f6-f61b-4d2e-9a65-10b8fbd68780 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:11.875758 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4590f6-f61b-4d2e-9a65-10b8fbd68780 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:11.875874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4590f6-f61b-4d2e-9a65-10b8fbd68780 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:11.877508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 386/774] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:11.878394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23cfe1-f3c5-40c8-895d-445b77aa0dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:11.879012 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23cfe1-f3c5-40c8-895d-445b77aa0dc1 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:11.879292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23cfe1-f3c5-40c8-895d-445b77aa0dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:11.879562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23cfe1-f3c5-40c8-895d-445b77aa0dc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:11.880299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23cfe1-f3c5-40c8-895d-445b77aa0dc1 None admin] RBAC: Adding query filter params (interface=public, service_id=28fc8b9d374747a5ae812acb62ef5933, region_id=RegionOne) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:11.880606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23cfe1-f3c5-40c8-895d-445b77aa0dc1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:11.881969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23cfe1-f3c5-40c8-895d-445b77aa0dc1 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:11.882639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142e686-3ca0-422a-9b2e-d987e7395c23 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:11.882934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142e686-3ca0-422a-9b2e-d987e7395c23 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:11.883214 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142e686-3ca0-422a-9b2e-d987e7395c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:11.892535 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 389/775] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 29 22:31:11 2022] GET /identity/v3/endpoints?service_id=28fc8b9d374747a5ae812acb62ef5933&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:11.898936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23cfe1-f3c5-40c8-895d-445b77aa0dc1 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:11.933168 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-3142e686-3ca0-422a-9b2e-d987e7395c23 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:11.934425 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3142e686-3ca0-422a-9b2e-d987e7395c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:12.048441 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 387/776] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:12.065930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23cfe1-f3c5-40c8-895d-445b77aa0dc1 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:12.123137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8029ac-cc30-4841-841b-c898559e31b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:12.123764 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8029ac-cc30-4841-841b-c898559e31b4 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:12.124044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8029ac-cc30-4841-841b-c898559e31b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:12.124357 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8029ac-cc30-4841-841b-c898559e31b4 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:12.124969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8029ac-cc30-4841-841b-c898559e31b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:12.126353 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8029ac-cc30-4841-841b-c898559e31b4 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:12.128079 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142e686-3ca0-422a-9b2e-d987e7395c23 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:12.136565 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 390/777] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 29 22:31:11 2022] GET /identity/v3/services => generated 772 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:12.187268 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:12.291304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142e686-3ca0-422a-9b2e-d987e7395c23 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:12.333758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8029ac-cc30-4841-841b-c898559e31b4 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:12.335572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aafcda-ccdf-41c8-85b0-18df54559473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:12.336270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aafcda-ccdf-41c8-85b0-18df54559473 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:12.336554 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aafcda-ccdf-41c8-85b0-18df54559473 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:12.336827 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aafcda-ccdf-41c8-85b0-18df54559473 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:12.363053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aafcda-ccdf-41c8-85b0-18df54559473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-98aafcda-ccdf-41c8-85b0-18df54559473 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:12.367943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:12.368917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:12.369811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:12.369811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:12.369811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:12.369811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:12.369811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:12.369811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:12.369811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:12.369811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:12.369811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:12.369811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:12.369811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:12.369811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:12.369811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 388/778] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:12.374897 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:12.379992 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aafcda-ccdf-41c8-85b0-18df54559473 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:12.490931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8029ac-cc30-4841-841b-c898559e31b4 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:12.492082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:12.500600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aafcda-ccdf-41c8-85b0-18df54559473 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:12.569741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1dfe7-0dd4-4d8a-becf-970c41e22aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:12.570721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1dfe7-0dd4-4d8a-becf-970c41e22aac None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:12.571203 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1dfe7-0dd4-4d8a-becf-970c41e22aac None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:12.571722 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1dfe7-0dd4-4d8a-becf-970c41e22aac None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:12.575640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1dfe7-0dd4-4d8a-becf-970c41e22aac None admin] RBAC: Adding query filter params (name=admin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:12.579717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1dfe7-0dd4-4d8a-becf-970c41e22aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:12.582103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1dfe7-0dd4-4d8a-becf-970c41e22aac None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:12.595879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf4247-4fa8-4c4a-8b1c-b799bbd1040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:12.599643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 389/779] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:12.599920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf4247-4fa8-4c4a-8b1c-b799bbd1040a None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:12.600248 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf4247-4fa8-4c4a-8b1c-b799bbd1040a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:12.600527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf4247-4fa8-4c4a-8b1c-b799bbd1040a None admin] PATH_INFO: `/v3/services/network` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:12.601127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf4247-4fa8-4c4a-8b1c-b799bbd1040a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:12.602578 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf4247-4fa8-4c4a-8b1c-b799bbd1040a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:12.607441 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1dfe7-0dd4-4d8a-becf-970c41e22aac None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-f2bf4247-4fa8-4c4a-8b1c-b799bbd1040a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:12.625958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:12.627045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:12.627934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:12.627934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:12.627934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:12.627934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:12.627934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:12.627934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:12.627934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:12.627934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:12.627934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:12.627934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:12.627934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:12.627934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:12.627934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:31:12.627934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:12.628770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 391/780] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:12 2022] GET /identity/v3/services/network => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:12.635042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf4247-4fa8-4c4a-8b1c-b799bbd1040a None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:12.726541 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1dfe7-0dd4-4d8a-becf-970c41e22aac None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:12.764581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db4cf6-42b4-45dc-a209-6c316254466d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:12.765390 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db4cf6-42b4-45dc-a209-6c316254466d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:12.765565 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db4cf6-42b4-45dc-a209-6c316254466d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:12.765870 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db4cf6-42b4-45dc-a209-6c316254466d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:12.779798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db4cf6-42b4-45dc-a209-6c316254466d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:12.781506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db4cf6-42b4-45dc-a209-6c316254466d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-21db4cf6-42b4-45dc-a209-6c316254466d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:12.798282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:12.800813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:12.802930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:12.802930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:12.802930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:12.802930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 390/781] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:12.814058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db4cf6-42b4-45dc-a209-6c316254466d None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:12.827126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:12.928569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db4cf6-42b4-45dc-a209-6c316254466d None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:12.966970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52263730-acec-4177-86d5-16b02f49ac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:12.967642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52263730-acec-4177-86d5-16b02f49ac34 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:12.967926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52263730-acec-4177-86d5-16b02f49ac34 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:12.968225 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52263730-acec-4177-86d5-16b02f49ac34 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:12.968878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52263730-acec-4177-86d5-16b02f49ac34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:12.969182 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52263730-acec-4177-86d5-16b02f49ac34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:12.970978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52263730-acec-4177-86d5-16b02f49ac34 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:12.984982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 391/782] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:12.997460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52263730-acec-4177-86d5-16b02f49ac34 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:13.016564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:13.070823 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:13.078310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf4247-4fa8-4c4a-8b1c-b799bbd1040a None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:13.107484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52263730-acec-4177-86d5-16b02f49ac34 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:13.149530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a6ca3-6d84-400b-b6b8-e58e2bc73625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:13.150777 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a6ca3-6d84-400b-b6b8-e58e2bc73625 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.151238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a6ca3-6d84-400b-b6b8-e58e2bc73625 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.151718 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a6ca3-6d84-400b-b6b8-e58e2bc73625 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.152560 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a6ca3-6d84-400b-b6b8-e58e2bc73625 None admin] RBAC: Adding query filter params (name=network) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:13.153556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a6ca3-6d84-400b-b6b8-e58e2bc73625 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:13.155257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a6ca3-6d84-400b-b6b8-e58e2bc73625 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:13.160540 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 392/783] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 29 22:31:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:13.166387 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a6ca3-6d84-400b-b6b8-e58e2bc73625 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:13.170652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fd1e0-3366-4564-be5f-ebab9afa85a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:13.170652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fd1e0-3366-4564-be5f-ebab9afa85a1 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.170652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fd1e0-3366-4564-be5f-ebab9afa85a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.170652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fd1e0-3366-4564-be5f-ebab9afa85a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.176767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fd1e0-3366-4564-be5f-ebab9afa85a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:13.178213 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fd1e0-3366-4564-be5f-ebab9afa85a1 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-043fd1e0-3366-4564-be5f-ebab9afa85a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:13.198803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:13.199848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:13.200855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:13.200855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:13.200855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:13.200855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:13.200855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:13.200855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:13.200855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:13.200855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:13.200855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:31:13.200855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:13.208568 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 392/784] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:13.213882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fd1e0-3366-4564-be5f-ebab9afa85a1 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:13.341354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fd1e0-3366-4564-be5f-ebab9afa85a1 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:13.374831 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:13.380883 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a6ca3-6d84-400b-b6b8-e58e2bc73625 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:13.388407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8998348-0eb4-4777-bc81-a46057e1a076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:13.389371 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8998348-0eb4-4777-bc81-a46057e1a076 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.389796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8998348-0eb4-4777-bc81-a46057e1a076 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.390214 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8998348-0eb4-4777-bc81-a46057e1a076 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.399002 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8998348-0eb4-4777-bc81-a46057e1a076 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:13.399002 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8998348-0eb4-4777-bc81-a46057e1a076 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:13.399002 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8998348-0eb4-4777-bc81-a46057e1a076 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:13.435705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 393/785] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Aug 29 22:31:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:13.440356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8998348-0eb4-4777-bc81-a46057e1a076 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:13.464030 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64ea9d-489e-4653-ba5e-6a27941ddd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:13.464030 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64ea9d-489e-4653-ba5e-6a27941ddd0d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.464681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64ea9d-489e-4653-ba5e-6a27941ddd0d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.465133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64ea9d-489e-4653-ba5e-6a27941ddd0d None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.465917 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64ea9d-489e-4653-ba5e-6a27941ddd0d None admin] RBAC: Adding query filter params (type=network) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:13.466419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64ea9d-489e-4653-ba5e-6a27941ddd0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:13.469698 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64ea9d-489e-4653-ba5e-6a27941ddd0d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:13.484423 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 393/786] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 29 22:31:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:13.489962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64ea9d-489e-4653-ba5e-6a27941ddd0d None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:13.505952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:13.665360 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64ea9d-489e-4653-ba5e-6a27941ddd0d None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:13.719822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c99c5-92d7-4e08-8a07-90ce1898f23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:13.720726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c99c5-92d7-4e08-8a07-90ce1898f23c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.721150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c99c5-92d7-4e08-8a07-90ce1898f23c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.721582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c99c5-92d7-4e08-8a07-90ce1898f23c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.722434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c99c5-92d7-4e08-8a07-90ce1898f23c None admin] RBAC: Adding query filter params (interface=public, service_id=e26d5ac79b0f44128ceca49c90fcca38, region_id=RegionOne) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:13.722890 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c99c5-92d7-4e08-8a07-90ce1898f23c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:13.724417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c99c5-92d7-4e08-8a07-90ce1898f23c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:13.742890 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 394/787] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 29 22:31:13 2022] GET /identity/v3/endpoints?service_id=e26d5ac79b0f44128ceca49c90fcca38&interface=public®ion_id=RegionOne => generated 194 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:13.749111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c99c5-92d7-4e08-8a07-90ce1898f23c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:13.844296 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:13.881158 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c99c5-92d7-4e08-8a07-90ce1898f23c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:13.886293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8998348-0eb4-4777-bc81-a46057e1a076 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:13.921601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52e56d-02c5-4895-bfcb-07e26498e9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:13.922602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52e56d-02c5-4895-bfcb-07e26498e9dc None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.923154 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52e56d-02c5-4895-bfcb-07e26498e9dc None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.923434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52e56d-02c5-4895-bfcb-07e26498e9dc None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.924321 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52e56d-02c5-4895-bfcb-07e26498e9dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:13.925742 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52e56d-02c5-4895-bfcb-07e26498e9dc None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:13.930423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6430-88b2-4488-a9a3-98920c4784a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:13.931355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6430-88b2-4488-a9a3-98920c4784a6 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.936126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6430-88b2-4488-a9a3-98920c4784a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.936301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 395/788] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 29 22:31:13 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:13.936301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd7a83-645c-44ac-a9a6-79a2740fea43 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.936301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd7a83-645c-44ac-a9a6-79a2740fea43 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.936301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd7a83-645c-44ac-a9a6-79a2740fea43 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.936301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 396/789] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:13.936764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6430-88b2-4488-a9a3-98920c4784a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.950669 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360be3b2-0ad3-44aa-9ff7-3e2bf22e1425 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.951000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360be3b2-0ad3-44aa-9ff7-3e2bf22e1425 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.951333 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360be3b2-0ad3-44aa-9ff7-3e2bf22e1425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.967426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb6430-88b2-4488-a9a3-98920c4784a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:13.969617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb6430-88b2-4488-a9a3-98920c4784a6 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:13.974341 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-360be3b2-0ad3-44aa-9ff7-3e2bf22e1425 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:13.975469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-360be3b2-0ad3-44aa-9ff7-3e2bf22e1425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-d7fb6430-88b2-4488-a9a3-98920c4784a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:13.987723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:13.989191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:13.990108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:13.990108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:13.990108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:13.993941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 394/790] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 549 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:13.995511 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc920fce-448a-4113-aa44-734b40d5ef64 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.995795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc920fce-448a-4113-aa44-734b40d5ef64 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.996065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc920fce-448a-4113-aa44-734b40d5ef64 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.997929 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 395/791] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:13.998706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc920fce-448a-4113-aa44-734b40d5ef64 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:14.052171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:14.088136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 397/792] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:14.088136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbcdf2-32a3-46f9-b9da-c16678fe9ef7 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:14.088136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbcdf2-32a3-46f9-b9da-c16678fe9ef7 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:14.088136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbcdf2-32a3-46f9-b9da-c16678fe9ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:14.107756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-1bdbcdf2-32a3-46f9-b9da-c16678fe9ef7 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:14.109014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-1bdbcdf2-32a3-46f9-b9da-c16678fe9ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:14.136615 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc920fce-448a-4113-aa44-734b40d5ef64 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:14.175899 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:14.178169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbd7a4-f9f7-47ff-b28a-a1bf3dbd1a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:14.179028 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbd7a4-f9f7-47ff-b28a-a1bf3dbd1a7c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:14.179529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbd7a4-f9f7-47ff-b28a-a1bf3dbd1a7c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:14.180054 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbd7a4-f9f7-47ff-b28a-a1bf3dbd1a7c None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:14.180941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbd7a4-f9f7-47ff-b28a-a1bf3dbd1a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:14.181449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbd7a4-f9f7-47ff-b28a-a1bf3dbd1a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:14.183236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbd7a4-f9f7-47ff-b28a-a1bf3dbd1a7c None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:14.185310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 398/793] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:14.196981 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 396/794] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:14.206988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbcdf2-32a3-46f9-b9da-c16678fe9ef7 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:14.318452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbcdf2-32a3-46f9-b9da-c16678fe9ef7 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:14.357006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd312bf-fb48-4fa3-be8e-06946567e76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:14.357904 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd312bf-fb48-4fa3-be8e-06946567e76e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:14.358360 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd312bf-fb48-4fa3-be8e-06946567e76e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:14.358782 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd312bf-fb48-4fa3-be8e-06946567e76e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:14.366602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd312bf-fb48-4fa3-be8e-06946567e76e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:14.368274 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd312bf-fb48-4fa3-be8e-06946567e76e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:14.380329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-5dd312bf-fb48-4fa3-be8e-06946567e76e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:14.380329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:14.380329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:14.380329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:14.380329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:14.380329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:14.380329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:14.380329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:14.380329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:14.380329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:14.380329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:14.380329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:14.380329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:14.380329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:14.380329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:14.381940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:14.383063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:14.383063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:14.383063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:14.383063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:14.383063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:14.383063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:14.383063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:14.383063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:14.385164 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 399/795] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:14.392642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbd7a4-f9f7-47ff-b28a-a1bf3dbd1a7c None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:14.407521 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd312bf-fb48-4fa3-be8e-06946567e76e None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:14.520271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:14.576917 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd312bf-fb48-4fa3-be8e-06946567e76e None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:14.580571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:14.587658 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbd7a4-f9f7-47ff-b28a-a1bf3dbd1a7c None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:14.618538 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495ecbf-5ed0-4241-9d1b-a436bc96c3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:14.619300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495ecbf-5ed0-4241-9d1b-a436bc96c3b6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:14.619643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495ecbf-5ed0-4241-9d1b-a436bc96c3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:14.620129 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495ecbf-5ed0-4241-9d1b-a436bc96c3b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:14.628853 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea56701-73d2-4625-94d1-e609bd2b621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:14.629465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea56701-73d2-4625-94d1-e609bd2b621d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:14.629745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea56701-73d2-4625-94d1-e609bd2b621d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:14.630015 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea56701-73d2-4625-94d1-e609bd2b621d None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:14.630702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea56701-73d2-4625-94d1-e609bd2b621d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:14.631011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea56701-73d2-4625-94d1-e609bd2b621d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:14.631733 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495ecbf-5ed0-4241-9d1b-a436bc96c3b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:14.632434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea56701-73d2-4625-94d1-e609bd2b621d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-4495ecbf-5ed0-4241-9d1b-a436bc96c3b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:14.636978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:14.638546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:14.639391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:14.639391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:14.639391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:14.639391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:14.639391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:14.639391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:14.639391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:14.639391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:14.639391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:14.639391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:14.639391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:14.639391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:14.639391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 400/796] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:14.640194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495ecbf-5ed0-4241-9d1b-a436bc96c3b6 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:14.647264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 397/797] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:14.652466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4d53a-3272-42cc-acb1-4d0b810cc0c8 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:14.652970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4d53a-3272-42cc-acb1-4d0b810cc0c8 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:14.653252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4d53a-3272-42cc-acb1-4d0b810cc0c8 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:14.655951 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 398/798] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:14.655951 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4d53a-3272-42cc-acb1-4d0b810cc0c8 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:14.756493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495ecbf-5ed0-4241-9d1b-a436bc96c3b6 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:14.766623 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4d53a-3272-42cc-acb1-4d0b810cc0c8 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:14.773541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:14.796886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd24c40-5825-4072-b9cb-d36b22064ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:14.797636 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24c40-5825-4072-b9cb-d36b22064ea0 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:14.797984 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24c40-5825-4072-b9cb-d36b22064ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:14.798378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24c40-5825-4072-b9cb-d36b22064ea0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:14.803203 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d1ea2-9988-4c31-9bcf-d1c99b6bbee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:14.803814 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d1ea2-9988-4c31-9bcf-d1c99b6bbee1 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:14.804096 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d1ea2-9988-4c31-9bcf-d1c99b6bbee1 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:14.804389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d1ea2-9988-4c31-9bcf-d1c99b6bbee1 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:14.805050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d1ea2-9988-4c31-9bcf-d1c99b6bbee1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:14.805349 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d1ea2-9988-4c31-9bcf-d1c99b6bbee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:14.806704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d1ea2-9988-4c31-9bcf-d1c99b6bbee1 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:14.812183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd24c40-5825-4072-b9cb-d36b22064ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:14.816267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 399/799] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:14.817043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d1ea2-9988-4c31-9bcf-d1c99b6bbee1 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-6bd24c40-5825-4072-b9cb-d36b22064ea0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:14.818087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:14.819062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:14.820055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:14.820055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:14.820055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:14.820055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:14.820055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:14.820055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:14.820055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:14.820055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:14.820055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:14.820055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:14.820055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:31:14.820055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:14.822334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 401/800] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:31:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:14.823777 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd8e5e-2c8d-4950-8c23-2a2261415ea2 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:14.824613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd8e5e-2c8d-4950-8c23-2a2261415ea2 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:14.825582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd8e5e-2c8d-4950-8c23-2a2261415ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:14.845501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-a2fd8e5e-2c8d-4950-8c23-2a2261415ea2 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:14.846433 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:14.846643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a2fd8e5e-2c8d-4950-8c23-2a2261415ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:14.923439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 402/801] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:14.924635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd8e5e-2c8d-4950-8c23-2a2261415ea2 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:14.952552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d1ea2-9988-4c31-9bcf-d1c99b6bbee1 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:14.998437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37901cb-734b-4946-9645-51d3e8171006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:14.999547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37901cb-734b-4946-9645-51d3e8171006 None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:15.000176 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37901cb-734b-4946-9645-51d3e8171006 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:15.000673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37901cb-734b-4946-9645-51d3e8171006 None admin] PATH_INFO: `/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/a8cccf561d484373a7cb24c5f111900c/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:15.004204 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37901cb-734b-4946-9645-51d3e8171006 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdd2d14c7e884b8b8f340183a79fd481, user_id=a8cccf561d484373a7cb24c5f111900c, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:15.006968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37901cb-734b-4946-9645-51d3e8171006 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:15.055194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd8e5e-2c8d-4950-8c23-2a2261415ea2 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:15.059475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:15.100174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 400/802] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:31:14 2022] PUT /identity/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/a8cccf561d484373a7cb24c5f111900c/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:31:15.101556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37901cb-734b-4946-9645-51d3e8171006 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:15.108406 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de85f2a-4a72-43f2-aa6e-444bb363016c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:15.112121 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de85f2a-4a72-43f2-aa6e-444bb363016c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:15.112121 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de85f2a-4a72-43f2-aa6e-444bb363016c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:15.112121 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de85f2a-4a72-43f2-aa6e-444bb363016c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:15.126365 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de85f2a-4a72-43f2-aa6e-444bb363016c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:15.128031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de85f2a-4a72-43f2-aa6e-444bb363016c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-7de85f2a-4a72-43f2-aa6e-444bb363016c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:15.147969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:15.149021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:15.150391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:15.150391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:15.150391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:15.150391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 403/803] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:15.157470 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de85f2a-4a72-43f2-aa6e-444bb363016c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:15.281945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de85f2a-4a72-43f2-aa6e-444bb363016c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:15.285204 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:15.311061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37901cb-734b-4946-9645-51d3e8171006 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:15.327891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c099f7-b193-49a8-b1bb-6e964de50bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:15.328295 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c099f7-b193-49a8-b1bb-6e964de50bb4 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:15.328580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c099f7-b193-49a8-b1bb-6e964de50bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:15.329869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c099f7-b193-49a8-b1bb-6e964de50bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:15.329869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c099f7-b193-49a8-b1bb-6e964de50bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:15.329869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c099f7-b193-49a8-b1bb-6e964de50bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:15.332140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c099f7-b193-49a8-b1bb-6e964de50bb4 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:15.347669 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 404/804] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:15.348923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c099f7-b193-49a8-b1bb-6e964de50bb4 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:15.355098 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f8de1-5b13-4770-b30c-8305fa1b910e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:15.356496 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f8de1-5b13-4770-b30c-8305fa1b910e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:15.356932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f8de1-5b13-4770-b30c-8305fa1b910e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:15.357348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f8de1-5b13-4770-b30c-8305fa1b910e None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:15.358325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f8de1-5b13-4770-b30c-8305fa1b910e None admin] RBAC: Adding query filter params (name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:15.359053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f8de1-5b13-4770-b30c-8305fa1b910e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:15.361356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f8de1-5b13-4770-b30c-8305fa1b910e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:15.373095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 401/805] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:31:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:15.373536 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:15.374280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f8de1-5b13-4770-b30c-8305fa1b910e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:15.492923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c099f7-b193-49a8-b1bb-6e964de50bb4 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:15.501437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f8de1-5b13-4770-b30c-8305fa1b910e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:15.530723 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129ed51-abf8-405f-a705-89f99a3ec348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:15.531673 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129ed51-abf8-405f-a705-89f99a3ec348 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:15.532170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129ed51-abf8-405f-a705-89f99a3ec348 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:15.532623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129ed51-abf8-405f-a705-89f99a3ec348 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:15.533446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129ed51-abf8-405f-a705-89f99a3ec348 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:15.535072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129ed51-abf8-405f-a705-89f99a3ec348 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:15.541752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002c445-8c7f-4240-ac87-366bafa8a6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:15.542473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002c445-8c7f-4240-ac87-366bafa8a6e4 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:15.542827 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002c445-8c7f-4240-ac87-366bafa8a6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:15.543196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002c445-8c7f-4240-ac87-366bafa8a6e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-5129ed51-abf8-405f-a705-89f99a3ec348 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:15.545490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:15.546581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:15.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:15.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:15.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:15.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:15.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:15.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:15.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:15.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:15.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:15.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:15.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:15.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:15.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:31:15.547429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:15.555058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002c445-8c7f-4240-ac87-366bafa8a6e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:15.555058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002c445-8c7f-4240-ac87-366bafa8a6e4 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:15.555417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 405/806] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Aug 29 22:31:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:15.556573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129ed51-abf8-405f-a705-89f99a3ec348 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-1002c445-8c7f-4240-ac87-366bafa8a6e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:15.568908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:15.569945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:15.570910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:15.570910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:15.570910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:15.570910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:15.570910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:15.570910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:15.570910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:15.570910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:15.570910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:31:15.570910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:15.570910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 402/807] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 29 22:31:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:15.571505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002c445-8c7f-4240-ac87-366bafa8a6e4 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:15.577411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:15.666559 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:15.685486 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129ed51-abf8-405f-a705-89f99a3ec348 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:15.701413 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002c445-8c7f-4240-ac87-366bafa8a6e4 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:15.726857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bc344-8dea-4c28-9a44-e05920a9b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:15.727969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bc344-8dea-4c28-9a44-e05920a9b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:15.728553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bc344-8dea-4c28-9a44-e05920a9b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:15.729005 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bc344-8dea-4c28-9a44-e05920a9b9b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:15.740760 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bc344-8dea-4c28-9a44-e05920a9b9b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:15.740949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936729e-fa57-4355-8d03-d479856f984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:15.741577 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936729e-fa57-4355-8d03-d479856f984a None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:15.741936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936729e-fa57-4355-8d03-d479856f984a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:15.742279 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936729e-fa57-4355-8d03-d479856f984a None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:15.743007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936729e-fa57-4355-8d03-d479856f984a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:15.743422 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bc344-8dea-4c28-9a44-e05920a9b9b7 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:15.743526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936729e-fa57-4355-8d03-d479856f984a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:15.745017 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936729e-fa57-4355-8d03-d479856f984a None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:15.755055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 403/808] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Aug 29 22:31:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:15.755055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936729e-fa57-4355-8d03-d479856f984a None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-730bc344-8dea-4c28-9a44-e05920a9b9b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:15.767507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:15.768706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:15.769609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:15.769609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:15.769609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:15.776665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 406/809] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:15.778108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bc344-8dea-4c28-9a44-e05920a9b9b7 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:15.830517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:15.868759 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936729e-fa57-4355-8d03-d479856f984a None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:15.891741 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bc344-8dea-4c28-9a44-e05920a9b9b7 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:15.909387 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a6541-0631-4f37-ab82-f493d5ac06ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:15.910007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6541-0631-4f37-ab82-f493d5ac06ec None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:15.910289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6541-0631-4f37-ab82-f493d5ac06ec None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:15.910566 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6541-0631-4f37-ab82-f493d5ac06ec None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:15.911308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a6541-0631-4f37-ab82-f493d5ac06ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:15.911638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a6541-0631-4f37-ab82-f493d5ac06ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:15.913201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a6541-0631-4f37-ab82-f493d5ac06ec None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:15.931812 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46caa6-565e-45fa-ad15-7036ec01710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:15.932792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46caa6-565e-45fa-ad15-7036ec01710a None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:15.933294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46caa6-565e-45fa-ad15-7036ec01710a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:15.933835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46caa6-565e-45fa-ad15-7036ec01710a None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:15.934686 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46caa6-565e-45fa-ad15-7036ec01710a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:15.935189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46caa6-565e-45fa-ad15-7036ec01710a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:15.936825 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46caa6-565e-45fa-ad15-7036ec01710a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:15.939979 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 404/810] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 29 22:31:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:15.940973 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a6541-0631-4f37-ab82-f493d5ac06ec None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:15.947411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:15.948188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 407/811] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Aug 29 22:31:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:15.949317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46caa6-565e-45fa-ad15-7036ec01710a None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:16.061835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a6541-0631-4f37-ab82-f493d5ac06ec None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:16.067715 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46caa6-565e-45fa-ad15-7036ec01710a None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:16.088841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:16.102792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8a74c-6ec6-4cdd-b42c-02b3d1470a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:16.103459 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8a74c-6ec6-4cdd-b42c-02b3d1470a34 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.103742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8a74c-6ec6-4cdd-b42c-02b3d1470a34 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.104023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8a74c-6ec6-4cdd-b42c-02b3d1470a34 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.104709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8a74c-6ec6-4cdd-b42c-02b3d1470a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:16.105018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8a74c-6ec6-4cdd-b42c-02b3d1470a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:16.106980 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8a74c-6ec6-4cdd-b42c-02b3d1470a34 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:16.113161 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad3819-127a-4627-a8f0-9ca53c3bb81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:16.114089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad3819-127a-4627-a8f0-9ca53c3bb81c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.114432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad3819-127a-4627-a8f0-9ca53c3bb81c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.114712 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad3819-127a-4627-a8f0-9ca53c3bb81c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.125468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 405/812] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:16.125468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8a74c-6ec6-4cdd-b42c-02b3d1470a34 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:16.195655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:16.203895 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad3819-127a-4627-a8f0-9ca53c3bb81c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:16.205449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad3819-127a-4627-a8f0-9ca53c3bb81c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:16.246164 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8a74c-6ec6-4cdd-b42c-02b3d1470a34 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:16.283755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d83b5-b915-4e0f-931b-19404a508521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:16.284448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d83b5-b915-4e0f-931b-19404a508521 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.284731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d83b5-b915-4e0f-931b-19404a508521 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.285001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d83b5-b915-4e0f-931b-19404a508521 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.285676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d83b5-b915-4e0f-931b-19404a508521 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:16.287051 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d83b5-b915-4e0f-931b-19404a508521 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:16.314425 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 408/813] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:31:16.315712 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e2fd5-0d2f-4e16-b214-4adc602ee2f0 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.315993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e2fd5-0d2f-4e16-b214-4adc602ee2f0 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.316316 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e2fd5-0d2f-4e16-b214-4adc602ee2f0 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.317722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 409/814] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:16.318209 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e2fd5-0d2f-4e16-b214-4adc602ee2f0 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:16.420430 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:16.428432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e2fd5-0d2f-4e16-b214-4adc602ee2f0 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:16.462745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a5ffa-fc31-4b20-a7f2-29d00b93b3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:16.463329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a5ffa-fc31-4b20-a7f2-29d00b93b3cc None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.463602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a5ffa-fc31-4b20-a7f2-29d00b93b3cc None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.463875 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a5ffa-fc31-4b20-a7f2-29d00b93b3cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.476117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 406/815] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:31:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:16.476117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d83b5-b915-4e0f-931b-19404a508521 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:16.476443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a5ffa-fc31-4b20-a7f2-29d00b93b3cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:16.476443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a5ffa-fc31-4b20-a7f2-29d00b93b3cc None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-a92a5ffa-fc31-4b20-a7f2-29d00b93b3cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:16.493176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:16.494775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:16.495732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:16.495732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:16.495732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:16.495732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:16.495732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:16.495732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:16.495732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:16.495732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:16.495732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:31:16.495732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:16.495732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 410/816] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 29 22:31:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:16.495732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebea0c0-7eee-4ebc-b7b5-b9b5d1281250 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.496485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebea0c0-7eee-4ebc-b7b5-b9b5d1281250 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.496485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebea0c0-7eee-4ebc-b7b5-b9b5d1281250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.525089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-1ebea0c0-7eee-4ebc-b7b5-b9b5d1281250 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:16.526381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-1ebea0c0-7eee-4ebc-b7b5-b9b5d1281250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:16.552567 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:16.639538 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 411/817] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:16.641094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebea0c0-7eee-4ebc-b7b5-b9b5d1281250 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:16.642237 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d83b5-b915-4e0f-931b-19404a508521 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:16.692720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc045c-91c2-4065-87df-301b6429186b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:16.693372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc045c-91c2-4065-87df-301b6429186b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.693640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc045c-91c2-4065-87df-301b6429186b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.693911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc045c-91c2-4065-87df-301b6429186b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.705984 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc045c-91c2-4065-87df-301b6429186b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:16.707419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc045c-91c2-4065-87df-301b6429186b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-43fc045c-91c2-4065-87df-301b6429186b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:16.724456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:16.725454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:16.726986 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:16.726986 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:16.726986 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:16.726986 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 407/818] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:16.731390 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc045c-91c2-4065-87df-301b6429186b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:16.759572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:16.787863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebea0c0-7eee-4ebc-b7b5-b9b5d1281250 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:16.829181 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64651044-f135-4dd9-98ac-4f88e6aa48fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:16.830210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64651044-f135-4dd9-98ac-4f88e6aa48fe None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.830720 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64651044-f135-4dd9-98ac-4f88e6aa48fe None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.831380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64651044-f135-4dd9-98ac-4f88e6aa48fe None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.832420 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64651044-f135-4dd9-98ac-4f88e6aa48fe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:16.832944 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64651044-f135-4dd9-98ac-4f88e6aa48fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:16.834600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64651044-f135-4dd9-98ac-4f88e6aa48fe None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:16.838257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:16.851336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc045c-91c2-4065-87df-301b6429186b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:16.860193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 412/819] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Aug 29 22:31:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:16.862049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64651044-f135-4dd9-98ac-4f88e6aa48fe None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:16.887439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45c08b-3a58-461a-b3d3-cb8745f9e91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:16.888049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45c08b-3a58-461a-b3d3-cb8745f9e91c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.888347 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45c08b-3a58-461a-b3d3-cb8745f9e91c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.888616 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45c08b-3a58-461a-b3d3-cb8745f9e91c None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.889269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45c08b-3a58-461a-b3d3-cb8745f9e91c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:16.889562 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45c08b-3a58-461a-b3d3-cb8745f9e91c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:16.890940 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45c08b-3a58-461a-b3d3-cb8745f9e91c None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:16.905778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 408/820] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:16.911131 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45c08b-3a58-461a-b3d3-cb8745f9e91c None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:16.979982 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64651044-f135-4dd9-98ac-4f88e6aa48fe None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.021797 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52beda6-cd96-447f-95b0-d86e97c79f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.022415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45c08b-3a58-461a-b3d3-cb8745f9e91c None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.023371 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52beda6-cd96-447f-95b0-d86e97c79f6d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.023857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52beda6-cd96-447f-95b0-d86e97c79f6d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.024406 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52beda6-cd96-447f-95b0-d86e97c79f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.035389 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:17.038289 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52beda6-cd96-447f-95b0-d86e97c79f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.040130 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52beda6-cd96-447f-95b0-d86e97c79f6d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-f52beda6-cd96-447f-95b0-d86e97c79f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:17.057254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:17.058266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:17.059238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:17.059238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:17.059238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:17.060837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb553202-5e01-4554-a247-be598e6fcf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.061507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb553202-5e01-4554-a247-be598e6fcf50 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.061741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb553202-5e01-4554-a247-be598e6fcf50 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.066391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb553202-5e01-4554-a247-be598e6fcf50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.067115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 413/821] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:17.068280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52beda6-cd96-447f-95b0-d86e97c79f6d None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.069566 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb553202-5e01-4554-a247-be598e6fcf50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.071001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb553202-5e01-4554-a247-be598e6fcf50 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.085130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-cb553202-5e01-4554-a247-be598e6fcf50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:17.085130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:17.085130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:17.085130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:17.085130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:17.085130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:17.085130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:17.085130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:17.085130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:17.085130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:17.085130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:17.085130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:17.085130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:17.085130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:17.085130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:17.086095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:17.087409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:17.087409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:17.087409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:17.087409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:17.087409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:17.087409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:17.087409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:17.087409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:17.087409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 409/822] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:17.087409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb553202-5e01-4554-a247-be598e6fcf50 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.104298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:17.192776 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52beda6-cd96-447f-95b0-d86e97c79f6d None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.203870 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb553202-5e01-4554-a247-be598e6fcf50 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.230417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f597e51-1fca-48b8-83cf-bd13c292afa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.231565 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f597e51-1fca-48b8-83cf-bd13c292afa1 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.232069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f597e51-1fca-48b8-83cf-bd13c292afa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.232380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f597e51-1fca-48b8-83cf-bd13c292afa1 None admin] PATH_INFO: `/v3/services/network` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.233006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f597e51-1fca-48b8-83cf-bd13c292afa1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.234443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f597e51-1fca-48b8-83cf-bd13c292afa1 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-1f597e51-1fca-48b8-83cf-bd13c292afa1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:17.244572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:17.245572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:17.247017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:17.247017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:17.247017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:17.247017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:17.247017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:17.247017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:17.247017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:17.247017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:17.247017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:17.247017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:17.247017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:17.247017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:17.247017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:31:17.247017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:17.247768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84414619-4582-4ffc-b928-efa49a6b7ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.247768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84414619-4582-4ffc-b928-efa49a6b7ce9 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.247768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84414619-4582-4ffc-b928-efa49a6b7ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.247768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84414619-4582-4ffc-b928-efa49a6b7ce9 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.248065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84414619-4582-4ffc-b928-efa49a6b7ce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:17.248065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84414619-4582-4ffc-b928-efa49a6b7ce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.249115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84414619-4582-4ffc-b928-efa49a6b7ce9 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.251202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 414/823] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:17 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:17.252180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f597e51-1fca-48b8-83cf-bd13c292afa1 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.267828 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 410/824] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:17.267828 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb976d-d6f9-4fa1-86ed-a68a226a4aec None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.267828 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb976d-d6f9-4fa1-86ed-a68a226a4aec None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.267828 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb976d-d6f9-4fa1-86ed-a68a226a4aec None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.267828 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 411/825] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:17.267828 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb976d-d6f9-4fa1-86ed-a68a226a4aec None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.318789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:17.347952 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:17.365957 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f597e51-1fca-48b8-83cf-bd13c292afa1 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.384146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb976d-d6f9-4fa1-86ed-a68a226a4aec None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.405761 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b439a-9993-4f2a-90d4-3e4466dd8700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.406379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b439a-9993-4f2a-90d4-3e4466dd8700 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.406654 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b439a-9993-4f2a-90d4-3e4466dd8700 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.406923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b439a-9993-4f2a-90d4-3e4466dd8700 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.407622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b439a-9993-4f2a-90d4-3e4466dd8700 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:17.407950 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b439a-9993-4f2a-90d4-3e4466dd8700 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.409593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b439a-9993-4f2a-90d4-3e4466dd8700 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.428031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 415/826] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:17.428031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b439a-9993-4f2a-90d4-3e4466dd8700 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.429618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988ad5c-9af8-4426-ba47-3cf8b045e699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.430283 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988ad5c-9af8-4426-ba47-3cf8b045e699 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.430563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988ad5c-9af8-4426-ba47-3cf8b045e699 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.430840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988ad5c-9af8-4426-ba47-3cf8b045e699 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.431485 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988ad5c-9af8-4426-ba47-3cf8b045e699 None admin] RBAC: Adding query filter params (name=network) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:17.431789 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988ad5c-9af8-4426-ba47-3cf8b045e699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.433194 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988ad5c-9af8-4426-ba47-3cf8b045e699 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.438273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 412/827] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 29 22:31:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:17.443802 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372459cf-46dd-4848-a6ea-c24aab2c5612 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.444105 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372459cf-46dd-4848-a6ea-c24aab2c5612 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.444387 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372459cf-46dd-4848-a6ea-c24aab2c5612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.462883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-372459cf-46dd-4848-a6ea-c24aab2c5612 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:17.464075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-372459cf-46dd-4848-a6ea-c24aab2c5612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:17.542867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b439a-9993-4f2a-90d4-3e4466dd8700 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.553670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 413/828] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:17.554841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372459cf-46dd-4848-a6ea-c24aab2c5612 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.565085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:17.589700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ee65f-07e0-4d14-ad12-52885d16f56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.590673 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ee65f-07e0-4d14-ad12-52885d16f56a None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.591252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ee65f-07e0-4d14-ad12-52885d16f56a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.591806 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ee65f-07e0-4d14-ad12-52885d16f56a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.599952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ee65f-07e0-4d14-ad12-52885d16f56a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.601802 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ee65f-07e0-4d14-ad12-52885d16f56a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.614467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-077ee65f-07e0-4d14-ad12-52885d16f56a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:17.614467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:17.614467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:17.614467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:17.614467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:17.614467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:17.614467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:17.614467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:17.614467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:17.614467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:17.614467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:17.614467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:17.614467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:17.614467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:17.614467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:17.615417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:17.616352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:17.616352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:17.616352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:17.616352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:17.616352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:17.616352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:17.616352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:17.616352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:17.624414 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:17.624683 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 416/829] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:17.626454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ee65f-07e0-4d14-ad12-52885d16f56a None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.665495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372459cf-46dd-4848-a6ea-c24aab2c5612 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.702130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc260971-bef1-4474-9864-bc6f5b546139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.702808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc260971-bef1-4474-9864-bc6f5b546139 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.703443 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc260971-bef1-4474-9864-bc6f5b546139 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.703443 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc260971-bef1-4474-9864-bc6f5b546139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.704146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc260971-bef1-4474-9864-bc6f5b546139 None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=f06d910badb84c6aa6b48f3b56b91f82) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:17.704487 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc260971-bef1-4474-9864-bc6f5b546139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.706032 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc260971-bef1-4474-9864-bc6f5b546139 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.712789 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 414/830] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:17 2022] GET /identity/v3/role_assignments?user.id=f06d910badb84c6aa6b48f3b56b91f82&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=a7d59d2982de4bfeb758dce70808029f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:17.714037 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc260971-bef1-4474-9864-bc6f5b546139 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.744008 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ee65f-07e0-4d14-ad12-52885d16f56a None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.784487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57925432-9516-4f7b-967f-748aece8119c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.785509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57925432-9516-4f7b-967f-748aece8119c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.785998 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57925432-9516-4f7b-967f-748aece8119c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.786484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57925432-9516-4f7b-967f-748aece8119c None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.787404 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57925432-9516-4f7b-967f-748aece8119c None admin] RBAC: Adding query filter params (type=network) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:17.788066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57925432-9516-4f7b-967f-748aece8119c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.789841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57925432-9516-4f7b-967f-748aece8119c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.796889 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 417/831] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 29 22:31:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:17.809249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57925432-9516-4f7b-967f-748aece8119c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.876507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc260971-bef1-4474-9864-bc6f5b546139 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.890526 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:17.908884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:17.926312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2fbaa-5853-462c-8a46-29b7fbec2225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.927075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2fbaa-5853-462c-8a46-29b7fbec2225 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.928069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2fbaa-5853-462c-8a46-29b7fbec2225 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.928486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2fbaa-5853-462c-8a46-29b7fbec2225 None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.932198 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2fbaa-5853-462c-8a46-29b7fbec2225 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:17.932624 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2fbaa-5853-462c-8a46-29b7fbec2225 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.934298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2fbaa-5853-462c-8a46-29b7fbec2225 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.950364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 415/832] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:17.951451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2fbaa-5853-462c-8a46-29b7fbec2225 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.975807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57925432-9516-4f7b-967f-748aece8119c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:18.020431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf0786-0b9b-4e1e-9c4f-2df258f8be2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:18.021235 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf0786-0b9b-4e1e-9c4f-2df258f8be2c None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:18.021670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf0786-0b9b-4e1e-9c4f-2df258f8be2c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:18.022041 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf0786-0b9b-4e1e-9c4f-2df258f8be2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:18.023021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf0786-0b9b-4e1e-9c4f-2df258f8be2c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:18.024631 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf0786-0b9b-4e1e-9c4f-2df258f8be2c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:18.066803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2fbaa-5853-462c-8a46-29b7fbec2225 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:18.105777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf450d53-3ef9-4969-8fcb-48cf73c53eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:18.106411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf450d53-3ef9-4969-8fcb-48cf73c53eeb None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:18.106689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf450d53-3ef9-4969-8fcb-48cf73c53eeb None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:18.106957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf450d53-3ef9-4969-8fcb-48cf73c53eeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:18.122925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 418/833] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:31:17 2022] POST /identity/v3/endpoints => generated 337 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:18.123860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf450d53-3ef9-4969-8fcb-48cf73c53eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:18.130543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf0786-0b9b-4e1e-9c4f-2df258f8be2c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-bf450d53-3ef9-4969-8fcb-48cf73c53eeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:18.130671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:18.131742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:18.132656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:18.132656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:18.132656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:18.132656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:18.132656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:18.132656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:18.132656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:18.132656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:18.132656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:18.132656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:18.132656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:18.132656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:18.132656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 416/834] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:18.135950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf450d53-3ef9-4969-8fcb-48cf73c53eeb None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:18.220720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:18.281764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf450d53-3ef9-4969-8fcb-48cf73c53eeb None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:18.343947 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3c96b-4c81-4eae-bbf8-4de71ae7fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:18.344481 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:18.344601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3c96b-4c81-4eae-bbf8-4de71ae7fae8 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:18.344775 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3c96b-4c81-4eae-bbf8-4de71ae7fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:18.345045 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3c96b-4c81-4eae-bbf8-4de71ae7fae8 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:18.345717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3c96b-4c81-4eae-bbf8-4de71ae7fae8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:18.346017 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3c96b-4c81-4eae-bbf8-4de71ae7fae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:18.347374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3c96b-4c81-4eae-bbf8-4de71ae7fae8 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:18.353323 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf0786-0b9b-4e1e-9c4f-2df258f8be2c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:18.367895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 417/835] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:18.374237 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3c96b-4c81-4eae-bbf8-4de71ae7fae8 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:18.421676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d145a-6155-4814-9858-fcfb5c35ea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:18.423694 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d145a-6155-4814-9858-fcfb5c35ea7c None admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:18.424502 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d145a-6155-4814-9858-fcfb5c35ea7c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:18.425001 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d145a-6155-4814-9858-fcfb5c35ea7c None admin] PATH_INFO: `/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/7506b634db8843d3b0651b1f4fbc4498/roles/5f0de9d8946f41e8a26d355448071297` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:18.449251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d145a-6155-4814-9858-fcfb5c35ea7c None admin] RBAC: Authorizing `identity:create_grant(project_id=fdd2d14c7e884b8b8f340183a79fd481, user_id=7506b634db8843d3b0651b1f4fbc4498, role_id=5f0de9d8946f41e8a26d355448071297)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:18.451267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d145a-6155-4814-9858-fcfb5c35ea7c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:18.503341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3c96b-4c81-4eae-bbf8-4de71ae7fae8 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:18.506264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:18.533282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 419/836] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:31:18 2022] PUT /identity/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/7506b634db8843d3b0651b1f4fbc4498/roles/5f0de9d8946f41e8a26d355448071297 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:31:18.541614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428b8ae-0710-4993-b315-604e0390b28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:18.542479 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428b8ae-0710-4993-b315-604e0390b28b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:18.542862 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428b8ae-0710-4993-b315-604e0390b28b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:18.543332 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428b8ae-0710-4993-b315-604e0390b28b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:18.557301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428b8ae-0710-4993-b315-604e0390b28b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:18.559679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428b8ae-0710-4993-b315-604e0390b28b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-f428b8ae-0710-4993-b315-604e0390b28b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:18.577985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:18.579188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:18.580330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:18.580330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:18.580330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:18.581791 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 418/837] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:18.587543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d145a-6155-4814-9858-fcfb5c35ea7c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:18.715028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d145a-6155-4814-9858-fcfb5c35ea7c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:18.752780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0ee2f-1681-4f26-aab8-ead6e3c7056e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:18.753659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0ee2f-1681-4f26-aab8-ead6e3c7056e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:18.754085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0ee2f-1681-4f26-aab8-ead6e3c7056e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:18.754501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0ee2f-1681-4f26-aab8-ead6e3c7056e None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:18.755297 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0ee2f-1681-4f26-aab8-ead6e3c7056e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:18.755764 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0ee2f-1681-4f26-aab8-ead6e3c7056e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:18.757305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0ee2f-1681-4f26-aab8-ead6e3c7056e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:18.775537 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 420/838] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:18.781846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428b8ae-0710-4993-b315-604e0390b28b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:18.835788 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b753da4-896a-49f9-ba8a-68ea15c6f0e3 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:18.836078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b753da4-896a-49f9-ba8a-68ea15c6f0e3 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:18.836406 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b753da4-896a-49f9-ba8a-68ea15c6f0e3 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:18.838053 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 421/839] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:18.844424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d0336-3778-4c11-8137-e9230d3beec6 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:18.844847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d0336-3778-4c11-8137-e9230d3beec6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:18.845134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d0336-3778-4c11-8137-e9230d3beec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:18.851813 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:18.869507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-158d0336-3778-4c11-8137-e9230d3beec6 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:18.870849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-158d0336-3778-4c11-8137-e9230d3beec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:18.892626 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428b8ae-0710-4993-b315-604e0390b28b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:18.930453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9411-da8b-44e1-8fab-172aa483cf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:18.931123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9411-da8b-44e1-8fab-172aa483cf92 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:18.931404 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9411-da8b-44e1-8fab-172aa483cf92 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:18.931676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9411-da8b-44e1-8fab-172aa483cf92 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:18.939885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f9411-da8b-44e1-8fab-172aa483cf92 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:18.941369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f9411-da8b-44e1-8fab-172aa483cf92 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-b10f9411-da8b-44e1-8fab-172aa483cf92 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:18.953768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:18.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:18.955855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:18.955855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:18.955855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:18.955855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:18.955855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:18.955855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:18.955855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:18.955855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:18.955855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:31:18.955855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:18.955855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 419/841] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:18.956575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 422/841] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:18.962170 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9411-da8b-44e1-8fab-172aa483cf92 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:18.992617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:19.081224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9411-da8b-44e1-8fab-172aa483cf92 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:19.115293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8630232-a9d3-4ec2-af43-e5dab0fddb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:19.116050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8630232-a9d3-4ec2-af43-e5dab0fddb71 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:19.116533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8630232-a9d3-4ec2-af43-e5dab0fddb71 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:19.116912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8630232-a9d3-4ec2-af43-e5dab0fddb71 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:19.117816 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8630232-a9d3-4ec2-af43-e5dab0fddb71 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:19.118216 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8630232-a9d3-4ec2-af43-e5dab0fddb71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:19.119727 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8630232-a9d3-4ec2-af43-e5dab0fddb71 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:19.139133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 420/842] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Aug 29 22:31:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:19.144463 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d0336-3778-4c11-8137-e9230d3beec6 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:19.256963 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8630232-a9d3-4ec2-af43-e5dab0fddb71 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:19.266359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d0336-3778-4c11-8137-e9230d3beec6 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:19.308161 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:19.318360 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150d99a-27d9-449d-8130-a8946eadf9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:19.319331 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150d99a-27d9-449d-8130-a8946eadf9a8 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:19.324284 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150d99a-27d9-449d-8130-a8946eadf9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:19.324284 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150d99a-27d9-449d-8130-a8946eadf9a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:19.365773 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:19.392389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8630232-a9d3-4ec2-af43-e5dab0fddb71 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:19.415635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150d99a-27d9-449d-8130-a8946eadf9a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:19.417345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150d99a-27d9-449d-8130-a8946eadf9a8 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:19.442260 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41918b5-0984-4da8-857c-142a3e3559c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:19.443633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41918b5-0984-4da8-857c-142a3e3559c8 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:19.444059 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41918b5-0984-4da8-857c-142a3e3559c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:19.444540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41918b5-0984-4da8-857c-142a3e3559c8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:19.445551 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41918b5-0984-4da8-857c-142a3e3559c8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:19.447762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41918b5-0984-4da8-857c-142a3e3559c8 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-d41918b5-0984-4da8-857c-142a3e3559c8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:19.460730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:19.462231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:19.463271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:19.463271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:19.463271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:19.463271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:19.463271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:19.463271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:19.463271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:19.463271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:19.463271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:19.463271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:19.463271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:19.463271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:19.463271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:31:19.463271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:19.470508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 421/843] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:31:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:19.473404 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41918b5-0984-4da8-857c-142a3e3559c8 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:19.544012 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 423/844] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:31:19.545326 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150d99a-27d9-449d-8130-a8946eadf9a8 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:19.585021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:19.620320 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41918b5-0984-4da8-857c-142a3e3559c8 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:19.657742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d925498-e344-4512-be0e-e7e1197e05ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:19.658528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d925498-e344-4512-be0e-e7e1197e05ba None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:19.658909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d925498-e344-4512-be0e-e7e1197e05ba None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:19.659283 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d925498-e344-4512-be0e-e7e1197e05ba None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:19.660019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d925498-e344-4512-be0e-e7e1197e05ba None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:19.660444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d925498-e344-4512-be0e-e7e1197e05ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:19.661905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d925498-e344-4512-be0e-e7e1197e05ba None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:19.667102 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 422/845] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:31:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:19.672825 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150d99a-27d9-449d-8130-a8946eadf9a8 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:19.673733 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d925498-e344-4512-be0e-e7e1197e05ba None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:19.682795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:19.709674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695afed-f6c8-4a42-84bf-7dc1729d734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:19.710394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695afed-f6c8-4a42-84bf-7dc1729d734a None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:19.710738 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695afed-f6c8-4a42-84bf-7dc1729d734a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:19.711079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695afed-f6c8-4a42-84bf-7dc1729d734a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:19.722440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695afed-f6c8-4a42-84bf-7dc1729d734a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:19.724127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695afed-f6c8-4a42-84bf-7dc1729d734a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-3695afed-f6c8-4a42-84bf-7dc1729d734a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:19.741946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:19.743304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:19.744468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:19.744468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:19.744468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:19.750607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 424/846] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:19.752054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695afed-f6c8-4a42-84bf-7dc1729d734a None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:19.806953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d925498-e344-4512-be0e-e7e1197e05ba None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:19.844152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cb267-7892-46c5-93ad-1d6726e4fa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:19.844774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cb267-7892-46c5-93ad-1d6726e4fa62 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:19.845056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cb267-7892-46c5-93ad-1d6726e4fa62 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:19.845329 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cb267-7892-46c5-93ad-1d6726e4fa62 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:19.846078 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cb267-7892-46c5-93ad-1d6726e4fa62 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:19.846386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cb267-7892-46c5-93ad-1d6726e4fa62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:19.847819 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cb267-7892-46c5-93ad-1d6726e4fa62 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:19.854350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 423/847] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:31:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:19.856851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:19.875831 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695afed-f6c8-4a42-84bf-7dc1729d734a None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:19.886865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9a990-6344-4397-b3e7-98a24de1a8be None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:19.887229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9a990-6344-4397-b3e7-98a24de1a8be None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:19.887429 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9a990-6344-4397-b3e7-98a24de1a8be None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:19.889063 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 424/848] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:19.895842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3293eee-dece-4ac0-9f99-6c5977f05ce8 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:19.896467 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3293eee-dece-4ac0-9f99-6c5977f05ce8 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:19.897386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3293eee-dece-4ac0-9f99-6c5977f05ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:19.918665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27505b02-a23c-4a1a-9191-42b909c53c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:19.919291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27505b02-a23c-4a1a-9191-42b909c53c6e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:19.919516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-b3293eee-dece-4ac0-9f99-6c5977f05ce8 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:19.919639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27505b02-a23c-4a1a-9191-42b909c53c6e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:19.919824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27505b02-a23c-4a1a-9191-42b909c53c6e None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:19.920517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27505b02-a23c-4a1a-9191-42b909c53c6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:19.920818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27505b02-a23c-4a1a-9191-42b909c53c6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:19.921679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b3293eee-dece-4ac0-9f99-6c5977f05ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:19.922237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27505b02-a23c-4a1a-9191-42b909c53c6e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:19.937300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 425/849] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:19.943294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27505b02-a23c-4a1a-9191-42b909c53c6e None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:19.998043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:20.012459 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 425/850] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:20.062582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27505b02-a23c-4a1a-9191-42b909c53c6e None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:20.103412 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e14e50-7db8-4481-90ab-540ebaf64e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:20.104434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e14e50-7db8-4481-90ab-540ebaf64e7c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:20.104859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e14e50-7db8-4481-90ab-540ebaf64e7c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:20.105274 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e14e50-7db8-4481-90ab-540ebaf64e7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:20.113418 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e14e50-7db8-4481-90ab-540ebaf64e7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:20.115057 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e14e50-7db8-4481-90ab-540ebaf64e7c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:20.127400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-35e14e50-7db8-4481-90ab-540ebaf64e7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:20.127400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:20.127400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:20.127400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:20.127400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:20.127400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:20.127400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:20.127400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:20.127400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:20.127400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:20.127400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:20.127400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:20.127400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:20.127400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:20.127400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:20.128515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:20.129615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:20.129615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:20.129615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:20.129615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:20.129615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:20.129615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:20.129615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:20.129615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:20.131700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 426/851] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:20.141202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3293eee-dece-4ac0-9f99-6c5977f05ce8 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:20.248414 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3293eee-dece-4ac0-9f99-6c5977f05ce8 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:20.290978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a3736-c337-4bbc-ba3c-96c9e011d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:20.291449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e14e50-7db8-4481-90ab-540ebaf64e7c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:20.291582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a3736-c337-4bbc-ba3c-96c9e011d604 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:20.291860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a3736-c337-4bbc-ba3c-96c9e011d604 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:20.292159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a3736-c337-4bbc-ba3c-96c9e011d604 None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:20.292857 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a3736-c337-4bbc-ba3c-96c9e011d604 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:20.293199 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a3736-c337-4bbc-ba3c-96c9e011d604 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:20.294622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a3736-c337-4bbc-ba3c-96c9e011d604 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:20.302507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:20.307371 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 426/852] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:20.317595 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a3736-c337-4bbc-ba3c-96c9e011d604 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:20.378837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:20.426090 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e14e50-7db8-4481-90ab-540ebaf64e7c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:20.439378 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a3736-c337-4bbc-ba3c-96c9e011d604 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:20.463559 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f740936-f4d8-49c1-afb6-3fd34ce7311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:20.464518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f740936-f4d8-49c1-afb6-3fd34ce7311b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:20.465474 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f740936-f4d8-49c1-afb6-3fd34ce7311b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:20.465923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f740936-f4d8-49c1-afb6-3fd34ce7311b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:20.466727 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f740936-f4d8-49c1-afb6-3fd34ce7311b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:20.468441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f740936-f4d8-49c1-afb6-3fd34ce7311b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-9f740936-f4d8-49c1-afb6-3fd34ce7311b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:20.482364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:20.483557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:20.484888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:20.484888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:20.484888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:20.484888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:20.484888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:20.484888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:20.484888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:20.484888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:20.484888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:20.484888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:20.484888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:20.484888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:20.484888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:31:20.484888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:20.486603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718b17d-f1c6-43ed-b402-df3d547b20bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:20.487319 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718b17d-f1c6-43ed-b402-df3d547b20bf None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:20.487732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 427/853] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Aug 29 22:31:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:20.488486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718b17d-f1c6-43ed-b402-df3d547b20bf None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:20.489316 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718b17d-f1c6-43ed-b402-df3d547b20bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:20.489958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718b17d-f1c6-43ed-b402-df3d547b20bf None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=a8cccf561d484373a7cb24c5f111900c) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:20.490411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718b17d-f1c6-43ed-b402-df3d547b20bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:20.492159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718b17d-f1c6-43ed-b402-df3d547b20bf None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:20.493079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f740936-f4d8-49c1-afb6-3fd34ce7311b None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:20.506329 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 427/854] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:20 2022] GET /identity/v3/role_assignments?user.id=a8cccf561d484373a7cb24c5f111900c&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=a7d59d2982de4bfeb758dce70808029f => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:20.582839 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:20.620918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f740936-f4d8-49c1-afb6-3fd34ce7311b None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:20.657948 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19595686-7f99-4c65-ad1a-63ac8b9ca638 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:20.658602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19595686-7f99-4c65-ad1a-63ac8b9ca638 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:20.659070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19595686-7f99-4c65-ad1a-63ac8b9ca638 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:20.660899 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 428/855] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:20.661509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b059a-3e96-499f-b4ae-b43e8c410093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:20.662144 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b059a-3e96-499f-b4ae-b43e8c410093 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:20.662420 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b059a-3e96-499f-b4ae-b43e8c410093 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:20.662683 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b059a-3e96-499f-b4ae-b43e8c410093 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:20.663319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b059a-3e96-499f-b4ae-b43e8c410093 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:20.663617 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b059a-3e96-499f-b4ae-b43e8c410093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:20.666865 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b059a-3e96-499f-b4ae-b43e8c410093 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:20.669338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47176d93-1cdf-4b34-aec2-3f46dbe0d034 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:20.669703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47176d93-1cdf-4b34-aec2-3f46dbe0d034 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:20.670049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47176d93-1cdf-4b34-aec2-3f46dbe0d034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:20.671863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 428/856] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 29 22:31:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:20.677951 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b059a-3e96-499f-b4ae-b43e8c410093 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:20.693305 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-47176d93-1cdf-4b34-aec2-3f46dbe0d034 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:20.694508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-47176d93-1cdf-4b34-aec2-3f46dbe0d034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:20.782934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 429/857] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:20.816042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b059a-3e96-499f-b4ae-b43e8c410093 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:20.849581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:20.854885 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93318e9-6d72-41aa-9735-9ddeddb789a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:20.855591 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93318e9-6d72-41aa-9735-9ddeddb789a7 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:20.856437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93318e9-6d72-41aa-9735-9ddeddb789a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:20.856756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93318e9-6d72-41aa-9735-9ddeddb789a7 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:20.857392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93318e9-6d72-41aa-9735-9ddeddb789a7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:20.857709 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93318e9-6d72-41aa-9735-9ddeddb789a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:20.859070 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93318e9-6d72-41aa-9735-9ddeddb789a7 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:20.863975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 429/858] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 29 22:31:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:21.062358 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47176d93-1cdf-4b34-aec2-3f46dbe0d034 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:21.114806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:21.168258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47176d93-1cdf-4b34-aec2-3f46dbe0d034 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:21.204324 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365580f-578e-4d36-a769-b90dd0f6a4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:21.205312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365580f-578e-4d36-a769-b90dd0f6a4b8 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:21.205785 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365580f-578e-4d36-a769-b90dd0f6a4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:21.206265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365580f-578e-4d36-a769-b90dd0f6a4b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:21.218011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365580f-578e-4d36-a769-b90dd0f6a4b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-2365580f-578e-4d36-a769-b90dd0f6a4b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:21.223171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:21.224115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:21.224982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:21.224982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:21.224982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:21.224982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:21.224982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:21.224982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:21.224982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:21.224982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:21.224982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:21.224982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:21.224982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:31:21.224982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:21.231768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 430/859] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:31:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:21.237285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93318e9-6d72-41aa-9735-9ddeddb789a7 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:21.347613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93318e9-6d72-41aa-9735-9ddeddb789a7 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:21.384508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193b677-b17e-4077-a2b3-be352352d3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:21.385029 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193b677-b17e-4077-a2b3-be352352d3ed None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:21.385306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193b677-b17e-4077-a2b3-be352352d3ed None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:21.385574 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193b677-b17e-4077-a2b3-be352352d3ed None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:21.386303 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193b677-b17e-4077-a2b3-be352352d3ed None admin] RBAC: Adding query filter params (name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:21.386601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193b677-b17e-4077-a2b3-be352352d3ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:21.388725 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193b677-b17e-4077-a2b3-be352352d3ed None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:21.397690 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 430/860] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:31:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:21.403621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365580f-578e-4d36-a769-b90dd0f6a4b8 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:21.512013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365580f-578e-4d36-a769-b90dd0f6a4b8 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:21.523838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:21.549860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f0c64-41f2-469f-916e-75df6c78368f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:21.550876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f0c64-41f2-469f-916e-75df6c78368f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:21.551354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f0c64-41f2-469f-916e-75df6c78368f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:21.551841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f0c64-41f2-469f-916e-75df6c78368f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:21.564107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f0c64-41f2-469f-916e-75df6c78368f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:21.566115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f0c64-41f2-469f-916e-75df6c78368f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-2e0f0c64-41f2-469f-916e-75df6c78368f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:21.589482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:21.590503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:21.591396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:21.591396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:21.591396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:21.598126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 431/861] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:21.599876 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193b677-b17e-4077-a2b3-be352352d3ed None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:21.662266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:21.711110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193b677-b17e-4077-a2b3-be352352d3ed None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:21.749819 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230e526-b296-4d68-b286-0ebc3793bb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:21.750477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230e526-b296-4d68-b286-0ebc3793bb2d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:21.750758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230e526-b296-4d68-b286-0ebc3793bb2d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:21.751029 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230e526-b296-4d68-b286-0ebc3793bb2d None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:21.751683 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230e526-b296-4d68-b286-0ebc3793bb2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:21.752015 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230e526-b296-4d68-b286-0ebc3793bb2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:21.753415 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230e526-b296-4d68-b286-0ebc3793bb2d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:21.766724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 431/862] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:21.772521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f0c64-41f2-469f-916e-75df6c78368f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:21.879061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f0c64-41f2-469f-916e-75df6c78368f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:21.881073 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed4775-cc28-46e4-ba40-1667f3506f9c None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:21.881286 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed4775-cc28-46e4-ba40-1667f3506f9c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:21.881515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed4775-cc28-46e4-ba40-1667f3506f9c None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:21.882968 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 432/863] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:21.888834 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe1c27-067b-437d-977b-3abe05c8ada7 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:21.889113 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe1c27-067b-437d-977b-3abe05c8ada7 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:21.889381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe1c27-067b-437d-977b-3abe05c8ada7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:21.909050 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-f1fe1c27-067b-437d-977b-3abe05c8ada7 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:21.910328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f1fe1c27-067b-437d-977b-3abe05c8ada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:21.915447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e92cb-5641-43cf-9454-412e1bab15a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:21.916020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e92cb-5641-43cf-9454-412e1bab15a3 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:21.916344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e92cb-5641-43cf-9454-412e1bab15a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:21.916629 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e92cb-5641-43cf-9454-412e1bab15a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:21.924902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e92cb-5641-43cf-9454-412e1bab15a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:21.926388 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e92cb-5641-43cf-9454-412e1bab15a3 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-0c4e92cb-5641-43cf-9454-412e1bab15a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:21.938509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:21.939507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:21.940518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:21.940518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:21.940518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:21.940518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:21.940518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:21.940518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:21.940518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:21.940518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:21.940518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:31:21.940518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:21.940518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 432/864] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 29 22:31:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:21.945431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e92cb-5641-43cf-9454-412e1bab15a3 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:21.974315 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:22.005330 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 433/865] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:22.060712 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e92cb-5641-43cf-9454-412e1bab15a3 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:22.096337 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49d473-f4ef-4aae-a32f-20331e5bb7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:22.096943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49d473-f4ef-4aae-a32f-20331e5bb7de None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:22.097218 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49d473-f4ef-4aae-a32f-20331e5bb7de None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:22.097521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49d473-f4ef-4aae-a32f-20331e5bb7de None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:22.098252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49d473-f4ef-4aae-a32f-20331e5bb7de None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:22.098553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49d473-f4ef-4aae-a32f-20331e5bb7de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:22.099961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49d473-f4ef-4aae-a32f-20331e5bb7de None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:22.119137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 433/866] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Aug 29 22:31:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:22.124788 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe1c27-067b-437d-977b-3abe05c8ada7 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:22.215322 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:22.227567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe1c27-067b-437d-977b-3abe05c8ada7 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:22.263571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51224bf-f524-4669-8788-8d3d0af0b4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:22.264215 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51224bf-f524-4669-8788-8d3d0af0b4a4 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:22.264491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51224bf-f524-4669-8788-8d3d0af0b4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:22.264766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51224bf-f524-4669-8788-8d3d0af0b4a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:22.278223 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49d473-f4ef-4aae-a32f-20331e5bb7de None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:22.344264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51224bf-f524-4669-8788-8d3d0af0b4a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:22.345723 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51224bf-f524-4669-8788-8d3d0af0b4a4 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:22.392690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:22.399649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:22.414313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49d473-f4ef-4aae-a32f-20331e5bb7de None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:22.453345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b96c88-6176-4a56-b968-d59bb9e584f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:22.454210 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b96c88-6176-4a56-b968-d59bb9e584f5 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:22.454637 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b96c88-6176-4a56-b968-d59bb9e584f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:22.455057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b96c88-6176-4a56-b968-d59bb9e584f5 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:22.455978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b96c88-6176-4a56-b968-d59bb9e584f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:22.457536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b96c88-6176-4a56-b968-d59bb9e584f5 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:22.459578 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 434/867] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:22 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:31:22.460963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51224bf-f524-4669-8788-8d3d0af0b4a4 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:22.558956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 434/868] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 29 22:31:22 2022] POST /identity/v3/services => generated 251 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:31:22.592301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51224bf-f524-4669-8788-8d3d0af0b4a4 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:22.636410 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706ff7a-c6f1-44dd-830c-fabf37c25ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:22.637891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706ff7a-c6f1-44dd-830c-fabf37c25ab2 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:22.638344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706ff7a-c6f1-44dd-830c-fabf37c25ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:22.638760 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706ff7a-c6f1-44dd-830c-fabf37c25ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:22.642466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cd1a0-7a01-407f-b15c-3cee83914a86 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:22.642712 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cd1a0-7a01-407f-b15c-3cee83914a86 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:22.643097 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cd1a0-7a01-407f-b15c-3cee83914a86 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:22.646215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 435/869] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:22.651290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3daa44-fdc5-4625-b895-e3c055516f61 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:22.651521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3daa44-fdc5-4625-b895-e3c055516f61 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:22.651903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3daa44-fdc5-4625-b895-e3c055516f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:22.653534 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706ff7a-c6f1-44dd-830c-fabf37c25ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:22.655218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706ff7a-c6f1-44dd-830c-fabf37c25ab2 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:22.663664 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-e706ff7a-c6f1-44dd-830c-fabf37c25ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:22.672407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:22.673630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:22.674981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:22.674981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:22.674981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:22.675224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-dc3daa44-fdc5-4625-b895-e3c055516f61 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:22.676967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 435/870] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:22.680212 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-dc3daa44-fdc5-4625-b895-e3c055516f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:22.682808 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706ff7a-c6f1-44dd-830c-fabf37c25ab2 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:22.766827 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 436/871] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:22.798054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706ff7a-c6f1-44dd-830c-fabf37c25ab2 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:22.834163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa5bcb-add0-4bd6-88de-ec979c1139c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:22.834775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa5bcb-add0-4bd6-88de-ec979c1139c1 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:22.835060 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa5bcb-add0-4bd6-88de-ec979c1139c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:22.835328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa5bcb-add0-4bd6-88de-ec979c1139c1 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:22.836026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa5bcb-add0-4bd6-88de-ec979c1139c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:22.836307 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa5bcb-add0-4bd6-88de-ec979c1139c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:22.837678 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa5bcb-add0-4bd6-88de-ec979c1139c1 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:22.856055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 436/872] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:22.860822 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3daa44-fdc5-4625-b895-e3c055516f61 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:22.926569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c7545-ce91-4783-ab92-8d52cdc5544d None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:22.926943 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c7545-ce91-4783-ab92-8d52cdc5544d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:22.927110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c7545-ce91-4783-ab92-8d52cdc5544d None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:22.928712 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 437/873] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:22.934620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bf904-8361-4332-8c53-af97e440c7a1 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:22.934901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bf904-8361-4332-8c53-af97e440c7a1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:22.935169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bf904-8361-4332-8c53-af97e440c7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:22.942712 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:22.954612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-989bf904-8361-4332-8c53-af97e440c7a1 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:22.956323 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-989bf904-8361-4332-8c53-af97e440c7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:22.987524 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3daa44-fdc5-4625-b895-e3c055516f61 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:23.010916 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:23.026349 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb884ad3-4a5e-46df-8690-cbeaf6252f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:23.027945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb884ad3-4a5e-46df-8690-cbeaf6252f04 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:23.028424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb884ad3-4a5e-46df-8690-cbeaf6252f04 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:23.028853 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb884ad3-4a5e-46df-8690-cbeaf6252f04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:23.032324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 438/874] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:23.038571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb884ad3-4a5e-46df-8690-cbeaf6252f04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:23.040257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb884ad3-4a5e-46df-8690-cbeaf6252f04 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:23.052754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-cb884ad3-4a5e-46df-8690-cbeaf6252f04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:23.052754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:23.052754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:23.052754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:23.052754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:23.052754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:23.052754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:23.052754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:23.052754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:23.052754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:23.052754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:23.052754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:23.052754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:23.052754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:23.052754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:23.053692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:23.054665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:23.054665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:23.054665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:23.054665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:23.054665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:23.054665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:23.054665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:23.054665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:23.056964 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 437/875] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:23.065675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bf904-8361-4332-8c53-af97e440c7a1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:23.128605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb884ad3-4a5e-46df-8690-cbeaf6252f04 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:23.243708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb884ad3-4a5e-46df-8690-cbeaf6252f04 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:23.268038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bf904-8361-4332-8c53-af97e440c7a1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:23.277485 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:23.283922 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e9710-e0a9-4eb2-8bd9-39347b496565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:23.285266 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e9710-e0a9-4eb2-8bd9-39347b496565 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:23.293718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e9710-e0a9-4eb2-8bd9-39347b496565 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:23.293718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e9710-e0a9-4eb2-8bd9-39347b496565 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:23.293718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e9710-e0a9-4eb2-8bd9-39347b496565 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:23.293718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e9710-e0a9-4eb2-8bd9-39347b496565 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-687e9710-e0a9-4eb2-8bd9-39347b496565 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:23.298344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:23.299656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:23.301246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:23.301246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:23.301246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:23.301246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:23.301246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:23.301246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:23.301246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:23.301246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:23.301246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:23.301246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:23.301246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:23.301246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:23.301246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:31:23.301246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:23.301246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 438/876] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 29 22:31:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:23.309904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e9710-e0a9-4eb2-8bd9-39347b496565 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:23.330978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf8641-7be0-44d2-8d3e-585b5e9fc0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:23.331786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf8641-7be0-44d2-8d3e-585b5e9fc0a6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:23.332213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf8641-7be0-44d2-8d3e-585b5e9fc0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:23.332576 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf8641-7be0-44d2-8d3e-585b5e9fc0a6 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:23.333394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf8641-7be0-44d2-8d3e-585b5e9fc0a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:23.333806 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf8641-7be0-44d2-8d3e-585b5e9fc0a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:23.335496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf8641-7be0-44d2-8d3e-585b5e9fc0a6 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:23.353024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 439/877] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:23.353024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf8641-7be0-44d2-8d3e-585b5e9fc0a6 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:23.401398 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:23.441113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e9710-e0a9-4eb2-8bd9-39347b496565 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:23.470127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf8641-7be0-44d2-8d3e-585b5e9fc0a6 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:23.479099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a6a63-aedd-44ab-8417-985282707d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:23.479715 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a6a63-aedd-44ab-8417-985282707d93 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:23.479988 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a6a63-aedd-44ab-8417-985282707d93 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:23.480311 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a6a63-aedd-44ab-8417-985282707d93 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:23.481459 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a6a63-aedd-44ab-8417-985282707d93 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:23.481761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a6a63-aedd-44ab-8417-985282707d93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:23.483118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a6a63-aedd-44ab-8417-985282707d93 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:23.487945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 439/878] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 29 22:31:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:23.488801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a6a63-aedd-44ab-8417-985282707d93 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:23.523457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98166cb-952d-487b-97c8-627ff25d0f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:23.524069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98166cb-952d-487b-97c8-627ff25d0f71 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:23.524370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98166cb-952d-487b-97c8-627ff25d0f71 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:23.524639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98166cb-952d-487b-97c8-627ff25d0f71 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:23.525292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98166cb-952d-487b-97c8-627ff25d0f71 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:23.526660 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98166cb-952d-487b-97c8-627ff25d0f71 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:23.558106 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:23.602371 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a6a63-aedd-44ab-8417-985282707d93 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:23.615013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 440/879] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 29 22:31:23 2022] POST /identity/v3/services => generated 269 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:23.616079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98166cb-952d-487b-97c8-627ff25d0f71 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:23.659096 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca99cb-5114-498a-a0f7-7bda863ec3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:23.660052 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca99cb-5114-498a-a0f7-7bda863ec3b4 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:23.660881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca99cb-5114-498a-a0f7-7bda863ec3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:23.661341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca99cb-5114-498a-a0f7-7bda863ec3b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:23.662387 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca99cb-5114-498a-a0f7-7bda863ec3b4 None admin] RBAC: Adding query filter params (role.id=5f0de9d8946f41e8a26d355448071297, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=7506b634db8843d3b0651b1f4fbc4498) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:23.662939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca99cb-5114-498a-a0f7-7bda863ec3b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:23.664960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca99cb-5114-498a-a0f7-7bda863ec3b4 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:23.673694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 440/880] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:23 2022] GET /identity/v3/role_assignments?user.id=7506b634db8843d3b0651b1f4fbc4498&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=5f0de9d8946f41e8a26d355448071297 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:23.767324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98166cb-952d-487b-97c8-627ff25d0f71 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:23.777997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:23.814410 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561778cb-5c5c-4349-b5af-77b6c33eb257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:23.816355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561778cb-5c5c-4349-b5af-77b6c33eb257 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:23.817265 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561778cb-5c5c-4349-b5af-77b6c33eb257 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:23.817734 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561778cb-5c5c-4349-b5af-77b6c33eb257 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:23.818585 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561778cb-5c5c-4349-b5af-77b6c33eb257 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:23.819077 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561778cb-5c5c-4349-b5af-77b6c33eb257 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:23.820749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561778cb-5c5c-4349-b5af-77b6c33eb257 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:23.826518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 441/881] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 29 22:31:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:24.777310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e160a24-b060-4e82-9f48-70021e7d0a9b None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:24.777837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e160a24-b060-4e82-9f48-70021e7d0a9b None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:24.777914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e160a24-b060-4e82-9f48-70021e7d0a9b None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:24.779505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 441/882] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:24.785438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699adf8-628c-4942-9569-ae6cfd523d73 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:24.785725 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699adf8-628c-4942-9569-ae6cfd523d73 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:24.786002 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699adf8-628c-4942-9569-ae6cfd523d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:24.805632 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-5699adf8-628c-4942-9569-ae6cfd523d73 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:24.806845 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-5699adf8-628c-4942-9569-ae6cfd523d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:24.884510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 442/883] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:25.159880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e160a24-b060-4e82-9f48-70021e7d0a9b None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:25.266325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e160a24-b060-4e82-9f48-70021e7d0a9b None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:25.284726 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:25.302921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab5925-f819-4aaf-ace5-a84bbce027b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:25.308487 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab5925-f819-4aaf-ace5-a84bbce027b3 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:25.308487 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab5925-f819-4aaf-ace5-a84bbce027b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:25.308487 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab5925-f819-4aaf-ace5-a84bbce027b3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:25.308487 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab5925-f819-4aaf-ace5-a84bbce027b3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:25.309924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab5925-f819-4aaf-ace5-a84bbce027b3 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-27ab5925-f819-4aaf-ace5-a84bbce027b3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:25.322852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:25.324151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:25.325130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:25.325130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:25.325130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:25.325130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:25.325130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:25.325130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:25.325130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:25.325130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:25.325130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:25.325130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:25.325130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:25.325130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:25.325130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:31:25.325130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:25.330492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 442/884] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:31:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:25.332743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699adf8-628c-4942-9569-ae6cfd523d73 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:25.441069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:25.444395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699adf8-628c-4942-9569-ae6cfd523d73 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:25.481380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504730d-9eb1-4d05-b086-e9f4571e4b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:25.482059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504730d-9eb1-4d05-b086-e9f4571e4b00 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:25.482346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504730d-9eb1-4d05-b086-e9f4571e4b00 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:25.482620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504730d-9eb1-4d05-b086-e9f4571e4b00 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:25.483319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504730d-9eb1-4d05-b086-e9f4571e4b00 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:25.483628 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504730d-9eb1-4d05-b086-e9f4571e4b00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:25.485109 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504730d-9eb1-4d05-b086-e9f4571e4b00 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:25.494393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 443/885] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:31:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:25.497144 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab5925-f819-4aaf-ace5-a84bbce027b3 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:25.607493 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab5925-f819-4aaf-ace5-a84bbce027b3 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:25.640848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc7c70-58bc-40d3-a763-1638d279bd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:25.641460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc7c70-58bc-40d3-a763-1638d279bd37 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:25.641742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc7c70-58bc-40d3-a763-1638d279bd37 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:25.642013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc7c70-58bc-40d3-a763-1638d279bd37 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:25.642722 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc7c70-58bc-40d3-a763-1638d279bd37 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:25.643028 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc7c70-58bc-40d3-a763-1638d279bd37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:25.644401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc7c70-58bc-40d3-a763-1638d279bd37 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:25.649699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 443/886] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:31:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:25.656119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504730d-9eb1-4d05-b086-e9f4571e4b00 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:25.767373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504730d-9eb1-4d05-b086-e9f4571e4b00 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:25.776842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214ea78-0738-41f8-a2d1-2536f39e7cb0 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:25.777799 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214ea78-0738-41f8-a2d1-2536f39e7cb0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:25.778343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214ea78-0738-41f8-a2d1-2536f39e7cb0 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:25.779833 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 444/887] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:25.785142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c3d8c-9ea9-4525-8f8a-d2dbccba4249 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:25.785585 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c3d8c-9ea9-4525-8f8a-d2dbccba4249 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:25.785997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c3d8c-9ea9-4525-8f8a-d2dbccba4249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:25.805745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bfab7-7608-46e5-b3bf-46d2f250b64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:25.806142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-b65c3d8c-9ea9-4525-8f8a-d2dbccba4249 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:25.806358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bfab7-7608-46e5-b3bf-46d2f250b64d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:25.806641 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bfab7-7608-46e5-b3bf-46d2f250b64d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:25.806919 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bfab7-7608-46e5-b3bf-46d2f250b64d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:25.807637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bfab7-7608-46e5-b3bf-46d2f250b64d None admin] RBAC: Adding query filter params (interface=public, service_id=dabd2e7608144c3a896de74c7cd85c20, region_id=RegionOne) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:25.807765 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b65c3d8c-9ea9-4525-8f8a-d2dbccba4249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:25.807951 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bfab7-7608-46e5-b3bf-46d2f250b64d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:25.809430 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bfab7-7608-46e5-b3bf-46d2f250b64d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:25.815128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 444/888] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 29 22:31:25 2022] GET /identity/v3/endpoints?service_id=dabd2e7608144c3a896de74c7cd85c20&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:25.821106 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bfab7-7608-46e5-b3bf-46d2f250b64d None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:25.853662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:25.855066 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:25.882453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 445/889] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:25.885459 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ef527-e242-43e4-96bd-7116421b1b3f None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:25.885744 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ef527-e242-43e4-96bd-7116421b1b3f None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:25.886021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ef527-e242-43e4-96bd-7116421b1b3f None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:25.887617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 446/890] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:25.892905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b9af2-4487-4305-a03c-2b7b11fd12d1 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:25.893186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b9af2-4487-4305-a03c-2b7b11fd12d1 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:25.893457 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b9af2-4487-4305-a03c-2b7b11fd12d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:25.912301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-e48b9af2-4487-4305-a03c-2b7b11fd12d1 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:25.916436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e48b9af2-4487-4305-a03c-2b7b11fd12d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:25.942297 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bfab7-7608-46e5-b3bf-46d2f250b64d None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:25.978675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef4bf0-f6be-4c5f-8595-0a2a3b55b8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:25.979306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef4bf0-f6be-4c5f-8595-0a2a3b55b8c2 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:25.979586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef4bf0-f6be-4c5f-8595-0a2a3b55b8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:25.979881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef4bf0-f6be-4c5f-8595-0a2a3b55b8c2 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:25.981191 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef4bf0-f6be-4c5f-8595-0a2a3b55b8c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:25.982691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef4bf0-f6be-4c5f-8595-0a2a3b55b8c2 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:25.986177 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 447/891] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:25.987230 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a525c-e066-4eb7-bf12-8d3bab4db70e None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:25.987523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a525c-e066-4eb7-bf12-8d3bab4db70e None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:25.987795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a525c-e066-4eb7-bf12-8d3bab4db70e None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:26.000117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 448/892] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:26.000345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 445/893] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 29 22:31:25 2022] GET /identity/v3/services => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:31:26.000440 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bed415-3b84-4bdc-8213-c02cabe8e4d3 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:26.000440 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bed415-3b84-4bdc-8213-c02cabe8e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:26.000440 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bed415-3b84-4bdc-8213-c02cabe8e4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:26.024814 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d3bed415-3b84-4bdc-8213-c02cabe8e4d3 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:26.025964 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d3bed415-3b84-4bdc-8213-c02cabe8e4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:26.103094 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 449/894] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:26.158242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef4bf0-f6be-4c5f-8595-0a2a3b55b8c2 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:26.262769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:26.264499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bed415-3b84-4bdc-8213-c02cabe8e4d3 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:26.279107 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef4bf0-f6be-4c5f-8595-0a2a3b55b8c2 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:26.300715 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:26.317027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ef543-3f17-4e14-aa91-c20e09f79f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:26.317695 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ef543-3f17-4e14-aa91-c20e09f79f93 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:26.317974 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ef543-3f17-4e14-aa91-c20e09f79f93 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:26.318244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ef543-3f17-4e14-aa91-c20e09f79f93 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:26.319151 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ef543-3f17-4e14-aa91-c20e09f79f93 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:26.320600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ef543-3f17-4e14-aa91-c20e09f79f93 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-785ef543-3f17-4e14-aa91-c20e09f79f93 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:26.330471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:26.331492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:26.332598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:26.332598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:26.332598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:26.332598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:26.332598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:26.332598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:26.332598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:26.332598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:26.332598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:26.332598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:26.332598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:26.332598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:26.332598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:31:26.332598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:26.332598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 446/895] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Aug 29 22:31:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:26.337486 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ef543-3f17-4e14-aa91-c20e09f79f93 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:26.386102 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bed415-3b84-4bdc-8213-c02cabe8e4d3 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:26.425014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc9b29-dea9-4b1f-8da2-fa32e761ee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:26.425664 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc9b29-dea9-4b1f-8da2-fa32e761ee1c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:26.426063 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc9b29-dea9-4b1f-8da2-fa32e761ee1c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:26.426340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc9b29-dea9-4b1f-8da2-fa32e761ee1c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:26.437578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc9b29-dea9-4b1f-8da2-fa32e761ee1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-74fc9b29-dea9-4b1f-8da2-fa32e761ee1c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:26.442999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:26.444003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:26.444908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:26.444908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:26.444908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:26.444908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:26.444908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:26.444908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:26.444908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:26.444908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:26.444908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:26.444908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:26.444908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:31:26.444908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:26.444908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 450/896] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Aug 29 22:31:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:26.445672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc9b29-dea9-4b1f-8da2-fa32e761ee1c None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:26.465292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ef543-3f17-4e14-aa91-c20e09f79f93 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:26.503028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03434b6-0cd9-49d4-9a44-f94d350ef3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:26.503640 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03434b6-0cd9-49d4-9a44-f94d350ef3c3 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:26.503924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03434b6-0cd9-49d4-9a44-f94d350ef3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:26.504231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03434b6-0cd9-49d4-9a44-f94d350ef3c3 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:26.504881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03434b6-0cd9-49d4-9a44-f94d350ef3c3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:26.505187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03434b6-0cd9-49d4-9a44-f94d350ef3c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:26.506606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03434b6-0cd9-49d4-9a44-f94d350ef3c3 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:26.516320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 447/897] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 29 22:31:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:26.516320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03434b6-0cd9-49d4-9a44-f94d350ef3c3 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:26.544221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:26.561986 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:26.567727 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc9b29-dea9-4b1f-8da2-fa32e761ee1c None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:26.615564 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f52553-0b9a-457c-ae9d-f72093942ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:26.616220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f52553-0b9a-457c-ae9d-f72093942ab8 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:26.616504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f52553-0b9a-457c-ae9d-f72093942ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:26.616786 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f52553-0b9a-457c-ae9d-f72093942ab8 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:26.617469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f52553-0b9a-457c-ae9d-f72093942ab8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:26.618839 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f52553-0b9a-457c-ae9d-f72093942ab8 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:26.635809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03434b6-0cd9-49d4-9a44-f94d350ef3c3 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:26.670468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f2236-c972-4449-b0d3-e4a9dbc453c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:26.671070 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f2236-c972-4449-b0d3-e4a9dbc453c5 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:26.671367 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f2236-c972-4449-b0d3-e4a9dbc453c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:26.671702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f2236-c972-4449-b0d3-e4a9dbc453c5 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:26.672403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f2236-c972-4449-b0d3-e4a9dbc453c5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:26.672707 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f2236-c972-4449-b0d3-e4a9dbc453c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:26.674385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f2236-c972-4449-b0d3-e4a9dbc453c5 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:26.682339 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 448/898] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Aug 29 22:31:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:26.683336 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f2236-c972-4449-b0d3-e4a9dbc453c5 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:26.696584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 451/899] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 29 22:31:26 2022] POST /identity/v3/services => generated 241 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:26.697698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f52553-0b9a-457c-ae9d-f72093942ab8 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:26.818442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:26.845154 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f2236-c972-4449-b0d3-e4a9dbc453c5 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:26.851194 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f52553-0b9a-457c-ae9d-f72093942ab8 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:26.891662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2384f6e-01a8-4573-a3f3-3fa56541b7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:26.892732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2384f6e-01a8-4573-a3f3-3fa56541b7d5 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:26.893019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2384f6e-01a8-4573-a3f3-3fa56541b7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:26.893294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2384f6e-01a8-4573-a3f3-3fa56541b7d5 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:26.893965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2384f6e-01a8-4573-a3f3-3fa56541b7d5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:26.894244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2384f6e-01a8-4573-a3f3-3fa56541b7d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:26.895681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2384f6e-01a8-4573-a3f3-3fa56541b7d5 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:26.895788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f6b4c-d235-4fa0-b168-95e4fd9bf324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:26.896412 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f6b4c-d235-4fa0-b168-95e4fd9bf324 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:26.896689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f6b4c-d235-4fa0-b168-95e4fd9bf324 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:26.896960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f6b4c-d235-4fa0-b168-95e4fd9bf324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:26.903581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 449/900] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 29 22:31:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:26.909295 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2384f6e-01a8-4573-a3f3-3fa56541b7d5 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:26.910750 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f6b4c-d235-4fa0-b168-95e4fd9bf324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:26.912209 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f6b4c-d235-4fa0-b168-95e4fd9bf324 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-389f6b4c-d235-4fa0-b168-95e4fd9bf324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:26.930770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:26.931874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:26.932839 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:26.932839 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:26.932839 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:26.932839 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 452/901] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:26.938265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f6b4c-d235-4fa0-b168-95e4fd9bf324 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:26.947654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:27.032435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2384f6e-01a8-4573-a3f3-3fa56541b7d5 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:27.076629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0ccea-a9ec-48ee-b1e4-ace6db64255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:27.077429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0ccea-a9ec-48ee-b1e4-ace6db64255c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.077733 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0ccea-a9ec-48ee-b1e4-ace6db64255c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.078396 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0ccea-a9ec-48ee-b1e4-ace6db64255c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.079398 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0ccea-a9ec-48ee-b1e4-ace6db64255c None admin] RBAC: Adding query filter params (interface=public, service_id=872e321cbade40a2af9c8d39dae89bc7, region_id=RegionOne) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:27.079714 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0ccea-a9ec-48ee-b1e4-ace6db64255c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:27.081123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0ccea-a9ec-48ee-b1e4-ace6db64255c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:27.081252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f6b4c-d235-4fa0-b168-95e4fd9bf324 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:27.093051 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 450/902] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 29 22:31:26 2022] GET /identity/v3/endpoints?service_id=872e321cbade40a2af9c8d39dae89bc7&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:27.098488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0ccea-a9ec-48ee-b1e4-ace6db64255c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:27.113576 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:27.125741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e0454-68b4-49af-b3fe-716b6ec27414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:27.126706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e0454-68b4-49af-b3fe-716b6ec27414 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.127188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e0454-68b4-49af-b3fe-716b6ec27414 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.127687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e0454-68b4-49af-b3fe-716b6ec27414 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.128625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e0454-68b4-49af-b3fe-716b6ec27414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:27.129132 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e0454-68b4-49af-b3fe-716b6ec27414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:27.130690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e0454-68b4-49af-b3fe-716b6ec27414 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:27.146442 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 453/903] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:27.154656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e0454-68b4-49af-b3fe-716b6ec27414 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:27.220875 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0ccea-a9ec-48ee-b1e4-ace6db64255c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:27.244686 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:27.261484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39d7cd-c739-4e0a-9329-042b7ea9da85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:27.262341 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39d7cd-c739-4e0a-9329-042b7ea9da85 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.262766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39d7cd-c739-4e0a-9329-042b7ea9da85 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.263208 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39d7cd-c739-4e0a-9329-042b7ea9da85 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.263970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39d7cd-c739-4e0a-9329-042b7ea9da85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:27.265578 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39d7cd-c739-4e0a-9329-042b7ea9da85 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:27.276476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 451/904] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 29 22:31:27 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:31:27.291556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e0454-68b4-49af-b3fe-716b6ec27414 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:27.331667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911e202-1855-4a61-8540-9ac6395e629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:27.332376 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911e202-1855-4a61-8540-9ac6395e629e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.332730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911e202-1855-4a61-8540-9ac6395e629e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.333077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911e202-1855-4a61-8540-9ac6395e629e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.342146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911e202-1855-4a61-8540-9ac6395e629e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:27.343787 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911e202-1855-4a61-8540-9ac6395e629e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-f911e202-1855-4a61-8540-9ac6395e629e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:27.357760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:27.358996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:27.360196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:27.360196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:27.360196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:27.360196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:27.360196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:27.360196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:27.360196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:27.360196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:27.360196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:31:27.360196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:27.361561 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 454/905] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 29 22:31:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:27.367545 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39d7cd-c739-4e0a-9329-042b7ea9da85 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:27.462611 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:27.489784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39d7cd-c739-4e0a-9329-042b7ea9da85 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:27.531805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237542e6-7dcd-472b-bec9-17e3f1153e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:27.532587 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237542e6-7dcd-472b-bec9-17e3f1153e9a None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.532932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237542e6-7dcd-472b-bec9-17e3f1153e9a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.533276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237542e6-7dcd-472b-bec9-17e3f1153e9a None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.534088 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237542e6-7dcd-472b-bec9-17e3f1153e9a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:27.534464 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237542e6-7dcd-472b-bec9-17e3f1153e9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:27.536056 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237542e6-7dcd-472b-bec9-17e3f1153e9a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:27.557517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 452/906] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Aug 29 22:31:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:27.563426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911e202-1855-4a61-8540-9ac6395e629e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:27.702063 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911e202-1855-4a61-8540-9ac6395e629e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:27.728001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:27.740705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326f3fa-c729-416b-8453-9c43040474da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:27.741391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326f3fa-c729-416b-8453-9c43040474da None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.741671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326f3fa-c729-416b-8453-9c43040474da None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.741946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326f3fa-c729-416b-8453-9c43040474da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.817610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326f3fa-c729-416b-8453-9c43040474da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:27.819067 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326f3fa-c729-416b-8453-9c43040474da None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:27.927437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 455/907] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:27 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:31:27.933172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237542e6-7dcd-472b-bec9-17e3f1153e9a None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.016175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fea99-3b0e-48f9-9334-4e9640a8c620 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.016522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fea99-3b0e-48f9-9334-4e9640a8c620 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.017112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fea99-3b0e-48f9-9334-4e9640a8c620 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.019036 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 456/908] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:28.026196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def52a29-d065-43a3-acee-0474eff8b36f None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.026819 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def52a29-d065-43a3-acee-0474eff8b36f None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.027620 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def52a29-d065-43a3-acee-0474eff8b36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.046369 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237542e6-7dcd-472b-bec9-17e3f1153e9a None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.053313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-def52a29-d065-43a3-acee-0474eff8b36f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:28.054552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-def52a29-d065-43a3-acee-0474eff8b36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:28.083285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:28.088908 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6ce7e-b5e2-46bf-a1ae-8d0263e725a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.090141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6ce7e-b5e2-46bf-a1ae-8d0263e725a2 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.090501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6ce7e-b5e2-46bf-a1ae-8d0263e725a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.090812 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6ce7e-b5e2-46bf-a1ae-8d0263e725a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.096547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:28.101943 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6ce7e-b5e2-46bf-a1ae-8d0263e725a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.104126 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6ce7e-b5e2-46bf-a1ae-8d0263e725a2 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-c3e6ce7e-b5e2-46bf-a1ae-8d0263e725a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:28.120569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:28.122271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:28.123434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:28.123434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:28.123434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:28.128505 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 453/909] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:28.130786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6ce7e-b5e2-46bf-a1ae-8d0263e725a2 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.155981 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 457/910] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:28.241358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6ce7e-b5e2-46bf-a1ae-8d0263e725a2 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.278631 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b746163-cdf6-4999-9201-5a14712bdd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.279623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b746163-cdf6-4999-9201-5a14712bdd45 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.280215 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b746163-cdf6-4999-9201-5a14712bdd45 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.280692 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b746163-cdf6-4999-9201-5a14712bdd45 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.281600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b746163-cdf6-4999-9201-5a14712bdd45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:28.282145 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b746163-cdf6-4999-9201-5a14712bdd45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.283714 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b746163-cdf6-4999-9201-5a14712bdd45 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.296936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 454/911] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:28.303027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def52a29-d065-43a3-acee-0474eff8b36f None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.409175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def52a29-d065-43a3-acee-0474eff8b36f None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.430674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b746163-cdf6-4999-9201-5a14712bdd45 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.458927 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd94ffd-fd79-4a32-97eb-db512e50c659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.460298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd94ffd-fd79-4a32-97eb-db512e50c659 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.461233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd94ffd-fd79-4a32-97eb-db512e50c659 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.461842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd94ffd-fd79-4a32-97eb-db512e50c659 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.472457 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd94ffd-fd79-4a32-97eb-db512e50c659 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.474174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd94ffd-fd79-4a32-97eb-db512e50c659 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.484376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:28.490949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-7bd94ffd-fd79-4a32-97eb-db512e50c659 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:28.490949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:28.490949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:28.490949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:28.490949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:28.490949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:28.490949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:28.490949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:28.490949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:28.490949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:28.490949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:28.490949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:28.490949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:28.490949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:28.490949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:28.499330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:28.500323 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:28.500323 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:28.500323 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:28.500323 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:28.500323 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:28.500323 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:28.500323 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:28.500323 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:28.500323 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 458/912] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:28.502158 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd94ffd-fd79-4a32-97eb-db512e50c659 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.547947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b746163-cdf6-4999-9201-5a14712bdd45 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.556722 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:28.585227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4c9a4-4d3e-4776-856a-72f95d71ddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.585901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4c9a4-4d3e-4776-856a-72f95d71ddfa None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.586179 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4c9a4-4d3e-4776-856a-72f95d71ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.586452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4c9a4-4d3e-4776-856a-72f95d71ddfa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.587040 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4c9a4-4d3e-4776-856a-72f95d71ddfa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.588636 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4c9a4-4d3e-4776-856a-72f95d71ddfa None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-8aa4c9a4-4d3e-4776-856a-72f95d71ddfa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:28.598487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:28.599612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:28.600532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:28.600532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:28.600532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:28.600532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:28.600532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:28.600532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:28.600532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:28.600532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:28.600532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:28.600532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:28.600532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:28.600532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:28.600532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:31:28.600532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:28.604672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 455/913] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:28.606507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4c9a4-4d3e-4776-856a-72f95d71ddfa None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.620383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd94ffd-fd79-4a32-97eb-db512e50c659 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.660553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e60848-5cf3-49ba-97ab-cf7a2647eb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.661623 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e60848-5cf3-49ba-97ab-cf7a2647eb59 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.662125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e60848-5cf3-49ba-97ab-cf7a2647eb59 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.662692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e60848-5cf3-49ba-97ab-cf7a2647eb59 None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.663597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e60848-5cf3-49ba-97ab-cf7a2647eb59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:28.664159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e60848-5cf3-49ba-97ab-cf7a2647eb59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.665904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e60848-5cf3-49ba-97ab-cf7a2647eb59 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.684430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 459/914] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:28.686187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e60848-5cf3-49ba-97ab-cf7a2647eb59 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.716138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4c9a4-4d3e-4776-856a-72f95d71ddfa None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.725859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:28.755252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc75d5f-d0f1-4419-9097-a8eedbdf1a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.755777 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc75d5f-d0f1-4419-9097-a8eedbdf1a08 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.756054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc75d5f-d0f1-4419-9097-a8eedbdf1a08 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.756350 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc75d5f-d0f1-4419-9097-a8eedbdf1a08 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.759626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc75d5f-d0f1-4419-9097-a8eedbdf1a08 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:28.760894 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc75d5f-d0f1-4419-9097-a8eedbdf1a08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.763415 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc75d5f-d0f1-4419-9097-a8eedbdf1a08 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.773424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:28.773608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 456/915] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:28.775500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc75d5f-d0f1-4419-9097-a8eedbdf1a08 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.802259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e60848-5cf3-49ba-97ab-cf7a2647eb59 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.842515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f13a6-3538-4301-8b66-e0e9aac153ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.843497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f13a6-3538-4301-8b66-e0e9aac153ad None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.843990 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f13a6-3538-4301-8b66-e0e9aac153ad None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.844504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f13a6-3538-4301-8b66-e0e9aac153ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.845446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f13a6-3538-4301-8b66-e0e9aac153ad None admin] RBAC: Adding query filter params (role.id=4ae46f00844c4ee79187b2dbaaf21a43, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=7506b634db8843d3b0651b1f4fbc4498) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:28.846005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f13a6-3538-4301-8b66-e0e9aac153ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.847795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f13a6-3538-4301-8b66-e0e9aac153ad None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.860296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 460/916] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/role_assignments?user.id=7506b634db8843d3b0651b1f4fbc4498&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=4ae46f00844c4ee79187b2dbaaf21a43 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:28.884936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc75d5f-d0f1-4419-9097-a8eedbdf1a08 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.923732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c319d-8e12-4b23-b9d7-642838a6f037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.924638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c319d-8e12-4b23-b9d7-642838a6f037 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.924977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c319d-8e12-4b23-b9d7-642838a6f037 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.925248 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c319d-8e12-4b23-b9d7-642838a6f037 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.925894 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c319d-8e12-4b23-b9d7-642838a6f037 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:28.926196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c319d-8e12-4b23-b9d7-642838a6f037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.927581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c319d-8e12-4b23-b9d7-642838a6f037 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.938848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 457/917] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:28.941075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f13a6-3538-4301-8b66-e0e9aac153ad None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:29.009786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd61e4-b6c1-4ee1-ab6c-3c517ceb0d0b None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.010044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd61e4-b6c1-4ee1-ab6c-3c517ceb0d0b None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.010381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd61e4-b6c1-4ee1-ab6c-3c517ceb0d0b None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.012627 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 458/918] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:29.021172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca37dc-69ad-42ba-8fd5-3cd76d841e7f None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.021465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca37dc-69ad-42ba-8fd5-3cd76d841e7f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.021988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca37dc-69ad-42ba-8fd5-3cd76d841e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.049958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-0eca37dc-69ad-42ba-8fd5-3cd76d841e7f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:29.051943 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0eca37dc-69ad-42ba-8fd5-3cd76d841e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:29.072184 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f13a6-3538-4301-8b66-e0e9aac153ad None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:29.091864 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:29.117901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f94245-e5bc-4840-8bec-293f994f3acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:29.118964 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f94245-e5bc-4840-8bec-293f994f3acd None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.119470 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f94245-e5bc-4840-8bec-293f994f3acd None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.120162 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f94245-e5bc-4840-8bec-293f994f3acd None admin] PATH_INFO: `/v3/endpoints` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.121021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f94245-e5bc-4840-8bec-293f994f3acd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:29.122413 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f94245-e5bc-4840-8bec-293f994f3acd None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:29.133542 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:29.147697 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 459/919] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:29.235719 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 461/920] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:31:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:29.429809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca37dc-69ad-42ba-8fd5-3cd76d841e7f None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:29.540916 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca37dc-69ad-42ba-8fd5-3cd76d841e7f None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:29.585418 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fe4e8-3379-42f7-bc94-7319e49e11b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:29.585418 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fe4e8-3379-42f7-bc94-7319e49e11b0 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.585683 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fe4e8-3379-42f7-bc94-7319e49e11b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.585901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fe4e8-3379-42f7-bc94-7319e49e11b0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.586454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fe4e8-3379-42f7-bc94-7319e49e11b0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:29.587877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fe4e8-3379-42f7-bc94-7319e49e11b0 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-224fe4e8-3379-42f7-bc94-7319e49e11b0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:29.597207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:29.598260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:29.599108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:29.599108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:29.599108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:29.599108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:29.599108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:29.599108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:29.599108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:29.599108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:29.599108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:29.599108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:29.599108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:29.599108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:29.599108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:31:29.599108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:29.603321 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 460/921] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 29 22:31:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:29.604832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fe4e8-3379-42f7-bc94-7319e49e11b0 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:29.605200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943fcfe-e7b3-44ef-aaaa-307cfc888056 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.612258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943fcfe-e7b3-44ef-aaaa-307cfc888056 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.612579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943fcfe-e7b3-44ef-aaaa-307cfc888056 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.614351 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 462/922] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:29.619813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ca767-ae2c-4523-9cc3-9ff43ee2c57c None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.620113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ca767-ae2c-4523-9cc3-9ff43ee2c57c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.620411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ca767-ae2c-4523-9cc3-9ff43ee2c57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.637344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:29.641354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-478ca767-ae2c-4523-9cc3-9ff43ee2c57c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:29.642548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-478ca767-ae2c-4523-9cc3-9ff43ee2c57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:29.723149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 463/923] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:29.724775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fe4e8-3379-42f7-bc94-7319e49e11b0 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:29.764162 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0a515-767b-465a-b6d0-c6f9542b9d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:29.765165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0a515-767b-465a-b6d0-c6f9542b9d1c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.765643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0a515-767b-465a-b6d0-c6f9542b9d1c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.766000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0a515-767b-465a-b6d0-c6f9542b9d1c None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.767021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0a515-767b-465a-b6d0-c6f9542b9d1c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:29.767565 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0a515-767b-465a-b6d0-c6f9542b9d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:29.769475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0a515-767b-465a-b6d0-c6f9542b9d1c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:29.775502 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 461/924] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 29 22:31:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:29.781475 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ca767-ae2c-4523-9cc3-9ff43ee2c57c None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:29.885561 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ca767-ae2c-4523-9cc3-9ff43ee2c57c None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:29.910795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:29.922289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156da768-e063-4803-b5b1-bb81c26192f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:29.923029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156da768-e063-4803-b5b1-bb81c26192f6 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.923219 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156da768-e063-4803-b5b1-bb81c26192f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.923484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156da768-e063-4803-b5b1-bb81c26192f6 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.924388 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156da768-e063-4803-b5b1-bb81c26192f6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:29.924687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156da768-e063-4803-b5b1-bb81c26192f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:29.926039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156da768-e063-4803-b5b1-bb81c26192f6 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:29.936296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 464/925] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 29 22:31:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:29.938190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0a515-767b-465a-b6d0-c6f9542b9d1c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:29.997605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156da768-e063-4803-b5b1-bb81c26192f6 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:30.047751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:30.057972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0a515-767b-465a-b6d0-c6f9542b9d1c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:30.096196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a0297-a0c6-4bd0-b9bf-0ab890449e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:30.096902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a0297-a0c6-4bd0-b9bf-0ab890449e2a None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:30.097182 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a0297-a0c6-4bd0-b9bf-0ab890449e2a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:30.097510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a0297-a0c6-4bd0-b9bf-0ab890449e2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:30.098297 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a0297-a0c6-4bd0-b9bf-0ab890449e2a None admin] RBAC: Adding query filter params (interface=public, service_id=5ba89974bc4a46129cc9d646c62b8352, region_id=RegionOne) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:30.098603 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a0297-a0c6-4bd0-b9bf-0ab890449e2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:30.099973 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a0297-a0c6-4bd0-b9bf-0ab890449e2a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:30.107450 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 462/926] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 29 22:31:29 2022] GET /identity/v3/endpoints?service_id=5ba89974bc4a46129cc9d646c62b8352&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:30.112883 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a0297-a0c6-4bd0-b9bf-0ab890449e2a None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:30.117911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156da768-e063-4803-b5b1-bb81c26192f6 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:30.162527 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c3b81-69de-487d-b86a-8f094515eda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:30.164010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c3b81-69de-487d-b86a-8f094515eda4 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:30.164728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c3b81-69de-487d-b86a-8f094515eda4 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:30.165157 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c3b81-69de-487d-b86a-8f094515eda4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:30.166159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c3b81-69de-487d-b86a-8f094515eda4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:30.168692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c3b81-69de-487d-b86a-8f094515eda4 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-524c3b81-69de-487d-b86a-8f094515eda4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:30.181838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:30.183006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:30.184558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:30.184558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:30.184558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:30.184558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:30.184558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:30.184558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:30.184558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:30.184558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:30.184558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:30.184558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:30.184558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:30.184558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:30.184558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:31:30.184558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:30.187666 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 465/927] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Aug 29 22:31:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:30.193821 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c3b81-69de-487d-b86a-8f094515eda4 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:30.229365 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a0297-a0c6-4bd0-b9bf-0ab890449e2a None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:30.267586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50566e7-e40a-459e-a308-1f66091ebc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:30.268130 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50566e7-e40a-459e-a308-1f66091ebc66 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:30.268411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50566e7-e40a-459e-a308-1f66091ebc66 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:30.268681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50566e7-e40a-459e-a308-1f66091ebc66 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:30.269361 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:30.269481 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50566e7-e40a-459e-a308-1f66091ebc66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:30.270879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50566e7-e40a-459e-a308-1f66091ebc66 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:30.280411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 463/928] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 29 22:31:30 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:31:30.326547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c3b81-69de-487d-b86a-8f094515eda4 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:30.367138 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311aa1e-a383-45ab-933d-63edccb47e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:30.368048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311aa1e-a383-45ab-933d-63edccb47e41 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:30.368501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311aa1e-a383-45ab-933d-63edccb47e41 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:30.368932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311aa1e-a383-45ab-933d-63edccb47e41 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:30.369718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311aa1e-a383-45ab-933d-63edccb47e41 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:30.370184 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311aa1e-a383-45ab-933d-63edccb47e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:30.372355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311aa1e-a383-45ab-933d-63edccb47e41 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:30.378486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 466/929] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 29 22:31:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:30.384618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50566e7-e40a-459e-a308-1f66091ebc66 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:30.406716 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:30.507406 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50566e7-e40a-459e-a308-1f66091ebc66 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:30.546610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ded17e-b1a1-432a-9906-bf8208a43888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:30.547189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ded17e-b1a1-432a-9906-bf8208a43888 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:30.547466 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ded17e-b1a1-432a-9906-bf8208a43888 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:30.547786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ded17e-b1a1-432a-9906-bf8208a43888 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:30.548446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ded17e-b1a1-432a-9906-bf8208a43888 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:30.548743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ded17e-b1a1-432a-9906-bf8208a43888 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:30.550400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ded17e-b1a1-432a-9906-bf8208a43888 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:30.555857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 464/930] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 29 22:31:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:30.564598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311aa1e-a383-45ab-933d-63edccb47e41 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:30.675609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311aa1e-a383-45ab-933d-63edccb47e41 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:30.694296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:30.714236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078f6aa-b74d-48c0-9bef-d05b7b026e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:30.715447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078f6aa-b74d-48c0-9bef-d05b7b026e9b None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:30.715730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078f6aa-b74d-48c0-9bef-d05b7b026e9b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:30.716004 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078f6aa-b74d-48c0-9bef-d05b7b026e9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:30.716728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078f6aa-b74d-48c0-9bef-d05b7b026e9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:30.718315 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078f6aa-b74d-48c0-9bef-d05b7b026e9b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:30.851685 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 467/931] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:31:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:30.854484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efdff3-e428-4dd7-9a60-640378dda663 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:30.861050 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efdff3-e428-4dd7-9a60-640378dda663 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:30.861050 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efdff3-e428-4dd7-9a60-640378dda663 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:30.861050 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 465/932] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:30.863063 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e494a-e0aa-416e-b168-bb9cb007e52c None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:30.863618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e494a-e0aa-416e-b168-bb9cb007e52c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:30.864160 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e494a-e0aa-416e-b168-bb9cb007e52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:30.885037 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-6f5e494a-e0aa-416e-b168-bb9cb007e52c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:30.887149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6f5e494a-e0aa-416e-b168-bb9cb007e52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:30.973432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 468/933] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:31.251277 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efdff3-e428-4dd7-9a60-640378dda663 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:31.293288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4452-2181-48eb-9b98-70ba0eea51bf None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:31.293796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4452-2181-48eb-9b98-70ba0eea51bf None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:31.293902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4452-2181-48eb-9b98-70ba0eea51bf None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:31.295448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 469/934] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:31.300880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb54074-f041-4c74-bff8-a4900a840cf2 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:31.301161 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb54074-f041-4c74-bff8-a4900a840cf2 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:31.301438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb54074-f041-4c74-bff8-a4900a840cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:31.321079 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-eeb54074-f041-4c74-bff8-a4900a840cf2 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:31.322387 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-eeb54074-f041-4c74-bff8-a4900a840cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:31.344508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:31.367025 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efdff3-e428-4dd7-9a60-640378dda663 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:31.408112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584a5c8-69b6-4c90-b900-ed447850bc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:31.408112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584a5c8-69b6-4c90-b900-ed447850bc7f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:31.408112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584a5c8-69b6-4c90-b900-ed447850bc7f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:31.408112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584a5c8-69b6-4c90-b900-ed447850bc7f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:31.408654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 470/935] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:31.418477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584a5c8-69b6-4c90-b900-ed447850bc7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-0584a5c8-69b6-4c90-b900-ed447850bc7f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:31.423348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:31.424599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:31.425670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:31.425670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:31.425670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:31.425670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:31.425670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:31.425670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:31.425670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:31.425670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:31.425670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:31.425670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:31.425670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:31:31.425670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:31.425670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 466/936] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Aug 29 22:31:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:31.430957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb54074-f041-4c74-bff8-a4900a840cf2 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:31.461795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:31.548150 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb54074-f041-4c74-bff8-a4900a840cf2 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:31.587382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2595-5d75-4112-b234-cd011a96a034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:31.592109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2595-5d75-4112-b234-cd011a96a034 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:31.592109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2595-5d75-4112-b234-cd011a96a034 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:31.592109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2595-5d75-4112-b234-cd011a96a034 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:31.592109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c2595-5d75-4112-b234-cd011a96a034 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:31.592109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c2595-5d75-4112-b234-cd011a96a034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:31.592109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c2595-5d75-4112-b234-cd011a96a034 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:31.600531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 471/937] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Aug 29 22:31:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:31.608781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584a5c8-69b6-4c90-b900-ed447850bc7f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:31.694183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2595-5d75-4112-b234-cd011a96a034 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:31.720865 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584a5c8-69b6-4c90-b900-ed447850bc7f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:31.769820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8577ba-5e89-4ca6-b7b7-cda85317bfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:31.770546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8577ba-5e89-4ca6-b7b7-cda85317bfd9 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:31.770830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8577ba-5e89-4ca6-b7b7-cda85317bfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:31.771306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8577ba-5e89-4ca6-b7b7-cda85317bfd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:31.789753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8577ba-5e89-4ca6-b7b7-cda85317bfd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:31.791344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8577ba-5e89-4ca6-b7b7-cda85317bfd9 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:31.802610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:31.802788 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-2f8577ba-5e89-4ca6-b7b7-cda85317bfd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:31.809173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:31.810225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:31.811123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:31.811123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:31.811123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:31.813032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 467/938] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:31.814435 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2595-5d75-4112-b234-cd011a96a034 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:31.819249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8577ba-5e89-4ca6-b7b7-cda85317bfd9 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:31.854453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd048-5f96-4e19-959f-f3df6f4fe45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:31.855425 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd048-5f96-4e19-959f-f3df6f4fe45a None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:31.856301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd048-5f96-4e19-959f-f3df6f4fe45a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:31.856301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd048-5f96-4e19-959f-f3df6f4fe45a None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:31.857293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffd048-5f96-4e19-959f-f3df6f4fe45a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:31.859048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffd048-5f96-4e19-959f-f3df6f4fe45a None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:31.862273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: WARNING keystone.server.flask.common [None req-30ffd048-5f96-4e19-959f-f3df6f4fe45a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 22:31:31.913105 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.sql.core [None req-30ffd048-5f96-4e19-959f-f3df6f4fe45a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 22:31:31.913105 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 22:31:31.913105 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [parameters: {'id': '8b7b3af26ddd4053b608a9c2f1576c49', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 22:31:31.913105 dv-cinder-854269-4-smb devstack@keystone.service[82236]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82236) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 22:31:31.922547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-30ffd048-5f96-4e19-959f-f3df6f4fe45a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8b7b3af26ddd4053b608a9c2f1576c49.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8b7b3af26ddd4053b608a9c2f1576c49. Aug 29 22:31:31.922547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:31.922547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:31:31.922547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:31:31.922547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:31:31.922547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:31:31.922547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:31:31.922547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:31:31.922547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:31:31.922547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:31:31.922547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:31:31.922547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:31:31.922547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application result.read() Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 22:31:31.923476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application yield resource Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise self.value Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application session.commit() Aug 29 22:31:31.924936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self.session.flush() Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application compat.raise_( Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 22:31:31.925841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 22:31:31.926781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 22:31:31.926781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 22:31:31.926781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 22:31:31.926781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 22:31:31.926781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 22:31:31.926781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 22:31:31.926781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 22:31:31.926781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 22:31:31.926781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 22:31:31.926781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 22:31:31.926781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 22:31:31.926781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 22:31:31.926781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 22:31:31.926781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 22:31:31.926781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application result.read() Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:31:31.927602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:31:31.930165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:31:31.930165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:31:31.930165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:31:31.930165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:31:31.930165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:31:31.930165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:31:31.930165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 22:31:31.930165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 22:31:31.930165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [parameters: {'id': '8b7b3af26ddd4053b608a9c2f1576c49', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 22:31:31.930165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 22:31:31.930165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:31.930165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:31.930165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:31.930165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:31.930165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:31.932229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:31.945282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:31.945282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 22:31:31.945282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 22:31:31.945282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:31.945282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:31.945282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 22:31:31.945282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 22:31:31.945282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8b7b3af26ddd4053b608a9c2f1576c49. Aug 29 22:31:31.945282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:31.945282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 472/939] 10.222.0.62 () {60 vars in 1140 bytes} [Mon Aug 29 22:31:31 2022] POST /identity/v3/projects => generated 262 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:31.945962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8577ba-5e89-4ca6-b7b7-cda85317bfd9 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:31.946044 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd048-5f96-4e19-959f-f3df6f4fe45a None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:31.975676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db868657-fe4d-4e33-8d7b-5266967adccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:31.976687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db868657-fe4d-4e33-8d7b-5266967adccc None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:31.977111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db868657-fe4d-4e33-8d7b-5266967adccc None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:31.977525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db868657-fe4d-4e33-8d7b-5266967adccc None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:31.978343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db868657-fe4d-4e33-8d7b-5266967adccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:31.978895 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db868657-fe4d-4e33-8d7b-5266967adccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:31.980630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db868657-fe4d-4e33-8d7b-5266967adccc None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:31.996817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 468/940] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:32.008131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db868657-fe4d-4e33-8d7b-5266967adccc None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:32.065924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:32.067179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd048-5f96-4e19-959f-f3df6f4fe45a None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:32.109676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51552ad0-9f06-4367-9fea-d07347ddd1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:32.110543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51552ad0-9f06-4367-9fea-d07347ddd1af None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.110968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51552ad0-9f06-4367-9fea-d07347ddd1af None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.111372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51552ad0-9f06-4367-9fea-d07347ddd1af None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.119114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51552ad0-9f06-4367-9fea-d07347ddd1af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:32.121630 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51552ad0-9f06-4367-9fea-d07347ddd1af None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:32.123059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db868657-fe4d-4e33-8d7b-5266967adccc None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:32.134005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-51552ad0-9f06-4367-9fea-d07347ddd1af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:32.134005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:32.134005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:32.134005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:32.134005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:32.134005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:32.134005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:32.134005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:32.134005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:32.134005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:32.134005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:32.134005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:32.134005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:32.134005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:32.134005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:32.135127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:32.136764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:32.136764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:32.136764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:32.136764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:32.136764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:32.136764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:32.136764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:32.136764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:32.143559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 473/941] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:32.145257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51552ad0-9f06-4367-9fea-d07347ddd1af None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:32.156180 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:32.164785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d18c9-ce93-4e0c-ab34-bf8991243c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:32.166253 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d18c9-ce93-4e0c-ab34-bf8991243c66 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.170210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d18c9-ce93-4e0c-ab34-bf8991243c66 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.170210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d18c9-ce93-4e0c-ab34-bf8991243c66 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.179834 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d18c9-ce93-4e0c-ab34-bf8991243c66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:32.181468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d18c9-ce93-4e0c-ab34-bf8991243c66 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-1b9d18c9-ce93-4e0c-ab34-bf8991243c66 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:32.194347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:32.195604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:32.196832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:32.196832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:32.196832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:32.196832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:32.196832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:32.196832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:32.196832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:32.196832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:32.196832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:31:32.196832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:32.202720 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 469/942] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 29 22:31:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:32.203738 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d18c9-ce93-4e0c-ab34-bf8991243c66 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:32.269889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51552ad0-9f06-4367-9fea-d07347ddd1af None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:32.307330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248c962-3573-4372-a7f8-afd83c6fe576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:32.308796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248c962-3573-4372-a7f8-afd83c6fe576 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.309215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248c962-3573-4372-a7f8-afd83c6fe576 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.309718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248c962-3573-4372-a7f8-afd83c6fe576 None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.310520 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248c962-3573-4372-a7f8-afd83c6fe576 None admin] RBAC: Adding query filter params (name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:32.311065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248c962-3573-4372-a7f8-afd83c6fe576 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:32.312750 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248c962-3573-4372-a7f8-afd83c6fe576 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:32.314925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d18c9-ce93-4e0c-ab34-bf8991243c66 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:32.330507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:32.343305 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 474/943] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 29 22:31:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:32.353767 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353ca60-db0d-47e6-9015-c1cce5a6b4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:32.354577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353ca60-db0d-47e6-9015-c1cce5a6b4cc None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.354920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353ca60-db0d-47e6-9015-c1cce5a6b4cc None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.355478 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353ca60-db0d-47e6-9015-c1cce5a6b4cc None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.356936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353ca60-db0d-47e6-9015-c1cce5a6b4cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:32.357555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353ca60-db0d-47e6-9015-c1cce5a6b4cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:32.359209 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353ca60-db0d-47e6-9015-c1cce5a6b4cc None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:32.380896 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 470/944] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Aug 29 22:31:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:32.387053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248c962-3573-4372-a7f8-afd83c6fe576 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:32.391971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd9b5-af88-4c72-b180-4ef4bbe91b3c None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.392424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd9b5-af88-4c72-b180-4ef4bbe91b3c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.392798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd9b5-af88-4c72-b180-4ef4bbe91b3c None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.394577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 471/945] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:32.400413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794f464-7dea-4f7f-90b7-85331629c550 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.400759 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794f464-7dea-4f7f-90b7-85331629c550 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.400972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794f464-7dea-4f7f-90b7-85331629c550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.421013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-8794f464-7dea-4f7f-90b7-85331629c550 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:32.422241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8794f464-7dea-4f7f-90b7-85331629c550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:32.489142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:32.504355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 472/946] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:32.538062 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248c962-3573-4372-a7f8-afd83c6fe576 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:32.579058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea530515-0ff5-4364-9ed4-33cf3c375f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:32.580817 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea530515-0ff5-4364-9ed4-33cf3c375f7b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.581037 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea530515-0ff5-4364-9ed4-33cf3c375f7b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.581312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea530515-0ff5-4364-9ed4-33cf3c375f7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.596107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea530515-0ff5-4364-9ed4-33cf3c375f7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:32.597756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea530515-0ff5-4364-9ed4-33cf3c375f7b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-ea530515-0ff5-4364-9ed4-33cf3c375f7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:32.621431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:32.622533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:32.623451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:32.623451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:32.623451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:32.623451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 475/947] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:32.629862 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794f464-7dea-4f7f-90b7-85331629c550 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:32.738743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794f464-7dea-4f7f-90b7-85331629c550 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:32.740514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:32.778998 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ef56a-4d35-44dd-b824-4d11978d39c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:32.779778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ef56a-4d35-44dd-b824-4d11978d39c4 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.780203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ef56a-4d35-44dd-b824-4d11978d39c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.780587 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ef56a-4d35-44dd-b824-4d11978d39c4 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.781221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea530515-0ff5-4364-9ed4-33cf3c375f7b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:32.781466 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ef56a-4d35-44dd-b824-4d11978d39c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:32.781880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ef56a-4d35-44dd-b824-4d11978d39c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:32.783487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ef56a-4d35-44dd-b824-4d11978d39c4 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:32.802345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 473/948] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:32.804005 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ef56a-4d35-44dd-b824-4d11978d39c4 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:32.909286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea530515-0ff5-4364-9ed4-33cf3c375f7b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:32.920148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ef56a-4d35-44dd-b824-4d11978d39c4 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:32.930201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:32.947617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b1531-fdcc-4b0d-96d9-2f3fef452688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:32.948400 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b1531-fdcc-4b0d-96d9-2f3fef452688 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.949228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b1531-fdcc-4b0d-96d9-2f3fef452688 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.949452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b1531-fdcc-4b0d-96d9-2f3fef452688 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.950046 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b1531-fdcc-4b0d-96d9-2f3fef452688 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:32.951411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b1531-fdcc-4b0d-96d9-2f3fef452688 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:32.959216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675385ce-57e7-4219-a6a6-acaad268e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:32.959846 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675385ce-57e7-4219-a6a6-acaad268e429 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.960145 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675385ce-57e7-4219-a6a6-acaad268e429 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.960417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675385ce-57e7-4219-a6a6-acaad268e429 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-e30b1531-fdcc-4b0d-96d9-2f3fef452688 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:32.960931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:32.966844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:32.967776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:32.967776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:32.967776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:32.967776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:32.967776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:32.967776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:32.967776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:32.967776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:32.967776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:32.967776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:32.967776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:32.967776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:32.967776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:31:32.967776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:32.967776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 476/949] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 29 22:31:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:32.968712 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e87d3-5801-4fb6-b849-e720c6d20246 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.968712 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e87d3-5801-4fb6-b849-e720c6d20246 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.968712 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e87d3-5801-4fb6-b849-e720c6d20246 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.968712 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 477/950] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:32.971392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e87d3-5801-4fb6-b849-e720c6d20246 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:32.978028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675385ce-57e7-4219-a6a6-acaad268e429 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:32.979459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675385ce-57e7-4219-a6a6-acaad268e429 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:32.991266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-675385ce-57e7-4219-a6a6-acaad268e429 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:32.991266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:32.991266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:32.991266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:32.991266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:32.991266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:32.991266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:32.991266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:32.991266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:32.991266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:32.991266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:32.991266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:32.991266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:32.991266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:32.991266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:32.992354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:32.993279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:32.993279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:32.993279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:32.993279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:32.993279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:32.993279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:32.993279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:32.993279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:32.993279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 474/951] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:32.994439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000015ab-6c34-436c-bb10-14e57d4a2c04 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.994744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000015ab-6c34-436c-bb10-14e57d4a2c04 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.995016 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000015ab-6c34-436c-bb10-14e57d4a2c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.014537 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-000015ab-6c34-436c-bb10-14e57d4a2c04 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:33.015828 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-000015ab-6c34-436c-bb10-14e57d4a2c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:33.034912 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:33.082154 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e87d3-5801-4fb6-b849-e720c6d20246 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:33.092139 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 475/952] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:33.092546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000015ab-6c34-436c-bb10-14e57d4a2c04 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.124912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd09db7-f0b5-4506-b637-75bc9dc1ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:33.126406 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd09db7-f0b5-4506-b637-75bc9dc1ef6c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.127106 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd09db7-f0b5-4506-b637-75bc9dc1ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.127797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd09db7-f0b5-4506-b637-75bc9dc1ef6c None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.128867 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd09db7-f0b5-4506-b637-75bc9dc1ef6c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:33.129472 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd09db7-f0b5-4506-b637-75bc9dc1ef6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:33.131054 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd09db7-f0b5-4506-b637-75bc9dc1ef6c None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:33.142365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 478/953] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 29 22:31:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:33.143555 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd09db7-f0b5-4506-b637-75bc9dc1ef6c None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.197336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:33.228937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000015ab-6c34-436c-bb10-14e57d4a2c04 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:33.257212 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd09db7-f0b5-4506-b637-75bc9dc1ef6c None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:33.275953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9d904-bdda-4468-8da9-4694170068cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:33.277466 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9d904-bdda-4468-8da9-4694170068cb None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.277754 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9d904-bdda-4468-8da9-4694170068cb None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.278024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9d904-bdda-4468-8da9-4694170068cb None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.278720 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9d904-bdda-4468-8da9-4694170068cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:33.279022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9d904-bdda-4468-8da9-4694170068cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:33.280471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9d904-bdda-4468-8da9-4694170068cb None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:33.296779 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 476/954] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:33.297280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a173b-7115-4c17-958d-8de4fde08ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:33.298164 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a173b-7115-4c17-958d-8de4fde08ede None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.298668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a173b-7115-4c17-958d-8de4fde08ede None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.299397 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a173b-7115-4c17-958d-8de4fde08ede None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.300270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a173b-7115-4c17-958d-8de4fde08ede None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:33.300776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a173b-7115-4c17-958d-8de4fde08ede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:33.302340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a173b-7115-4c17-958d-8de4fde08ede None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:33.302652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9d904-bdda-4468-8da9-4694170068cb None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.313086 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 479/955] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 29 22:31:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:33.314549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a173b-7115-4c17-958d-8de4fde08ede None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.323215 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:33.417249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9d904-bdda-4468-8da9-4694170068cb None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:33.423809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a173b-7115-4c17-958d-8de4fde08ede None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:33.438283 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:33.455513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e3642-5951-4a13-a949-9d4696d282b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:33.456137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e3642-5951-4a13-a949-9d4696d282b8 None admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.456413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e3642-5951-4a13-a949-9d4696d282b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.456687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e3642-5951-4a13-a949-9d4696d282b8 None admin] PATH_INFO: `/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/7506b634db8843d3b0651b1f4fbc4498/roles/4ae46f00844c4ee79187b2dbaaf21a43` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.458859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e3642-5951-4a13-a949-9d4696d282b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdd2d14c7e884b8b8f340183a79fd481, user_id=7506b634db8843d3b0651b1f4fbc4498, role_id=4ae46f00844c4ee79187b2dbaaf21a43)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:33.460354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e3642-5951-4a13-a949-9d4696d282b8 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:33.464073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c840a-54cd-4bd1-af46-aa0da3159465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:33.464929 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c840a-54cd-4bd1-af46-aa0da3159465 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.465205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c840a-54cd-4bd1-af46-aa0da3159465 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.465475 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c840a-54cd-4bd1-af46-aa0da3159465 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.466133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c840a-54cd-4bd1-af46-aa0da3159465 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:33.467488 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c840a-54cd-4bd1-af46-aa0da3159465 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:33.536164 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 477/956] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:31:33 2022] PUT /identity/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/7506b634db8843d3b0651b1f4fbc4498/roles/4ae46f00844c4ee79187b2dbaaf21a43 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:31:33.537297 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e3642-5951-4a13-a949-9d4696d282b8 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.624282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 480/957] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:31:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:33.652247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:33.691006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e3642-5951-4a13-a949-9d4696d282b8 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:33.742740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e1557-c515-48ca-985a-c3bf66cc22b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:33.743313 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e1557-c515-48ca-985a-c3bf66cc22b9 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.743594 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e1557-c515-48ca-985a-c3bf66cc22b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.743871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e1557-c515-48ca-985a-c3bf66cc22b9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.744499 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e1557-c515-48ca-985a-c3bf66cc22b9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:33.746680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e1557-c515-48ca-985a-c3bf66cc22b9 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-ba6e1557-c515-48ca-985a-c3bf66cc22b9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:33.756726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:33.758067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:33.759095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:33.759095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:33.759095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:33.759095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:33.759095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:33.759095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:33.759095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:33.759095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:33.759095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:33.759095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:33.759095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:33.759095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:33.759095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:31:33.759095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:33.759095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 478/958] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:33.765275 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c840a-54cd-4bd1-af46-aa0da3159465 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.880351 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c840a-54cd-4bd1-af46-aa0da3159465 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:33.917829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f41ba5-74f9-42a0-aeb8-04067c7ea774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:33.918514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f41ba5-74f9-42a0-aeb8-04067c7ea774 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.918795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f41ba5-74f9-42a0-aeb8-04067c7ea774 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.919070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f41ba5-74f9-42a0-aeb8-04067c7ea774 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.919767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f41ba5-74f9-42a0-aeb8-04067c7ea774 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:33.920080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f41ba5-74f9-42a0-aeb8-04067c7ea774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:33.921477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f41ba5-74f9-42a0-aeb8-04067c7ea774 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:33.927144 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 481/959] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 29 22:31:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:33.932987 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e1557-c515-48ca-985a-c3bf66cc22b9 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:34.049793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e1557-c515-48ca-985a-c3bf66cc22b9 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:34.083153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:34.088887 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a386dd-cc5c-4be6-b957-f76e29e665a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:34.090061 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a386dd-cc5c-4be6-b957-f76e29e665a4 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:34.090344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a386dd-cc5c-4be6-b957-f76e29e665a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:34.090682 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a386dd-cc5c-4be6-b957-f76e29e665a4 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:34.091322 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a386dd-cc5c-4be6-b957-f76e29e665a4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:34.091670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a386dd-cc5c-4be6-b957-f76e29e665a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:34.093137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a386dd-cc5c-4be6-b957-f76e29e665a4 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:34.098417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 479/960] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 29 22:31:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:34.485457 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5d098-24f5-4fe1-af46-64f517da3d14 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:34.486010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5d098-24f5-4fe1-af46-64f517da3d14 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:34.486010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5d098-24f5-4fe1-af46-64f517da3d14 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:34.487566 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 482/961] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:34.493024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32708d7d-ddff-41e3-ad18-e387d260c8dc None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:34.493441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32708d7d-ddff-41e3-ad18-e387d260c8dc None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:34.493621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32708d7d-ddff-41e3-ad18-e387d260c8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:34.513633 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-32708d7d-ddff-41e3-ad18-e387d260c8dc None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:34.514832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-32708d7d-ddff-41e3-ad18-e387d260c8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:34.591867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 480/962] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:34.866341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5d098-24f5-4fe1-af46-64f517da3d14 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:34.900178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:34.976585 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5d098-24f5-4fe1-af46-64f517da3d14 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:35.013637 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab885903-358c-4dcc-a9a5-f22a903d208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:35.014635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab885903-358c-4dcc-a9a5-f22a903d208f None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:35.015136 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab885903-358c-4dcc-a9a5-f22a903d208f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:35.015613 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab885903-358c-4dcc-a9a5-f22a903d208f None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:35.016523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab885903-358c-4dcc-a9a5-f22a903d208f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:35.018164 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab885903-358c-4dcc-a9a5-f22a903d208f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:35.077902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.sql.core [None req-ab885903-358c-4dcc-a9a5-f22a903d208f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 22:31:35.077902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 22:31:35.077902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [parameters: {'user_id': '928220f37f26429e96b609c2b8fee0f8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 22:31:35.077902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82236) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 22:31:35.089148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-ab885903-358c-4dcc-a9a5-f22a903d208f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 22:31:35.089148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:35.089148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:31:35.089148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:31:35.089148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:31:35.089148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:31:35.089148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:31:35.089148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:31:35.089148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:31:35.089148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:31:35.089148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:31:35.089148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:31:35.089148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:31:35.089148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application result.read() Aug 29 22:31:35.089148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:31:35.090668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application yield resource Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise self.value Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application session.commit() Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 22:31:35.091668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self.session.flush() Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application compat.raise_( Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 22:31:35.092604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:31:35.093528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application result.read() Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:31:35.094398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:31:35.095258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:31:35.095258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:31:35.095258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:31:35.095258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:31:35.095258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 22:31:35.095258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 22:31:35.095258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [parameters: {'user_id': '928220f37f26429e96b609c2b8fee0f8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 22:31:35.095258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 22:31:35.095258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:35.095258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:35.095258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:35.095258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:35.095258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:35.095258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:35.095258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 22:31:35.097711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 22:31:35.100126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 22:31:35.100126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 22:31:35.100126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 22:31:35.100126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 22:31:35.100126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 22:31:35.100126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:35.102814 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 483/963] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Aug 29 22:31:34 2022] POST /identity/v3/users => generated 160 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:35.109178 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32708d7d-ddff-41e3-ad18-e387d260c8dc None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:35.218219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32708d7d-ddff-41e3-ad18-e387d260c8dc None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:35.245552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:35.254312 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b6f94-6b9f-4d26-8232-d37714c18f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:35.254954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b6f94-6b9f-4d26-8232-d37714c18f4c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:35.255238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b6f94-6b9f-4d26-8232-d37714c18f4c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:35.255515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b6f94-6b9f-4d26-8232-d37714c18f4c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:35.263677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b6f94-6b9f-4d26-8232-d37714c18f4c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:35.265218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b6f94-6b9f-4d26-8232-d37714c18f4c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-338b6f94-6b9f-4d26-8232-d37714c18f4c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:35.277962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:35.280114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:35.281472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:35.281472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:35.281472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:35.281472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:35.281472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:35.281472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:35.281472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:35.281472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:35.281472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:31:35.281472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:35.281472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 481/964] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:35.285277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab885903-358c-4dcc-a9a5-f22a903d208f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:35.388829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:35.398236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab885903-358c-4dcc-a9a5-f22a903d208f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:35.436351 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121b8b-0e00-45fd-b2a5-4d55673c282d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:35.436970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121b8b-0e00-45fd-b2a5-4d55673c282d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:35.439027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121b8b-0e00-45fd-b2a5-4d55673c282d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:35.439027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121b8b-0e00-45fd-b2a5-4d55673c282d None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:35.439027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db121b8b-0e00-45fd-b2a5-4d55673c282d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:35.439027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db121b8b-0e00-45fd-b2a5-4d55673c282d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:35.440132 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db121b8b-0e00-45fd-b2a5-4d55673c282d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:35.480594 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 484/965] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:35.664056 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb0aaf-d5d2-46b5-b367-dfd609f47cd6 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:35.664612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb0aaf-d5d2-46b5-b367-dfd609f47cd6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:35.664612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb0aaf-d5d2-46b5-b367-dfd609f47cd6 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:35.666265 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 482/966] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:35.671803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6bfb8-ec6c-4d8e-b158-9a2dfe0845f3 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:35.672288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6bfb8-ec6c-4d8e-b158-9a2dfe0845f3 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:35.672475 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6bfb8-ec6c-4d8e-b158-9a2dfe0845f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:35.692582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-b6e6bfb8-ec6c-4d8e-b158-9a2dfe0845f3 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:35.694119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b6e6bfb8-ec6c-4d8e-b158-9a2dfe0845f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:35.755719 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07604d9-7f1f-4fb9-875b-03e42dbcaa2e None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:35.755902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07604d9-7f1f-4fb9-875b-03e42dbcaa2e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:35.756218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07604d9-7f1f-4fb9-875b-03e42dbcaa2e None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:35.760125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 483/967] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:35.763551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24efe0a-381e-46ba-a182-baa11c235204 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:35.763834 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24efe0a-381e-46ba-a182-baa11c235204 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:35.764189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24efe0a-381e-46ba-a182-baa11c235204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:35.772843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 485/968] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:35.783422 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-c24efe0a-381e-46ba-a182-baa11c235204 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:35.785015 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c24efe0a-381e-46ba-a182-baa11c235204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:35.857571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 484/969] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:36.048617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6bfb8-ec6c-4d8e-b158-9a2dfe0845f3 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:36.093826 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224a818-09c9-4e1a-9313-be0237af92ab None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:36.094119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224a818-09c9-4e1a-9313-be0237af92ab None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:36.094395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224a818-09c9-4e1a-9313-be0237af92ab None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:36.095745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 485/970] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:36.100928 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd836c9b-e639-42a7-b736-313fc54fdfbc None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:36.101218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd836c9b-e639-42a7-b736-313fc54fdfbc None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:36.101497 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd836c9b-e639-42a7-b736-313fc54fdfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:36.121343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-cd836c9b-e639-42a7-b736-313fc54fdfbc None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:36.122570 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-cd836c9b-e639-42a7-b736-313fc54fdfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:36.141243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:36.159734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6bfb8-ec6c-4d8e-b158-9a2dfe0845f3 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:36.190365 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 486/971] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:36.191208 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd836c9b-e639-42a7-b736-313fc54fdfbc None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:36.197179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f066a2-cae5-48f9-992b-10dc8cf6f0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:36.197824 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f066a2-cae5-48f9-992b-10dc8cf6f0fc None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:36.198098 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f066a2-cae5-48f9-992b-10dc8cf6f0fc None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:36.198364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f066a2-cae5-48f9-992b-10dc8cf6f0fc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:36.210593 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f066a2-cae5-48f9-992b-10dc8cf6f0fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-d1f066a2-cae5-48f9-992b-10dc8cf6f0fc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:36.215569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:36.216709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:36.217580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:36.217580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:36.217580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:36.217580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:36.217580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:36.217580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:36.217580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:36.217580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:36.217580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:36.217580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:36.217580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:31:36.217580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:36.217580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 486/972] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Aug 29 22:31:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:36.222482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f066a2-cae5-48f9-992b-10dc8cf6f0fc None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:36.246099 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:36.302359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd836c9b-e639-42a7-b736-313fc54fdfbc None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:36.330265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f066a2-cae5-48f9-992b-10dc8cf6f0fc None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:36.340427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954afb2c-e826-4b4a-95c1-6cda93a2f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:36.341437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954afb2c-e826-4b4a-95c1-6cda93a2f486 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:36.341724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954afb2c-e826-4b4a-95c1-6cda93a2f486 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:36.341998 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954afb2c-e826-4b4a-95c1-6cda93a2f486 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:36.342907 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954afb2c-e826-4b4a-95c1-6cda93a2f486 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:36.344316 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954afb2c-e826-4b4a-95c1-6cda93a2f486 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-954afb2c-e826-4b4a-95c1-6cda93a2f486 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:36.353385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:36.354665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:36.356128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:36.356128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:36.356128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:36.356128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:36.356128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:36.356128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:36.356128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:36.356128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:36.356128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:36.356128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:36.356128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:36.356128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:36.356128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:31:36.356128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:36.356128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 487/973] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 29 22:31:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:36.360928 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954afb2c-e826-4b4a-95c1-6cda93a2f486 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:36.371888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f7278-c52f-4490-a017-442977529455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:36.372576 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f7278-c52f-4490-a017-442977529455 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:36.372857 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f7278-c52f-4490-a017-442977529455 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:36.373386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f7278-c52f-4490-a017-442977529455 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:36.374052 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f7278-c52f-4490-a017-442977529455 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:36.374351 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f7278-c52f-4490-a017-442977529455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:36.375832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f7278-c52f-4490-a017-442977529455 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:36.385389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 487/974] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Aug 29 22:31:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:36.390895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f7278-c52f-4490-a017-442977529455 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:36.395838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:36.468581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954afb2c-e826-4b4a-95c1-6cda93a2f486 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:36.479298 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:36.503229 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085b27b-8226-49c7-8770-125e7f7941ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:36.503840 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085b27b-8226-49c7-8770-125e7f7941ff None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:36.504153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085b27b-8226-49c7-8770-125e7f7941ff None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:36.504517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085b27b-8226-49c7-8770-125e7f7941ff None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:36.505162 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085b27b-8226-49c7-8770-125e7f7941ff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:36.505469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085b27b-8226-49c7-8770-125e7f7941ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:36.506860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085b27b-8226-49c7-8770-125e7f7941ff None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:36.506979 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f7278-c52f-4490-a017-442977529455 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:36.512192 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 488/975] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 29 22:31:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:36.512976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085b27b-8226-49c7-8770-125e7f7941ff None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:36.542222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08d4da-af3f-48f9-a731-31f34423568e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:36.542885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08d4da-af3f-48f9-a731-31f34423568e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:36.543168 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08d4da-af3f-48f9-a731-31f34423568e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:36.543501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08d4da-af3f-48f9-a731-31f34423568e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:36.554804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08d4da-af3f-48f9-a731-31f34423568e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:36.556201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08d4da-af3f-48f9-a731-31f34423568e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-5d08d4da-af3f-48f9-a731-31f34423568e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:36.571073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:36.572179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:36.574217 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:36.574217 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:36.574217 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:36.574217 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 488/976] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:36.574217 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08d4da-af3f-48f9-a731-31f34423568e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:36.621164 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085b27b-8226-49c7-8770-125e7f7941ff None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:36.634894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:36.655790 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49197b92-40d2-4427-a82f-1d15ef1f705a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:36.656423 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49197b92-40d2-4427-a82f-1d15ef1f705a None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:36.656707 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49197b92-40d2-4427-a82f-1d15ef1f705a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:36.656973 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49197b92-40d2-4427-a82f-1d15ef1f705a None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:36.657616 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49197b92-40d2-4427-a82f-1d15ef1f705a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:36.658968 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49197b92-40d2-4427-a82f-1d15ef1f705a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:36.679972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08d4da-af3f-48f9-a731-31f34423568e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:36.713419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e9149-923e-4554-93ae-9f71b70bf18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:36.714024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e9149-923e-4554-93ae-9f71b70bf18e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:36.714352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e9149-923e-4554-93ae-9f71b70bf18e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:36.714628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e9149-923e-4554-93ae-9f71b70bf18e None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:36.715260 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e9149-923e-4554-93ae-9f71b70bf18e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:36.715568 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e9149-923e-4554-93ae-9f71b70bf18e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:36.716957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e9149-923e-4554-93ae-9f71b70bf18e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:36.719165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 489/977] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 29 22:31:36 2022] POST /identity/v3/services => generated 242 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:36.720147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49197b92-40d2-4427-a82f-1d15ef1f705a None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:36.724526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 489/978] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 29 22:31:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:36.729534 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e9149-923e-4554-93ae-9f71b70bf18e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:36.771318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:36.858514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e9149-923e-4554-93ae-9f71b70bf18e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:36.870344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49197b92-40d2-4427-a82f-1d15ef1f705a None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:36.879906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:36.900599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccf073-391b-45c9-b7dc-b03473e9c3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:36.901575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccf073-391b-45c9-b7dc-b03473e9c3ad None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:36.901841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccf073-391b-45c9-b7dc-b03473e9c3ad None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:36.903253 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccf073-391b-45c9-b7dc-b03473e9c3ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:36.903585 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccf073-391b-45c9-b7dc-b03473e9c3ad None admin] RBAC: Adding query filter params (interface=admin, service_id=5ba89974bc4a46129cc9d646c62b8352, region_id=RegionOne) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:36.904860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccf073-391b-45c9-b7dc-b03473e9c3ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:36.905541 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccf073-391b-45c9-b7dc-b03473e9c3ad None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:36.912065 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65ec0f-23ba-44f6-9d82-4514d91f3fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:36.912880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65ec0f-23ba-44f6-9d82-4514d91f3fa6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:36.913023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65ec0f-23ba-44f6-9d82-4514d91f3fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:36.913274 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65ec0f-23ba-44f6-9d82-4514d91f3fa6 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:36.913928 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65ec0f-23ba-44f6-9d82-4514d91f3fa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:36.914174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 490/979] 10.222.0.62 () {56 vars in 1249 bytes} [Mon Aug 29 22:31:36 2022] GET /identity/v3/endpoints?service_id=5ba89974bc4a46129cc9d646c62b8352&interface=admin®ion_id=RegionOne => generated 193 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:36.914298 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65ec0f-23ba-44f6-9d82-4514d91f3fa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:36.915606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65ec0f-23ba-44f6-9d82-4514d91f3fa6 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:36.920373 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccf073-391b-45c9-b7dc-b03473e9c3ad None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:36.930632 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 490/980] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:36.937247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65ec0f-23ba-44f6-9d82-4514d91f3fa6 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:37.039861 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccf073-391b-45c9-b7dc-b03473e9c3ad None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:37.040817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:37.053224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65ec0f-23ba-44f6-9d82-4514d91f3fa6 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:37.079950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481086ff-b86a-472e-93f0-4d724d96f949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:37.080879 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481086ff-b86a-472e-93f0-4d724d96f949 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:37.081366 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481086ff-b86a-472e-93f0-4d724d96f949 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:37.081645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481086ff-b86a-472e-93f0-4d724d96f949 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:37.082264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481086ff-b86a-472e-93f0-4d724d96f949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:37.083698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481086ff-b86a-472e-93f0-4d724d96f949 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:37.090947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecbc33-6af3-4835-af96-0bd6dafc291c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:37.091586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecbc33-6af3-4835-af96-0bd6dafc291c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:37.091868 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecbc33-6af3-4835-af96-0bd6dafc291c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:37.092225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecbc33-6af3-4835-af96-0bd6dafc291c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:37.096760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 491/981] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 29 22:31:36 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:31:37.103068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecbc33-6af3-4835-af96-0bd6dafc291c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:37.104613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecbc33-6af3-4835-af96-0bd6dafc291c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-98ecbc33-6af3-4835-af96-0bd6dafc291c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:37.119078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:37.120187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:37.121200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:37.121200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:37.121200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:37.121200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:37.121200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:37.121200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:37.121200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:37.121200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:37.121200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:31:37.121200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:37.121200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 491/982] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 29 22:31:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:37.126508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481086ff-b86a-472e-93f0-4d724d96f949 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:37.181559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:37.242523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481086ff-b86a-472e-93f0-4d724d96f949 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:37.278841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1294cd-2ce4-4a6d-8461-45069c83d4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:37.279813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1294cd-2ce4-4a6d-8461-45069c83d4f3 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:37.280342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1294cd-2ce4-4a6d-8461-45069c83d4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:37.280845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1294cd-2ce4-4a6d-8461-45069c83d4f3 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:37.281816 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1294cd-2ce4-4a6d-8461-45069c83d4f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:37.282335 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1294cd-2ce4-4a6d-8461-45069c83d4f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:37.283988 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1294cd-2ce4-4a6d-8461-45069c83d4f3 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:37.304073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 492/983] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Aug 29 22:31:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:37.309564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecbc33-6af3-4835-af96-0bd6dafc291c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:37.417046 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecbc33-6af3-4835-af96-0bd6dafc291c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:37.452702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27398853-6046-49c3-8404-e54e5d5a3033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:37.453299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27398853-6046-49c3-8404-e54e5d5a3033 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:37.453577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27398853-6046-49c3-8404-e54e5d5a3033 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:37.453850 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27398853-6046-49c3-8404-e54e5d5a3033 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:37.473591 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:37.525918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27398853-6046-49c3-8404-e54e5d5a3033 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:37.528123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27398853-6046-49c3-8404-e54e5d5a3033 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:37.636987 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 492/984] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:37 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:31:37.642991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1294cd-2ce4-4a6d-8461-45069c83d4f3 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:37.746861 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1294cd-2ce4-4a6d-8461-45069c83d4f3 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:37.749358 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:37.782970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5664e-ad0f-4768-95f2-2da70dca2204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:37.783776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5664e-ad0f-4768-95f2-2da70dca2204 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:37.784182 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5664e-ad0f-4768-95f2-2da70dca2204 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:37.784552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5664e-ad0f-4768-95f2-2da70dca2204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:37.796076 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5664e-ad0f-4768-95f2-2da70dca2204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:37.797723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5664e-ad0f-4768-95f2-2da70dca2204 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-2dd5664e-ad0f-4768-95f2-2da70dca2204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:37.813302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:37.814448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:37.815580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:37.815580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:37.815580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:37.816853 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 493/985] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:37.822265 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27398853-6046-49c3-8404-e54e5d5a3033 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:37.887544 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:37.939242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27398853-6046-49c3-8404-e54e5d5a3033 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:37.975111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fc77b-bcbe-43fa-8566-2817ad0dbec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:37.975712 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fc77b-bcbe-43fa-8566-2817ad0dbec6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:37.975989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fc77b-bcbe-43fa-8566-2817ad0dbec6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:37.976288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fc77b-bcbe-43fa-8566-2817ad0dbec6 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:37.976928 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fc77b-bcbe-43fa-8566-2817ad0dbec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:37.977225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fc77b-bcbe-43fa-8566-2817ad0dbec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:37.978576 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fc77b-bcbe-43fa-8566-2817ad0dbec6 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:37.990418 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 493/986] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:37.996647 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5664e-ad0f-4768-95f2-2da70dca2204 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:38.103522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5664e-ad0f-4768-95f2-2da70dca2204 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:38.139866 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc4c92-39c4-4e62-b130-584fd94c1e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:38.140548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc4c92-39c4-4e62-b130-584fd94c1e28 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:38.140827 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc4c92-39c4-4e62-b130-584fd94c1e28 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:38.141100 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc4c92-39c4-4e62-b130-584fd94c1e28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:38.148139 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc4c92-39c4-4e62-b130-584fd94c1e28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:38.149573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc4c92-39c4-4e62-b130-584fd94c1e28 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:38.161156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-53fc4c92-39c4-4e62-b130-584fd94c1e28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:38.161156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:38.161156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:38.161156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:38.161156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:38.161156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:38.161156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:38.161156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:38.161156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:38.161156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:38.161156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:38.161156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:38.161156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:38.161156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:38.161156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:38.162173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:38.163101 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:38.163101 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:38.163101 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:38.163101 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:38.163101 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:38.163101 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:38.163101 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:38.163101 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:38.167761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 494/987] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:38.169022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fc77b-bcbe-43fa-8566-2817ad0dbec6 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:38.274112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fc77b-bcbe-43fa-8566-2817ad0dbec6 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:38.285068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:38.312654 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301fa6a-2bc1-4366-a328-535249a42df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:38.313269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301fa6a-2bc1-4366-a328-535249a42df4 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:38.313550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301fa6a-2bc1-4366-a328-535249a42df4 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:38.313823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301fa6a-2bc1-4366-a328-535249a42df4 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:38.320354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301fa6a-2bc1-4366-a328-535249a42df4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:38.320354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301fa6a-2bc1-4366-a328-535249a42df4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:38.320354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301fa6a-2bc1-4366-a328-535249a42df4 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:38.328812 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 494/988] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:38.334631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc4c92-39c4-4e62-b130-584fd94c1e28 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:38.356169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:38.446020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc4c92-39c4-4e62-b130-584fd94c1e28 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:38.483013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffaef6-5d5e-4c90-8a67-0e09e4e7f26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:38.483676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffaef6-5d5e-4c90-8a67-0e09e4e7f26f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:38.483966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffaef6-5d5e-4c90-8a67-0e09e4e7f26f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:38.484288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffaef6-5d5e-4c90-8a67-0e09e4e7f26f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:38.485029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffaef6-5d5e-4c90-8a67-0e09e4e7f26f None admin] RBAC: Adding query filter params (role.id=4ae46f00844c4ee79187b2dbaaf21a43, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=7506b634db8843d3b0651b1f4fbc4498) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:38.485340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffaef6-5d5e-4c90-8a67-0e09e4e7f26f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:38.486781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffaef6-5d5e-4c90-8a67-0e09e4e7f26f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:38.493419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 495/989] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:38 2022] GET /identity/v3/role_assignments?user.id=7506b634db8843d3b0651b1f4fbc4498&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=4ae46f00844c4ee79187b2dbaaf21a43 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:38.710810 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284767e-1d8d-4cfe-97ad-2da4363826b0 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:38.711009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284767e-1d8d-4cfe-97ad-2da4363826b0 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:38.711251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284767e-1d8d-4cfe-97ad-2da4363826b0 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:38.713098 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 495/990] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:38.719137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f515e-767c-49ca-94f8-cec7deed1d07 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:38.719423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f515e-767c-49ca-94f8-cec7deed1d07 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:38.719693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f515e-767c-49ca-94f8-cec7deed1d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:38.739612 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-284f515e-767c-49ca-94f8-cec7deed1d07 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:38.740855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-284f515e-767c-49ca-94f8-cec7deed1d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:38.830639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 496/991] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:39.047420 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643be07-191a-4c96-991e-eab34d0b6762 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.047939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643be07-191a-4c96-991e-eab34d0b6762 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.047939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643be07-191a-4c96-991e-eab34d0b6762 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.049828 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 496/992] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:39.055295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e7a68-abb0-48e6-8464-0ca76e1c6cfe None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.055577 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e7a68-abb0-48e6-8464-0ca76e1c6cfe None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.055855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e7a68-abb0-48e6-8464-0ca76e1c6cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.077376 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-034e7a68-abb0-48e6-8464-0ca76e1c6cfe None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:39.078583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-034e7a68-abb0-48e6-8464-0ca76e1c6cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:39.081636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:39.103951 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643be07-191a-4c96-991e-eab34d0b6762 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.152609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 497/993] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:39.217816 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643be07-191a-4c96-991e-eab34d0b6762 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.254329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c0a9a-8a7d-4a39-9e47-4ec81c7e8151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.255287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c0a9a-8a7d-4a39-9e47-4ec81c7e8151 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.255763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c0a9a-8a7d-4a39-9e47-4ec81c7e8151 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.256364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c0a9a-8a7d-4a39-9e47-4ec81c7e8151 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.257140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c0a9a-8a7d-4a39-9e47-4ec81c7e8151 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.258690 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c0a9a-8a7d-4a39-9e47-4ec81c7e8151 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-201c0a9a-8a7d-4a39-9e47-4ec81c7e8151 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:39.268461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:39.269477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:39.270491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:39.270491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:39.270491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:39.270491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:39.270491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:39.270491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:39.270491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:39.270491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:39.270491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:39.270491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:39.270491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:39.270491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:39.270491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:31:39.270491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:39.272630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 497/994] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:39.279252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e7a68-abb0-48e6-8464-0ca76e1c6cfe None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.389468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e7a68-abb0-48e6-8464-0ca76e1c6cfe None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.422267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c0a9a-8a7d-4a39-9e47-4ec81c7e8151 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.426501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e4cc3-a69a-4c59-935b-d13d659b0d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.428128 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4cc3-a69a-4c59-935b-d13d659b0d0b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.428419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4cc3-a69a-4c59-935b-d13d659b0d0b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.428699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4cc3-a69a-4c59-935b-d13d659b0d0b None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.429342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e4cc3-a69a-4c59-935b-d13d659b0d0b None admin] RBAC: Adding query filter params (name=compute) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:39.429647 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e4cc3-a69a-4c59-935b-d13d659b0d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.431032 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e4cc3-a69a-4c59-935b-d13d659b0d0b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:39.442321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 498/995] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:39.443425 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e4cc3-a69a-4c59-935b-d13d659b0d0b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.447008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:39.464715 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:39.535468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c0a9a-8a7d-4a39-9e47-4ec81c7e8151 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.549702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e4cc3-a69a-4c59-935b-d13d659b0d0b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.571578 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48b590-404e-499e-85c7-030960de25c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.572239 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48b590-404e-499e-85c7-030960de25c2 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.572520 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48b590-404e-499e-85c7-030960de25c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.572797 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48b590-404e-499e-85c7-030960de25c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.573496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48b590-404e-499e-85c7-030960de25c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.575537 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48b590-404e-499e-85c7-030960de25c2 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-0a48b590-404e-499e-85c7-030960de25c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:39.584621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:39.585652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:39.586495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:39.586495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:39.586495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:39.586495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:39.586495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:39.586495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:39.586495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:39.586495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:39.586495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:39.586495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:39.586495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:39.586495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:39.586495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:31:39.586495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:39.586495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 498/996] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:39.591996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9617f-da55-44eb-be3e-3b1b71a10642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.592312 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48b590-404e-499e-85c7-030960de25c2 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.592818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9617f-da55-44eb-be3e-3b1b71a10642 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.593109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9617f-da55-44eb-be3e-3b1b71a10642 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.593389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9617f-da55-44eb-be3e-3b1b71a10642 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.594085 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9617f-da55-44eb-be3e-3b1b71a10642 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:39.594398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9617f-da55-44eb-be3e-3b1b71a10642 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.595842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9617f-da55-44eb-be3e-3b1b71a10642 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:39.606052 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 499/997] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:39.607560 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9617f-da55-44eb-be3e-3b1b71a10642 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.680462 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:39.710810 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:39.715891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48b590-404e-499e-85c7-030960de25c2 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.716725 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9617f-da55-44eb-be3e-3b1b71a10642 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.753145 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230fad9-fb09-4237-8004-4f6d379f96e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.753635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81426dfe-f8ec-4d05-9eed-b5773705c297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.753781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230fad9-fb09-4237-8004-4f6d379f96e7 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.754024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230fad9-fb09-4237-8004-4f6d379f96e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.754301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230fad9-fb09-4237-8004-4f6d379f96e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.755001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230fad9-fb09-4237-8004-4f6d379f96e7 None admin] RBAC: Adding query filter params (interface=public, service_id=aaf5d11598144595bfbdfcecbb3374ea, region_id=RegionOne) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:39.755117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81426dfe-f8ec-4d05-9eed-b5773705c297 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.755306 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230fad9-fb09-4237-8004-4f6d379f96e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.755772 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81426dfe-f8ec-4d05-9eed-b5773705c297 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.756269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81426dfe-f8ec-4d05-9eed-b5773705c297 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.756696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230fad9-fb09-4237-8004-4f6d379f96e7 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:39.757304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81426dfe-f8ec-4d05-9eed-b5773705c297 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:39.757806 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81426dfe-f8ec-4d05-9eed-b5773705c297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.759410 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81426dfe-f8ec-4d05-9eed-b5773705c297 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:39.762628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 500/998] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/endpoints?service_id=aaf5d11598144595bfbdfcecbb3374ea&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:39.765762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 499/999] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:39.771355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230fad9-fb09-4237-8004-4f6d379f96e7 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.771528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81426dfe-f8ec-4d05-9eed-b5773705c297 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.880141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81426dfe-f8ec-4d05-9eed-b5773705c297 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.887597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230fad9-fb09-4237-8004-4f6d379f96e7 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.918921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797830d-b32a-4afd-8475-127de736b847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.919532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797830d-b32a-4afd-8475-127de736b847 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.919807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797830d-b32a-4afd-8475-127de736b847 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.920103 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797830d-b32a-4afd-8475-127de736b847 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.920578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:39.920802 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797830d-b32a-4afd-8475-127de736b847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.922197 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797830d-b32a-4afd-8475-127de736b847 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:39.926466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f06a8-795c-4368-987e-b08567571248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.927263 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f06a8-795c-4368-987e-b08567571248 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.927697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f06a8-795c-4368-987e-b08567571248 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.928148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f06a8-795c-4368-987e-b08567571248 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.928867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 500/1000] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:31:39.929082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f06a8-795c-4368-987e-b08567571248 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:39.929545 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f06a8-795c-4368-987e-b08567571248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.941677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f06a8-795c-4368-987e-b08567571248 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:39.941677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 501/1001] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:39.943440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797830d-b32a-4afd-8475-127de736b847 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.977475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:40.063332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797830d-b32a-4afd-8475-127de736b847 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:40.101370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f9403-8dd5-4f0a-a941-881d11baa449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:40.101980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f9403-8dd5-4f0a-a941-881d11baa449 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:40.102264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f9403-8dd5-4f0a-a941-881d11baa449 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:40.102540 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f9403-8dd5-4f0a-a941-881d11baa449 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:40.103226 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f9403-8dd5-4f0a-a941-881d11baa449 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:40.104666 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f9403-8dd5-4f0a-a941-881d11baa449 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:40.182547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 501/1002] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:31:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:40.478704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d4e62-d270-4e7c-95a7-05f6f3627dd5 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:40.479087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d4e62-d270-4e7c-95a7-05f6f3627dd5 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:40.479289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d4e62-d270-4e7c-95a7-05f6f3627dd5 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:40.482438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 502/1003] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:40.488324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e0a9-622a-472f-8821-16319ea3ca37 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:40.488731 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e0a9-622a-472f-8821-16319ea3ca37 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:40.489028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e0a9-622a-472f-8821-16319ea3ca37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:40.507473 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-af96e0a9-622a-472f-8821-16319ea3ca37 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:40.508645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-af96e0a9-622a-472f-8821-16319ea3ca37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:40.590704 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 502/1004] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:40.855516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d4e62-d270-4e7c-95a7-05f6f3627dd5 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:40.959936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d4e62-d270-4e7c-95a7-05f6f3627dd5 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:40.994617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06cc2a-529b-46fa-a9c5-e99a5c9d9144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:40.995270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06cc2a-529b-46fa-a9c5-e99a5c9d9144 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:40.995544 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06cc2a-529b-46fa-a9c5-e99a5c9d9144 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:40.995815 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06cc2a-529b-46fa-a9c5-e99a5c9d9144 None admin] PATH_INFO: `/v3/services/image` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:40.996441 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06cc2a-529b-46fa-a9c5-e99a5c9d9144 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:40.997786 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06cc2a-529b-46fa-a9c5-e99a5c9d9144 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-ff06cc2a-529b-46fa-a9c5-e99a5c9d9144 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:41.006507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:41.007548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:41.008832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:41.008832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:41.008832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:41.008832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:41.008832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:41.008832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:41.008832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:41.008832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:41.008832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:41.008832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:41.008832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:41.008832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:41.008832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:31:41.008832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:41.012195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 503/1005] 10.222.0.62 () {56 vars in 1105 bytes} [Mon Aug 29 22:31:40 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:41.013764 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96e0a9-622a-472f-8821-16319ea3ca37 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:41.030525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:41.123293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96e0a9-622a-472f-8821-16319ea3ca37 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:41.158998 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bb87f-f888-4909-8f0c-e9049f9fd06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:41.159601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bb87f-f888-4909-8f0c-e9049f9fd06b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:41.159872 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bb87f-f888-4909-8f0c-e9049f9fd06b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:41.160163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bb87f-f888-4909-8f0c-e9049f9fd06b None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:41.160794 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bb87f-f888-4909-8f0c-e9049f9fd06b None admin] RBAC: Adding query filter params (name=image) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:41.161093 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bb87f-f888-4909-8f0c-e9049f9fd06b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:41.162455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bb87f-f888-4909-8f0c-e9049f9fd06b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:41.167740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 503/1006] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:41.173234 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06cc2a-529b-46fa-a9c5-e99a5c9d9144 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:41.235616 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:41.277628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06cc2a-529b-46fa-a9c5-e99a5c9d9144 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:41.317918 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07872392-690a-493f-a789-6c0fd2c78939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:41.318432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07872392-690a-493f-a789-6c0fd2c78939 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:41.318432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07872392-690a-493f-a789-6c0fd2c78939 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:41.319051 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07872392-690a-493f-a789-6c0fd2c78939 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:41.319689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07872392-690a-493f-a789-6c0fd2c78939 None admin] RBAC: Adding query filter params (type=image) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:41.320015 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07872392-690a-493f-a789-6c0fd2c78939 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:41.321376 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07872392-690a-493f-a789-6c0fd2c78939 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:41.326737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 504/1007] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:41.870167 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa45b7-b899-45d5-a1b2-aadb1e0a1063 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:41.870885 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa45b7-b899-45d5-a1b2-aadb1e0a1063 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:41.871160 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa45b7-b899-45d5-a1b2-aadb1e0a1063 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:41.872570 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 504/1008] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:41.877660 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418c36c-7f61-4e54-82e8-29dc44b00b91 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:41.877946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418c36c-7f61-4e54-82e8-29dc44b00b91 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:41.878221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418c36c-7f61-4e54-82e8-29dc44b00b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:41.897270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-3418c36c-7f61-4e54-82e8-29dc44b00b91 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:41.898470 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3418c36c-7f61-4e54-82e8-29dc44b00b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:41.968074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 505/1009] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:42.134355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a66df-366d-42fe-9f06-530e5a311bbd None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:42.134854 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a66df-366d-42fe-9f06-530e5a311bbd None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:42.134854 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a66df-366d-42fe-9f06-530e5a311bbd None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:42.136373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 505/1010] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:42.141554 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74226d7f-1c16-4343-9b9a-7816386b7e08 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:42.141844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74226d7f-1c16-4343-9b9a-7816386b7e08 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:42.142142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74226d7f-1c16-4343-9b9a-7816386b7e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:42.160362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-74226d7f-1c16-4343-9b9a-7816386b7e08 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:42.161576 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-74226d7f-1c16-4343-9b9a-7816386b7e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:42.216677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:42.235703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 506/1011] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:42.238499 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a66df-366d-42fe-9f06-530e5a311bbd None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:42.320472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:42.344890 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a66df-366d-42fe-9f06-530e5a311bbd None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:42.380573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33283a-954b-42c6-af96-ac63d3ac1dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:42.381206 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33283a-954b-42c6-af96-ac63d3ac1dcd None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:42.381485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33283a-954b-42c6-af96-ac63d3ac1dcd None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:42.381754 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33283a-954b-42c6-af96-ac63d3ac1dcd None admin] PATH_INFO: `/v3/services/compute` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:42.382328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33283a-954b-42c6-af96-ac63d3ac1dcd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:42.383699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33283a-954b-42c6-af96-ac63d3ac1dcd None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-bf33283a-954b-42c6-af96-ac63d3ac1dcd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:42.393317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:42.394379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:42.395247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:42.395247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:42.395247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:42.395247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:42.395247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:42.395247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:42.395247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:42.395247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:42.395247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:42.395247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:42.395247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:42.395247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:42.395247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:31:42.395247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:42.396762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 506/1012] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:42.400351 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74226d7f-1c16-4343-9b9a-7816386b7e08 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:42.505452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33283a-954b-42c6-af96-ac63d3ac1dcd None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:42.508799 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74226d7f-1c16-4343-9b9a-7816386b7e08 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:42.546030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee18e5-b77c-4ac5-a0ac-46faa742fb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:42.546641 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee18e5-b77c-4ac5-a0ac-46faa742fb82 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:42.546920 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee18e5-b77c-4ac5-a0ac-46faa742fb82 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:42.547196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee18e5-b77c-4ac5-a0ac-46faa742fb82 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:42.547830 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee18e5-b77c-4ac5-a0ac-46faa742fb82 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:42.548159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee18e5-b77c-4ac5-a0ac-46faa742fb82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:42.549785 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee18e5-b77c-4ac5-a0ac-46faa742fb82 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:42.559527 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 507/1013] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 29 22:31:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:42.560647 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee18e5-b77c-4ac5-a0ac-46faa742fb82 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:42.617357 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:42.631101 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33283a-954b-42c6-af96-ac63d3ac1dcd None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:42.666939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3e00d-bb08-4b23-bdcb-372c421d6d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:42.667518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3e00d-bb08-4b23-bdcb-372c421d6d60 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:42.667802 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3e00d-bb08-4b23-bdcb-372c421d6d60 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:42.668077 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3e00d-bb08-4b23-bdcb-372c421d6d60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:42.669224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3e00d-bb08-4b23-bdcb-372c421d6d60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:42.670674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3e00d-bb08-4b23-bdcb-372c421d6d60 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:42.675838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 507/1014] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:42.677972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee18e5-b77c-4ac5-a0ac-46faa742fb82 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:42.678257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3e00d-bb08-4b23-bdcb-372c421d6d60 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:42.691579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:42.717627 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2aaf6-b7ac-4bca-b222-3301d2405366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:42.718617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2aaf6-b7ac-4bca-b222-3301d2405366 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:42.718895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2aaf6-b7ac-4bca-b222-3301d2405366 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:42.719195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2aaf6-b7ac-4bca-b222-3301d2405366 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:42.719804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2aaf6-b7ac-4bca-b222-3301d2405366 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:42.720136 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2aaf6-b7ac-4bca-b222-3301d2405366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:42.721509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2aaf6-b7ac-4bca-b222-3301d2405366 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:42.726934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 508/1015] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 29 22:31:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:42.732457 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2aaf6-b7ac-4bca-b222-3301d2405366 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:42.789216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3e00d-bb08-4b23-bdcb-372c421d6d60 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:42.827233 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb218128-3df9-404a-80bf-9ac00aa271a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:42.827841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218128-3df9-404a-80bf-9ac00aa271a7 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:42.828139 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218128-3df9-404a-80bf-9ac00aa271a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:42.828414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218128-3df9-404a-80bf-9ac00aa271a7 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:42.829061 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb218128-3df9-404a-80bf-9ac00aa271a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:42.830558 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb218128-3df9-404a-80bf-9ac00aa271a7 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:42.845143 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2aaf6-b7ac-4bca-b222-3301d2405366 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:42.859359 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:42.882428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff5b77-4789-4513-9376-e67623f2dbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:42.883040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff5b77-4789-4513-9376-e67623f2dbcf None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:42.883320 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff5b77-4789-4513-9376-e67623f2dbcf None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:42.883594 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff5b77-4789-4513-9376-e67623f2dbcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:42.884405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff5b77-4789-4513-9376-e67623f2dbcf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:42.885753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff5b77-4789-4513-9376-e67623f2dbcf None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:42.927700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 508/1016] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 29 22:31:42 2022] POST /identity/v3/projects => generated 311 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:31:42.994372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 509/1017] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:31:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:31:43.275757 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b18b-89c1-4faf-bf86-ddf5a1f63722 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:43.276267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b18b-89c1-4faf-bf86-ddf5a1f63722 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:43.276267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b18b-89c1-4faf-bf86-ddf5a1f63722 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:43.278130 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 509/1018] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:43.283537 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086613fa-4d4f-4b13-8841-7fc6e62ec228 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:43.283815 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086613fa-4d4f-4b13-8841-7fc6e62ec228 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:43.284110 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086613fa-4d4f-4b13-8841-7fc6e62ec228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:43.303244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-086613fa-4d4f-4b13-8841-7fc6e62ec228 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:43.304460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-086613fa-4d4f-4b13-8841-7fc6e62ec228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:43.380491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 510/1019] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:43 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:43.660826 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b18b-89c1-4faf-bf86-ddf5a1f63722 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:43.723568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:43.766849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b18b-89c1-4faf-bf86-ddf5a1f63722 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:43.803270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e61126-eee8-423b-9eb4-2ed96e8fb031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:43.804055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e61126-eee8-423b-9eb4-2ed96e8fb031 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:43.804358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e61126-eee8-423b-9eb4-2ed96e8fb031 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:43.805096 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e61126-eee8-423b-9eb4-2ed96e8fb031 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:43.805768 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e61126-eee8-423b-9eb4-2ed96e8fb031 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:43.807136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e61126-eee8-423b-9eb4-2ed96e8fb031 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:43.943421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 510/1020] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 29 22:31:43 2022] POST /identity/v3/services => generated 242 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:44.914449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff9e00-b4d6-4293-862c-3c2c075b8ab4 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:44.914968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff9e00-b4d6-4293-862c-3c2c075b8ab4 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:44.914968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff9e00-b4d6-4293-862c-3c2c075b8ab4 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:44.916437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 511/1021] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:44.922389 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff609f26-c489-421f-868d-c0b741e476a0 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:44.922839 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff609f26-c489-421f-868d-c0b741e476a0 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:44.922985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff609f26-c489-421f-868d-c0b741e476a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:44.943250 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ff609f26-c489-421f-868d-c0b741e476a0 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:44.944504 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ff609f26-c489-421f-868d-c0b741e476a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:45.028135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 511/1022] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:45.045490 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd4941-fe00-42bb-abed-c966c34c54eb None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:45.045848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd4941-fe00-42bb-abed-c966c34c54eb None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:45.046192 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd4941-fe00-42bb-abed-c966c34c54eb None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:45.048224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 512/1023] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:45.053145 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff611a3c-bb47-4414-a9da-cd7bd5ed124e None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:45.053431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff611a3c-bb47-4414-a9da-cd7bd5ed124e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:45.053702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff611a3c-bb47-4414-a9da-cd7bd5ed124e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:45.074132 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ff611a3c-bb47-4414-a9da-cd7bd5ed124e None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:45.075390 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ff611a3c-bb47-4414-a9da-cd7bd5ed124e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:45.121799 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:45.146031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 512/1024] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:45.299493 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd4941-fe00-42bb-abed-c966c34c54eb None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:45.395993 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:45.404769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd4941-fe00-42bb-abed-c966c34c54eb None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:45.416003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff611a3c-bb47-4414-a9da-cd7bd5ed124e None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:45.443167 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49c27e-3088-4942-936a-04830e64a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:45.443801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49c27e-3088-4942-936a-04830e64a6eb None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:45.444098 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49c27e-3088-4942-936a-04830e64a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:45.446048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49c27e-3088-4942-936a-04830e64a6eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:45.446048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49c27e-3088-4942-936a-04830e64a6eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:45.446995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49c27e-3088-4942-936a-04830e64a6eb None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:45.448985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 513/1025] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:45.454658 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49c27e-3088-4942-936a-04830e64a6eb None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:45.519865 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff611a3c-bb47-4414-a9da-cd7bd5ed124e None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:45.556151 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b41eb6-e525-4cce-a76a-19ad9dacb812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:45.556715 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b41eb6-e525-4cce-a76a-19ad9dacb812 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:45.556999 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b41eb6-e525-4cce-a76a-19ad9dacb812 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:45.557260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b41eb6-e525-4cce-a76a-19ad9dacb812 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:45.568135 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49c27e-3088-4942-936a-04830e64a6eb None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:45.568920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b41eb6-e525-4cce-a76a-19ad9dacb812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-c5b41eb6-e525-4cce-a76a-19ad9dacb812 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:45.574252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:45.575238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:45.576652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:45.576652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:45.576652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:45.576652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:45.576652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:45.576652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:45.576652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:45.576652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:45.576652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:45.576652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:45.576652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:31:45.576652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:45.580394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 513/1026] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Aug 29 22:31:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:45.581255 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b41eb6-e525-4cce-a76a-19ad9dacb812 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:45.614301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29713e1a-8cdd-4414-9d37-f67b8d5d78b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:45.614919 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29713e1a-8cdd-4414-9d37-f67b8d5d78b5 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:45.615202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29713e1a-8cdd-4414-9d37-f67b8d5d78b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:45.615482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29713e1a-8cdd-4414-9d37-f67b8d5d78b5 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:45.616191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29713e1a-8cdd-4414-9d37-f67b8d5d78b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:45.617619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29713e1a-8cdd-4414-9d37-f67b8d5d78b5 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:45.626389 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:45.694123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b41eb6-e525-4cce-a76a-19ad9dacb812 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:45.719040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 514/1027] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:31:45 2022] POST /identity/v3/users => generated 285 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:45.731661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0819e-fe3f-4b5a-ae1f-91a265a76b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:45.732388 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0819e-fe3f-4b5a-ae1f-91a265a76b27 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:45.732702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0819e-fe3f-4b5a-ae1f-91a265a76b27 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:45.732969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0819e-fe3f-4b5a-ae1f-91a265a76b27 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:45.734227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0819e-fe3f-4b5a-ae1f-91a265a76b27 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:45.734227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0819e-fe3f-4b5a-ae1f-91a265a76b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:45.735517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0819e-fe3f-4b5a-ae1f-91a265a76b27 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:45.751101 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 514/1028] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Aug 29 22:31:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:45.752734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29713e1a-8cdd-4414-9d37-f67b8d5d78b5 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:45.774771 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:45.871600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29713e1a-8cdd-4414-9d37-f67b8d5d78b5 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:45.909662 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264fabd-7d54-4fd8-b175-c826a34eab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:45.910301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264fabd-7d54-4fd8-b175-c826a34eab78 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:45.910581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264fabd-7d54-4fd8-b175-c826a34eab78 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:45.910849 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264fabd-7d54-4fd8-b175-c826a34eab78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:45.923332 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264fabd-7d54-4fd8-b175-c826a34eab78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:45.925200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264fabd-7d54-4fd8-b175-c826a34eab78 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:45.927222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b440e-d4cd-47db-8398-87809b4201eb None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:45.927650 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b440e-d4cd-47db-8398-87809b4201eb None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:45.927792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b440e-d4cd-47db-8398-87809b4201eb None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:45.929145 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 515/1029] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:45.934593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a213e7-c690-415f-893e-bbf69835f8da None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:45.935930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a213e7-c690-415f-893e-bbf69835f8da None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:45.936432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a213e7-c690-415f-893e-bbf69835f8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-0264fabd-7d54-4fd8-b175-c826a34eab78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:45.945082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:45.946163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:45.947605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:45.947605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:45.947605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:45.947605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 515/1030] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:45.952893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264fabd-7d54-4fd8-b175-c826a34eab78 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:45.963655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-65a213e7-c690-415f-893e-bbf69835f8da None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:45.965509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-65a213e7-c690-415f-893e-bbf69835f8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:46.037336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:46.048261 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 516/1031] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:46.069403 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264fabd-7d54-4fd8-b175-c826a34eab78 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:46.107080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd3b08-727f-4729-bc26-401f18b2c20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:46.107694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd3b08-727f-4729-bc26-401f18b2c20d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:46.108019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd3b08-727f-4729-bc26-401f18b2c20d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:46.108322 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd3b08-727f-4729-bc26-401f18b2c20d None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:46.109031 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd3b08-727f-4729-bc26-401f18b2c20d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:46.109338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd3b08-727f-4729-bc26-401f18b2c20d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:46.110687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd3b08-727f-4729-bc26-401f18b2c20d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:46.125147 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 516/1032] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:46.131073 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a213e7-c690-415f-893e-bbf69835f8da None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:46.162168 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:46.240339 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a213e7-c690-415f-893e-bbf69835f8da None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:46.277440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd6d3c-c3a3-4a60-a65a-970ec7505df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:46.278069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd6d3c-c3a3-4a60-a65a-970ec7505df1 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:46.278345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd6d3c-c3a3-4a60-a65a-970ec7505df1 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:46.278645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd6d3c-c3a3-4a60-a65a-970ec7505df1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:46.285997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd6d3c-c3a3-4a60-a65a-970ec7505df1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:46.287575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd6d3c-c3a3-4a60-a65a-970ec7505df1 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-05cd6d3c-c3a3-4a60-a65a-970ec7505df1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:46.299963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:46.305832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:46.306801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:46.306801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:46.306801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:46.306801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:46.306801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:46.306801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:46.306801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:46.306801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:46.306801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:31:46.306801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:46.306801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 517/1033] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 29 22:31:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:46.309036 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd3b08-727f-4729-bc26-401f18b2c20d None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:46.317875 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd6d3c-c3a3-4a60-a65a-970ec7505df1 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:46.413867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:46.421103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd3b08-727f-4729-bc26-401f18b2c20d None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:46.426457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd6d3c-c3a3-4a60-a65a-970ec7505df1 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:46.458006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:46.463972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62188b-6388-42a0-9a5c-7ba5e434e8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:46.464232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fac959-e8cd-46a2-a097-af7292d58477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:46.464619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62188b-6388-42a0-9a5c-7ba5e434e8b4 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:46.464847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fac959-e8cd-46a2-a097-af7292d58477 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:46.464978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62188b-6388-42a0-9a5c-7ba5e434e8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:46.465138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fac959-e8cd-46a2-a097-af7292d58477 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:46.465249 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62188b-6388-42a0-9a5c-7ba5e434e8b4 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:46.465402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fac959-e8cd-46a2-a097-af7292d58477 None admin] PATH_INFO: `/v3/services/image` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:46.465866 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62188b-6388-42a0-9a5c-7ba5e434e8b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:46.465993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fac959-e8cd-46a2-a097-af7292d58477 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:46.466168 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62188b-6388-42a0-9a5c-7ba5e434e8b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:46.467328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fac959-e8cd-46a2-a097-af7292d58477 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:46.467563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62188b-6388-42a0-9a5c-7ba5e434e8b4 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-63fac959-e8cd-46a2-a097-af7292d58477 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:46.477010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:46.478028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:46.481163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:46.481163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:46.481163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:46.481163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:46.481163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:46.481163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:46.481163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:46.481163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:46.481163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:46.481163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:46.481163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:46.481163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:46.481163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:31:46.481163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:46.481163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 518/1034] 10.222.0.62 () {56 vars in 1105 bytes} [Mon Aug 29 22:31:46 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:46.484486 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fac959-e8cd-46a2-a097-af7292d58477 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:46.488620 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 517/1035] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 29 22:31:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:46.493605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62188b-6388-42a0-9a5c-7ba5e434e8b4 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:46.602732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fac959-e8cd-46a2-a097-af7292d58477 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:46.609026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62188b-6388-42a0-9a5c-7ba5e434e8b4 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:46.643896 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6ecd5-edf5-4ac2-bd16-1c4fc6aed4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:46.644661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6ecd5-edf5-4ac2-bd16-1c4fc6aed4af None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:46.644932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6ecd5-edf5-4ac2-bd16-1c4fc6aed4af None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:46.645209 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6ecd5-edf5-4ac2-bd16-1c4fc6aed4af None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:46.645845 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6ecd5-edf5-4ac2-bd16-1c4fc6aed4af None admin] RBAC: Adding query filter params (name=image) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:46.646152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6ecd5-edf5-4ac2-bd16-1c4fc6aed4af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:46.646327 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12fef4-94bb-4b7d-a326-ebf5ee7afe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:46.646925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12fef4-94bb-4b7d-a326-ebf5ee7afe88 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:46.647200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12fef4-94bb-4b7d-a326-ebf5ee7afe88 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:46.647471 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12fef4-94bb-4b7d-a326-ebf5ee7afe88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:46.647567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6ecd5-edf5-4ac2-bd16-1c4fc6aed4af None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:46.656424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 519/1036] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:46.658664 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6ecd5-edf5-4ac2-bd16-1c4fc6aed4af None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:46.679293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:46.709140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:46.722009 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12fef4-94bb-4b7d-a326-ebf5ee7afe88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:46.723638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12fef4-94bb-4b7d-a326-ebf5ee7afe88 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:46.766784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6ecd5-edf5-4ac2-bd16-1c4fc6aed4af None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:46.805751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f389c-cfe8-47b7-8ea4-047e593f0a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:46.806362 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f389c-cfe8-47b7-8ea4-047e593f0a4b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:46.806642 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f389c-cfe8-47b7-8ea4-047e593f0a4b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:46.806959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f389c-cfe8-47b7-8ea4-047e593f0a4b None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:46.807620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f389c-cfe8-47b7-8ea4-047e593f0a4b None admin] RBAC: Adding query filter params (type=image) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:46.807925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f389c-cfe8-47b7-8ea4-047e593f0a4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:46.809348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f389c-cfe8-47b7-8ea4-047e593f0a4b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:46.814465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 520/1037] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:46.820240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f389c-cfe8-47b7-8ea4-047e593f0a4b None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:46.848035 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 518/1038] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:31:46.853584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12fef4-94bb-4b7d-a326-ebf5ee7afe88 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:46.913623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:46.936139 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f389c-cfe8-47b7-8ea4-047e593f0a4b None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:46.945991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:46.958573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12fef4-94bb-4b7d-a326-ebf5ee7afe88 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:46.977908 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58020e-a3fe-4dcf-af54-d127bb8be9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:46.978828 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58020e-a3fe-4dcf-af54-d127bb8be9c6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:46.979356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58020e-a3fe-4dcf-af54-d127bb8be9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:46.980453 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58020e-a3fe-4dcf-af54-d127bb8be9c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:46.981351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58020e-a3fe-4dcf-af54-d127bb8be9c6 None admin] RBAC: Adding query filter params (interface=public, service_id=740147585e0f42d699d9e482d1c43bef, region_id=RegionOne) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:46.981853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58020e-a3fe-4dcf-af54-d127bb8be9c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:46.983471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58020e-a3fe-4dcf-af54-d127bb8be9c6 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:46.989780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 521/1039] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 29 22:31:46 2022] GET /identity/v3/endpoints?service_id=740147585e0f42d699d9e482d1c43bef&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:46.995840 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58020e-a3fe-4dcf-af54-d127bb8be9c6 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:46.999816 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316137b-a492-4f21-bd46-8b16acaf05a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:47.000477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316137b-a492-4f21-bd46-8b16acaf05a8 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.000755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316137b-a492-4f21-bd46-8b16acaf05a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.001023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316137b-a492-4f21-bd46-8b16acaf05a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.012532 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316137b-a492-4f21-bd46-8b16acaf05a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:47.013969 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316137b-a492-4f21-bd46-8b16acaf05a8 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-9316137b-a492-4f21-bd46-8b16acaf05a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:47.029039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:47.030152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:47.031053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:47.031053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:47.031053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:47.031053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 519/1040] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:47.035696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316137b-a492-4f21-bd46-8b16acaf05a8 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:47.113924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58020e-a3fe-4dcf-af54-d127bb8be9c6 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:47.154166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ed688-4a2d-40e6-843a-adb37aabfa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:47.155095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ed688-4a2d-40e6-843a-adb37aabfa9b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.155571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ed688-4a2d-40e6-843a-adb37aabfa9b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.156039 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ed688-4a2d-40e6-843a-adb37aabfa9b None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.156961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ed688-4a2d-40e6-843a-adb37aabfa9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:47.158618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ed688-4a2d-40e6-843a-adb37aabfa9b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:47.166187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 522/1041] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 29 22:31:46 2022] GET /identity/v3/services => generated 1957 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:31:47.166790 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316137b-a492-4f21-bd46-8b16acaf05a8 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:47.216806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3053f1-cb2f-4e88-844b-9b133f263298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:47.217357 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3053f1-cb2f-4e88-844b-9b133f263298 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.217642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3053f1-cb2f-4e88-844b-9b133f263298 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.217918 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3053f1-cb2f-4e88-844b-9b133f263298 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.218590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3053f1-cb2f-4e88-844b-9b133f263298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:47.218903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3053f1-cb2f-4e88-844b-9b133f263298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:47.220364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3053f1-cb2f-4e88-844b-9b133f263298 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:47.231507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:47.235570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 520/1042] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:47.241167 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ed688-4a2d-40e6-843a-adb37aabfa9b None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:47.253536 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:47.364434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ed688-4a2d-40e6-843a-adb37aabfa9b None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:47.399453 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bb9e9-25c9-4bdb-82d6-404023c48196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:47.400122 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bb9e9-25c9-4bdb-82d6-404023c48196 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.400399 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bb9e9-25c9-4bdb-82d6-404023c48196 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.400673 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bb9e9-25c9-4bdb-82d6-404023c48196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.408924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bb9e9-25c9-4bdb-82d6-404023c48196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:47.410566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bb9e9-25c9-4bdb-82d6-404023c48196 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:47.423221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-e25bb9e9-25c9-4bdb-82d6-404023c48196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:47.423221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:47.423221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:47.423221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:47.423221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:47.423221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:47.423221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:47.423221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:47.423221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:47.423221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:47.423221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:47.423221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:47.423221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:47.423221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:47.423221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:47.424646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:47.425564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:47.425564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:47.425564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:47.425564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:47.425564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:47.425564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:47.425564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:47.425564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:47.425564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 523/1043] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:47.430933 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3053f1-cb2f-4e88-844b-9b133f263298 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:47.541545 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3053f1-cb2f-4e88-844b-9b133f263298 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:47.592644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4e1a8-c79d-4baf-8bb8-701442ef38cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:47.593541 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4e1a8-c79d-4baf-8bb8-701442ef38cc None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.593997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4e1a8-c79d-4baf-8bb8-701442ef38cc None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.594440 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4e1a8-c79d-4baf-8bb8-701442ef38cc None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.595333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4e1a8-c79d-4baf-8bb8-701442ef38cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:47.595813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4e1a8-c79d-4baf-8bb8-701442ef38cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:47.597473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4e1a8-c79d-4baf-8bb8-701442ef38cc None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:47.618388 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 521/1044] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:47.620513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bb9e9-25c9-4bdb-82d6-404023c48196 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:47.690586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:47.726145 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bb9e9-25c9-4bdb-82d6-404023c48196 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:47.761721 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0707f86-3f14-4343-88bb-34cff4ae65ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:47.762325 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0707f86-3f14-4343-88bb-34cff4ae65ac None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.762604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0707f86-3f14-4343-88bb-34cff4ae65ac None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.762901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0707f86-3f14-4343-88bb-34cff4ae65ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.763621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0707f86-3f14-4343-88bb-34cff4ae65ac None admin] RBAC: Adding query filter params (role.id=4ae46f00844c4ee79187b2dbaaf21a43, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=f06d910badb84c6aa6b48f3b56b91f82) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:47.763925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0707f86-3f14-4343-88bb-34cff4ae65ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:47.765379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0707f86-3f14-4343-88bb-34cff4ae65ac None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:47.776163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 524/1045] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:47 2022] GET /identity/v3/role_assignments?user.id=f06d910badb84c6aa6b48f3b56b91f82&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=4ae46f00844c4ee79187b2dbaaf21a43 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:47.776417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8768cbb-5711-4e00-b7b1-dd61eebc7f8a None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.776417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8768cbb-5711-4e00-b7b1-dd61eebc7f8a None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.776417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8768cbb-5711-4e00-b7b1-dd61eebc7f8a None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.776417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 522/1046] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:47.783079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1da491-15b0-4e9b-b92b-94d345c434cf None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.783424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1da491-15b0-4e9b-b92b-94d345c434cf None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.783624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1da491-15b0-4e9b-b92b-94d345c434cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.803660 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-4e1da491-15b0-4e9b-b92b-94d345c434cf None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:47.804852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4e1da491-15b0-4e9b-b92b-94d345c434cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:47.890765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 525/1047] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:48.166656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8768cbb-5711-4e00-b7b1-dd61eebc7f8a None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:48.233882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:48.280165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8768cbb-5711-4e00-b7b1-dd61eebc7f8a None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:48.317962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896112c-4166-4d34-aa9f-5bff0f5db050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:48.318603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896112c-4166-4d34-aa9f-5bff0f5db050 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:48.318885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896112c-4166-4d34-aa9f-5bff0f5db050 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:48.319160 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896112c-4166-4d34-aa9f-5bff0f5db050 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:48.336499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896112c-4166-4d34-aa9f-5bff0f5db050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-f896112c-4166-4d34-aa9f-5bff0f5db050 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:48.341419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:48.342411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:48.343350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:48.343350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:48.343350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:48.343350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:48.343350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:48.343350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:48.343350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:48.343350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:48.343350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:48.343350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:48.343350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:48.343350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:48.347570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 523/1048] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:48.349080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1da491-15b0-4e9b-b92b-94d345c434cf None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:48.412737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:48.453597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1da491-15b0-4e9b-b92b-94d345c434cf None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:48.490809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9fc5f-9a6a-4a54-a148-b2f589d739a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:48.491421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9fc5f-9a6a-4a54-a148-b2f589d739a4 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:48.491703 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9fc5f-9a6a-4a54-a148-b2f589d739a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:48.491988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9fc5f-9a6a-4a54-a148-b2f589d739a4 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:48.492682 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9fc5f-9a6a-4a54-a148-b2f589d739a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:48.492990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9fc5f-9a6a-4a54-a148-b2f589d739a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:48.494446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9fc5f-9a6a-4a54-a148-b2f589d739a4 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:48.503859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 526/1049] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:48.509688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896112c-4166-4d34-aa9f-5bff0f5db050 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:48.626865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896112c-4166-4d34-aa9f-5bff0f5db050 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:48.647973 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:48.663078 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2824d3-6e28-4d15-bc3e-9dc7ee50a6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:48.666141 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2824d3-6e28-4d15-bc3e-9dc7ee50a6a0 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:48.666141 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2824d3-6e28-4d15-bc3e-9dc7ee50a6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:48.666141 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2824d3-6e28-4d15-bc3e-9dc7ee50a6a0 None admin] PATH_INFO: `/v3/users/1da17daf1c2a4a7ab58445338952bc3d` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:48.678449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2824d3-6e28-4d15-bc3e-9dc7ee50a6a0 None admin] RBAC: Authorizing `identity:get_user(user_id=1da17daf1c2a4a7ab58445338952bc3d)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:48.680116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2824d3-6e28-4d15-bc3e-9dc7ee50a6a0 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:48.681928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 524/1050] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:48 2022] GET /identity/v3/users/1da17daf1c2a4a7ab58445338952bc3d => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:48.687849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9fc5f-9a6a-4a54-a148-b2f589d739a4 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:48.800587 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9fc5f-9a6a-4a54-a148-b2f589d739a4 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:48.825105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:48.836152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28de797-358f-4bcd-b38d-510d6d836753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:48.839618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28de797-358f-4bcd-b38d-510d6d836753 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:48.839618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28de797-358f-4bcd-b38d-510d6d836753 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:48.839618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28de797-358f-4bcd-b38d-510d6d836753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:48.914884 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28de797-358f-4bcd-b38d-510d6d836753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:48.916388 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28de797-358f-4bcd-b38d-510d6d836753 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:49.020525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 527/1051] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:48 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:31:49.026316 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2824d3-6e28-4d15-bc3e-9dc7ee50a6a0 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:49.128078 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2824d3-6e28-4d15-bc3e-9dc7ee50a6a0 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:49.159900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8268e2-a8f2-4185-839f-9db220d9dcb7 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:49.160252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8268e2-a8f2-4185-839f-9db220d9dcb7 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:49.160464 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8268e2-a8f2-4185-839f-9db220d9dcb7 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:49.162037 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 528/1052] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:49.165123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedbe6f-668f-4745-895e-6d337d5707d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:49.165869 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedbe6f-668f-4745-895e-6d337d5707d8 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:49.166150 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedbe6f-668f-4745-895e-6d337d5707d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:49.166419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedbe6f-668f-4745-895e-6d337d5707d8 None admin] PATH_INFO: `/v3/projects/52574ae3e0904812a92efd80ff527135` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:49.166870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04de9e-b4a1-471b-bf8b-957a1d8b3641 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:49.167199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04de9e-b4a1-471b-bf8b-957a1d8b3641 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:49.167466 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04de9e-b4a1-471b-bf8b-957a1d8b3641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:49.167749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedbe6f-668f-4745-895e-6d337d5707d8 None admin] RBAC: Authorizing `identity:get_project(project_id=52574ae3e0904812a92efd80ff527135)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:49.169216 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedbe6f-668f-4745-895e-6d337d5707d8 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:49.171035 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 525/1053] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:49 2022] GET /identity/v3/projects/52574ae3e0904812a92efd80ff527135 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:49.177161 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedbe6f-668f-4745-895e-6d337d5707d8 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:49.186628 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-aa04de9e-b4a1-471b-bf8b-957a1d8b3641 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:49.187808 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-aa04de9e-b4a1-471b-bf8b-957a1d8b3641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:49.206458 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:49.227400 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:49.258006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 529/1054] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:49.287068 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedbe6f-668f-4745-895e-6d337d5707d8 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:49.322957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54bd10-a256-47d7-bf7c-708573a5d67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:49.324127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54bd10-a256-47d7-bf7c-708573a5d67c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:49.324410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54bd10-a256-47d7-bf7c-708573a5d67c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:49.324677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54bd10-a256-47d7-bf7c-708573a5d67c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:49.325406 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54bd10-a256-47d7-bf7c-708573a5d67c None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=52574ae3e0904812a92efd80ff527135, user.id=1da17daf1c2a4a7ab58445338952bc3d) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:49.325714 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54bd10-a256-47d7-bf7c-708573a5d67c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:49.327127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54bd10-a256-47d7-bf7c-708573a5d67c None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:49.340412 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 526/1055] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:49 2022] GET /identity/v3/role_assignments?user.id=1da17daf1c2a4a7ab58445338952bc3d&scope.project.id=52574ae3e0904812a92efd80ff527135&role.id=a7d59d2982de4bfeb758dce70808029f => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:49.530679 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04de9e-b4a1-471b-bf8b-957a1d8b3641 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:49.647525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04de9e-b4a1-471b-bf8b-957a1d8b3641 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:49.683619 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598aea3-22ca-47a7-b32c-1a903c7254a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:49.684282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598aea3-22ca-47a7-b32c-1a903c7254a5 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:49.684560 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598aea3-22ca-47a7-b32c-1a903c7254a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:49.684839 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598aea3-22ca-47a7-b32c-1a903c7254a5 None admin] PATH_INFO: `/v3/services/image` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:49.685423 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598aea3-22ca-47a7-b32c-1a903c7254a5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:49.686783 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598aea3-22ca-47a7-b32c-1a903c7254a5 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:49.690648 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3c51b-0a81-41d6-8dbf-ba47462aa95b None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:49.691015 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3c51b-0a81-41d6-8dbf-ba47462aa95b None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:49.691354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3c51b-0a81-41d6-8dbf-ba47462aa95b None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:49.692790 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 527/1056] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-1598aea3-22ca-47a7-b32c-1a903c7254a5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:49.696940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:49.697935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:49.699394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:49.699394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:49.699394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:49.699394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:49.699394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:49.699394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:49.699394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:49.699394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:49.699394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:49.699394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:49.699394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:31:49.699394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:31:49.699394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:31:49.699394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:49.700280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edef730-6c75-42b5-8d40-64a0ea5f6c22 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:49.700280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edef730-6c75-42b5-8d40-64a0ea5f6c22 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:49.700280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edef730-6c75-42b5-8d40-64a0ea5f6c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:49.701447 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 530/1057] 10.222.0.62 () {56 vars in 1105 bytes} [Mon Aug 29 22:31:49 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:49.707165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598aea3-22ca-47a7-b32c-1a903c7254a5 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:49.722888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-5edef730-6c75-42b5-8d40-64a0ea5f6c22 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:49.723967 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5edef730-6c75-42b5-8d40-64a0ea5f6c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:49.728436 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:49.810027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 528/1058] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:49.839906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598aea3-22ca-47a7-b32c-1a903c7254a5 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:49.877112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ef278-733f-41ea-b4d1-a91638aaf5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:49.877642 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ef278-733f-41ea-b4d1-a91638aaf5ca None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:49.877939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ef278-733f-41ea-b4d1-a91638aaf5ca None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:49.878191 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ef278-733f-41ea-b4d1-a91638aaf5ca None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:49.878830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ef278-733f-41ea-b4d1-a91638aaf5ca None admin] RBAC: Adding query filter params (name=image) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:49.879203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ef278-733f-41ea-b4d1-a91638aaf5ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:49.880653 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ef278-733f-41ea-b4d1-a91638aaf5ca None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:49.886041 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 531/1059] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:49.891626 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edef730-6c75-42b5-8d40-64a0ea5f6c22 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:49.937600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:49.998974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edef730-6c75-42b5-8d40-64a0ea5f6c22 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:50.034638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be09fe7-cd4d-460a-9aa9-bf20c1cc0b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:50.035248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be09fe7-cd4d-460a-9aa9-bf20c1cc0b0d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:50.035530 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be09fe7-cd4d-460a-9aa9-bf20c1cc0b0d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:50.035805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be09fe7-cd4d-460a-9aa9-bf20c1cc0b0d None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:50.036464 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be09fe7-cd4d-460a-9aa9-bf20c1cc0b0d None admin] RBAC: Adding query filter params (type=image) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:50.036769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be09fe7-cd4d-460a-9aa9-bf20c1cc0b0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:50.038124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be09fe7-cd4d-460a-9aa9-bf20c1cc0b0d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:50.043985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 529/1060] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:50.049719 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ef278-733f-41ea-b4d1-a91638aaf5ca None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:50.079842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be09fe7-cd4d-460a-9aa9-bf20c1cc0b0d None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:50.135139 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:50.155038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ef278-733f-41ea-b4d1-a91638aaf5ca None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:50.191009 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be09fe7-cd4d-460a-9aa9-bf20c1cc0b0d None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:50.192462 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fe1a3-ab8e-4afc-9829-9a947f2dd706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:50.192967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe1a3-ab8e-4afc-9829-9a947f2dd706 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:50.193271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe1a3-ab8e-4afc-9829-9a947f2dd706 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:50.193541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe1a3-ab8e-4afc-9829-9a947f2dd706 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:50.193967 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:50.194549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fe1a3-ab8e-4afc-9829-9a947f2dd706 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:50.195596 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fe1a3-ab8e-4afc-9829-9a947f2dd706 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:50.226757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34702f15-bcc1-4854-871a-4f8aafd66d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:50.227384 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34702f15-bcc1-4854-871a-4f8aafd66d8f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:50.227662 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34702f15-bcc1-4854-871a-4f8aafd66d8f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:50.227931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34702f15-bcc1-4854-871a-4f8aafd66d8f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:50.238687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34702f15-bcc1-4854-871a-4f8aafd66d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-34702f15-bcc1-4854-871a-4f8aafd66d8f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:50.243875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:50.244991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:50.246396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:50.246396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:50.246396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:50.246396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:50.246396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:50.246396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:50.246396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:50.246396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:50.246396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:50.246396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:50.246396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:31:50.246396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:50.246396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 530/1061] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Aug 29 22:31:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:50.251426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34702f15-bcc1-4854-871a-4f8aafd66d8f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:50.300980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 532/1062] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:31:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:50.366785 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34702f15-bcc1-4854-871a-4f8aafd66d8f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:50.411464 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e4de1-535f-4e79-be2c-7d62d45c254b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:50.412135 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e4de1-535f-4e79-be2c-7d62d45c254b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:50.412399 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e4de1-535f-4e79-be2c-7d62d45c254b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:50.412667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e4de1-535f-4e79-be2c-7d62d45c254b None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:50.413373 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e4de1-535f-4e79-be2c-7d62d45c254b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:50.413681 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e4de1-535f-4e79-be2c-7d62d45c254b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:50.415193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e4de1-535f-4e79-be2c-7d62d45c254b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:50.431403 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 531/1063] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Aug 29 22:31:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:50.433436 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fe1a3-ab8e-4afc-9829-9a947f2dd706 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:50.543705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fe1a3-ab8e-4afc-9829-9a947f2dd706 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:50.586626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc831fc3-c9fb-41bc-add3-d86aae5ab957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:50.586626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc831fc3-c9fb-41bc-add3-d86aae5ab957 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:50.586626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc831fc3-c9fb-41bc-add3-d86aae5ab957 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:50.586626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc831fc3-c9fb-41bc-add3-d86aae5ab957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:50.596203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:50.599907 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc831fc3-c9fb-41bc-add3-d86aae5ab957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:50.601530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc831fc3-c9fb-41bc-add3-d86aae5ab957 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-dc831fc3-c9fb-41bc-add3-d86aae5ab957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:50.617042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:50.618003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:50.618962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:50.618962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:50.618962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:50.618962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 533/1064] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:50.624238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e4de1-535f-4e79-be2c-7d62d45c254b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:50.650570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:50.732525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e4de1-535f-4e79-be2c-7d62d45c254b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:50.767656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b3601-c342-46d8-b429-aa06373fe50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:50.768304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b3601-c342-46d8-b429-aa06373fe50f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:50.768600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b3601-c342-46d8-b429-aa06373fe50f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:50.768856 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b3601-c342-46d8-b429-aa06373fe50f None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:50.769508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b3601-c342-46d8-b429-aa06373fe50f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:50.769834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b3601-c342-46d8-b429-aa06373fe50f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:50.771198 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b3601-c342-46d8-b429-aa06373fe50f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:50.793395 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 532/1065] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:50.794907 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc831fc3-c9fb-41bc-add3-d86aae5ab957 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:50.926149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc831fc3-c9fb-41bc-add3-d86aae5ab957 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:50.963431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071bf83-a9c6-4e32-b2b8-f84ff130fa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:50.964618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071bf83-a9c6-4e32-b2b8-f84ff130fa8b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:50.964895 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071bf83-a9c6-4e32-b2b8-f84ff130fa8b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:50.965192 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071bf83-a9c6-4e32-b2b8-f84ff130fa8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:50.973126 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071bf83-a9c6-4e32-b2b8-f84ff130fa8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:50.974600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071bf83-a9c6-4e32-b2b8-f84ff130fa8b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-e071bf83-a9c6-4e32-b2b8-f84ff130fa8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:50.986148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:50.987288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:50.988275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:50.988275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:50.988275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:50.988275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:50.988275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:50.988275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:50.988275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:50.988275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:50.988275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:31:50.988275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:50.988275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 534/1066] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 29 22:31:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:50.993073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b3601-c342-46d8-b429-aa06373fe50f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:51.079347 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:51.098569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b3601-c342-46d8-b429-aa06373fe50f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:51.135049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345db5c1-c5ca-4706-8216-4ea1d86c8a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:51.136349 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345db5c1-c5ca-4706-8216-4ea1d86c8a98 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.136699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345db5c1-c5ca-4706-8216-4ea1d86c8a98 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.136987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345db5c1-c5ca-4706-8216-4ea1d86c8a98 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.137723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345db5c1-c5ca-4706-8216-4ea1d86c8a98 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:51.138030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345db5c1-c5ca-4706-8216-4ea1d86c8a98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:51.139463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345db5c1-c5ca-4706-8216-4ea1d86c8a98 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:51.158124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 533/1067] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 29 22:31:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:51.165282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071bf83-a9c6-4e32-b2b8-f84ff130fa8b None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:51.218902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:51.262837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141ef23-3f36-44e5-8522-6e5f982f0b16 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.263508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141ef23-3f36-44e5-8522-6e5f982f0b16 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.263508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141ef23-3f36-44e5-8522-6e5f982f0b16 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.264855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 534/1068] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:51.269706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fecc3-0289-465a-8080-91b6724091bd None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.269993 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fecc3-0289-465a-8080-91b6724091bd None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.270392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fecc3-0289-465a-8080-91b6724091bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.273192 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071bf83-a9c6-4e32-b2b8-f84ff130fa8b None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:51.289512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-a32fecc3-0289-465a-8080-91b6724091bd None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:51.290709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a32fecc3-0289-465a-8080-91b6724091bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:51.311129 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bb627-2986-46d5-a500-2df6cbfcd638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:51.311986 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bb627-2986-46d5-a500-2df6cbfcd638 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.312509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bb627-2986-46d5-a500-2df6cbfcd638 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.312784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bb627-2986-46d5-a500-2df6cbfcd638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.326253 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bb627-2986-46d5-a500-2df6cbfcd638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:51.327693 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bb627-2986-46d5-a500-2df6cbfcd638 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-ea3bb627-2986-46d5-a500-2df6cbfcd638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:51.343020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:51.344055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:51.345032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:51.345032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:51.345032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:51.345032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 535/1069] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:51.350739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bb627-2986-46d5-a500-2df6cbfcd638 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:51.372173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 535/1070] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:51.459386 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bb627-2986-46d5-a500-2df6cbfcd638 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:51.461398 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:51.497027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540da34a-4459-421a-9ce9-e78b695b4d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:51.497553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540da34a-4459-421a-9ce9-e78b695b4d84 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.497834 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540da34a-4459-421a-9ce9-e78b695b4d84 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.498107 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540da34a-4459-421a-9ce9-e78b695b4d84 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.498753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540da34a-4459-421a-9ce9-e78b695b4d84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:51.499060 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540da34a-4459-421a-9ce9-e78b695b4d84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:51.500501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540da34a-4459-421a-9ce9-e78b695b4d84 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:51.512413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 536/1071] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:51.517804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fecc3-0289-465a-8080-91b6724091bd None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:51.596437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:51.630317 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fecc3-0289-465a-8080-91b6724091bd None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:51.642900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540da34a-4459-421a-9ce9-e78b695b4d84 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:51.669100 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bd766-ffbe-49ba-9622-232e614e44a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:51.669743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bd766-ffbe-49ba-9622-232e614e44a7 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.670023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bd766-ffbe-49ba-9622-232e614e44a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.670297 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bd766-ffbe-49ba-9622-232e614e44a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.677277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061bd766-ffbe-49ba-9622-232e614e44a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:51.678738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061bd766-ffbe-49ba-9622-232e614e44a7 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:51.690603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-061bd766-ffbe-49ba-9622-232e614e44a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:51.690603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:51.690603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:51.690603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:51.690603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:51.690603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:51.690603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:51.690603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:51.690603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:51.690603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:51.690603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:51.690603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:51.690603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:51.690603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:51.690603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:51.691730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:51.692698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:51.692698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:51.692698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:51.692698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:51.692698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:51.692698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:51.692698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:51.692698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:51.692698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 536/1072] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:51.697554 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bd766-ffbe-49ba-9622-232e614e44a7 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:51.761372 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540da34a-4459-421a-9ce9-e78b695b4d84 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:51.798252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd3001-62de-459a-a9c7-2c91399046f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:51.799141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd3001-62de-459a-a9c7-2c91399046f9 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.799425 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd3001-62de-459a-a9c7-2c91399046f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.799695 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd3001-62de-459a-a9c7-2c91399046f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.806644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bd766-ffbe-49ba-9622-232e614e44a7 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:51.812071 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd3001-62de-459a-a9c7-2c91399046f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-d4bd3001-62de-459a-a9c7-2c91399046f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:51.817656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:51.818815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:51.819765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:51.819765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:51.819765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:51.819765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:51.819765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:51.819765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:51.819765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:51.819765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:51.819765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:51.819765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:51.819765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:51.819765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:51.819765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 537/1073] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:51.825503 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd3001-62de-459a-a9c7-2c91399046f9 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:51.841270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:51.847472 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6543b-a2e4-4ee5-b7f8-dca6d9a576c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:51.848142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6543b-a2e4-4ee5-b7f8-dca6d9a576c7 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.848404 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6543b-a2e4-4ee5-b7f8-dca6d9a576c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.848679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6543b-a2e4-4ee5-b7f8-dca6d9a576c7 None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.849375 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6543b-a2e4-4ee5-b7f8-dca6d9a576c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:51.849687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6543b-a2e4-4ee5-b7f8-dca6d9a576c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:51.851336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6543b-a2e4-4ee5-b7f8-dca6d9a576c7 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:51.852355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:51.863870 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 537/1074] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:51.869742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6543b-a2e4-4ee5-b7f8-dca6d9a576c7 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:51.941296 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd3001-62de-459a-a9c7-2c91399046f9 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:51.979467 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6543b-a2e4-4ee5-b7f8-dca6d9a576c7 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:51.985656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dc689-039f-4b40-b90f-0f1b23815d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:51.986630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dc689-039f-4b40-b90f-0f1b23815d27 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.986910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dc689-039f-4b40-b90f-0f1b23815d27 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.987183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dc689-039f-4b40-b90f-0f1b23815d27 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.987857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dc689-039f-4b40-b90f-0f1b23815d27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:51.988257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dc689-039f-4b40-b90f-0f1b23815d27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:51.990803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dc689-039f-4b40-b90f-0f1b23815d27 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:52.001055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 538/1075] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:52.006501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dc689-039f-4b40-b90f-0f1b23815d27 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:52.030495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24410b-4d7e-4aca-b8bc-3be1a933ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:52.031087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24410b-4d7e-4aca-b8bc-3be1a933ee6d None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:52.031367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24410b-4d7e-4aca-b8bc-3be1a933ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:52.031643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24410b-4d7e-4aca-b8bc-3be1a933ee6d None admin] PATH_INFO: `/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/f06d910badb84c6aa6b48f3b56b91f82/roles/4ae46f00844c4ee79187b2dbaaf21a43` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.033853 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24410b-4d7e-4aca-b8bc-3be1a933ee6d None admin] RBAC: Authorizing `identity:create_grant(project_id=fdd2d14c7e884b8b8f340183a79fd481, user_id=f06d910badb84c6aa6b48f3b56b91f82, role_id=4ae46f00844c4ee79187b2dbaaf21a43)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:52.035308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24410b-4d7e-4aca-b8bc-3be1a933ee6d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:52.096839 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:52.109874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 538/1076] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:31:51 2022] PUT /identity/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/f06d910badb84c6aa6b48f3b56b91f82/roles/4ae46f00844c4ee79187b2dbaaf21a43 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:31:52.126495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dc689-039f-4b40-b90f-0f1b23815d27 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:52.165767 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fec292-4bb9-435e-a113-8c68c1a047f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:52.166427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fec292-4bb9-435e-a113-8c68c1a047f0 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:52.166773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fec292-4bb9-435e-a113-8c68c1a047f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:52.167555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fec292-4bb9-435e-a113-8c68c1a047f0 None admin] PATH_INFO: `/v3/users/1da17daf1c2a4a7ab58445338952bc3d` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.168827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fec292-4bb9-435e-a113-8c68c1a047f0 None admin] RBAC: Authorizing `identity:get_user(user_id=1da17daf1c2a4a7ab58445338952bc3d)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:52.170294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fec292-4bb9-435e-a113-8c68c1a047f0 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:52.172242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 539/1077] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:52 2022] GET /identity/v3/users/1da17daf1c2a4a7ab58445338952bc3d => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:52.178317 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24410b-4d7e-4aca-b8bc-3be1a933ee6d None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:52.236253 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:52.293785 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24410b-4d7e-4aca-b8bc-3be1a933ee6d None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:52.316907 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2bd38-3ee7-4bf7-b13f-96c1cee5d829 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:52.317194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2bd38-3ee7-4bf7-b13f-96c1cee5d829 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:52.317469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2bd38-3ee7-4bf7-b13f-96c1cee5d829 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.319299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 540/1078] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:52.325393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77887840-312c-4a58-982c-53484624d181 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:52.325675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77887840-312c-4a58-982c-53484624d181 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:52.325949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77887840-312c-4a58-982c-53484624d181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.331856 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1319332-8ab3-473b-aad1-c146cd1ae8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:52.332528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1319332-8ab3-473b-aad1-c146cd1ae8a7 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:52.332809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1319332-8ab3-473b-aad1-c146cd1ae8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:52.333133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1319332-8ab3-473b-aad1-c146cd1ae8a7 None admin] PATH_INFO: `/v3/projects/52574ae3e0904812a92efd80ff527135` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.334272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1319332-8ab3-473b-aad1-c146cd1ae8a7 None admin] RBAC: Authorizing `identity:get_project(project_id=52574ae3e0904812a92efd80ff527135)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:52.335690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1319332-8ab3-473b-aad1-c146cd1ae8a7 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:52.337681 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 539/1079] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:52 2022] GET /identity/v3/projects/52574ae3e0904812a92efd80ff527135 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:52.343726 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1319332-8ab3-473b-aad1-c146cd1ae8a7 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:52.345724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-77887840-312c-4a58-982c-53484624d181 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:52.346968 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-77887840-312c-4a58-982c-53484624d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:52.425000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 541/1080] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:52.455022 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1319332-8ab3-473b-aad1-c146cd1ae8a7 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:52.473699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:52.491530 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834769f-fad0-4206-b5f7-64886de212e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:52.492358 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834769f-fad0-4206-b5f7-64886de212e4 None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:52.492757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834769f-fad0-4206-b5f7-64886de212e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:52.492927 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834769f-fad0-4206-b5f7-64886de212e4 None admin] PATH_INFO: `/v3/projects/52574ae3e0904812a92efd80ff527135/users/1da17daf1c2a4a7ab58445338952bc3d/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.495489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834769f-fad0-4206-b5f7-64886de212e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=52574ae3e0904812a92efd80ff527135, user_id=1da17daf1c2a4a7ab58445338952bc3d, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:52.497010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834769f-fad0-4206-b5f7-64886de212e4 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:52.592002 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 540/1081] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:31:52 2022] PUT /identity/v3/projects/52574ae3e0904812a92efd80ff527135/users/1da17daf1c2a4a7ab58445338952bc3d/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:31:52.698711 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77887840-312c-4a58-982c-53484624d181 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:52.792423 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:52.811442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77887840-312c-4a58-982c-53484624d181 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:52.848218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100894e-68bb-47e3-9939-f38e25ef7535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:52.848725 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100894e-68bb-47e3-9939-f38e25ef7535 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:52.849007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100894e-68bb-47e3-9939-f38e25ef7535 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:52.849277 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100894e-68bb-47e3-9939-f38e25ef7535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.920800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100894e-68bb-47e3-9939-f38e25ef7535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:52.922263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100894e-68bb-47e3-9939-f38e25ef7535 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:53.005945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:53.028621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 542/1082] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:31:53.032442 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834769f-fad0-4206-b5f7-64886de212e4 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:53.139961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834769f-fad0-4206-b5f7-64886de212e4 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:53.174099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771136a-be46-4f3c-8d68-9ec656edc1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:53.174740 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771136a-be46-4f3c-8d68-9ec656edc1da None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:53.175021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771136a-be46-4f3c-8d68-9ec656edc1da None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:53.175292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771136a-be46-4f3c-8d68-9ec656edc1da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:53.187258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771136a-be46-4f3c-8d68-9ec656edc1da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:53.188756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771136a-be46-4f3c-8d68-9ec656edc1da None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-2771136a-be46-4f3c-8d68-9ec656edc1da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:53.204902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:53.205941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:53.206837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:53.206837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:53.206837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:53.211197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 541/1083] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:53.212679 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100894e-68bb-47e3-9939-f38e25ef7535 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:53.320423 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100894e-68bb-47e3-9939-f38e25ef7535 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:53.353804 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7580b6-c092-4213-b774-55b2c97ff24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:53.354924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7580b6-c092-4213-b774-55b2c97ff24b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:53.355199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7580b6-c092-4213-b774-55b2c97ff24b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:53.355473 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7580b6-c092-4213-b774-55b2c97ff24b None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:53.356118 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7580b6-c092-4213-b774-55b2c97ff24b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:53.356422 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7580b6-c092-4213-b774-55b2c97ff24b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:53.357809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7580b6-c092-4213-b774-55b2c97ff24b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:53.376125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 543/1084] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:54.052836 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04357235-76fe-4323-8281-d550b6dc05e5 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.053342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04357235-76fe-4323-8281-d550b6dc05e5 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.053342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04357235-76fe-4323-8281-d550b6dc05e5 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.054656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 542/1085] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:54.060125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d29e9c-f093-48f5-9910-2eb189911254 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.060538 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d29e9c-f093-48f5-9910-2eb189911254 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.060691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d29e9c-f093-48f5-9910-2eb189911254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.079327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-43d29e9c-f093-48f5-9910-2eb189911254 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:54.080548 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-43d29e9c-f093-48f5-9910-2eb189911254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:54.118068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:54.149410 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 544/1086] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:54.417340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04357235-76fe-4323-8281-d550b6dc05e5 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:54.450811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:54.507408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26c325-f5c5-4685-871c-3517c0390164 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.507692 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26c325-f5c5-4685-871c-3517c0390164 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.507961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26c325-f5c5-4685-871c-3517c0390164 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.509375 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 545/1087] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:54.515017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfdcc1-c52c-44fc-9512-6783e5c3f815 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.515297 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfdcc1-c52c-44fc-9512-6783e5c3f815 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.515579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfdcc1-c52c-44fc-9512-6783e5c3f815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.523063 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04357235-76fe-4323-8281-d550b6dc05e5 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:54.533918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-7fcfdcc1-c52c-44fc-9512-6783e5c3f815 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:54.535267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-7fcfdcc1-c52c-44fc-9512-6783e5c3f815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:54.556697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b26ea2-0326-44af-acdb-1088f1dcd255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:54.557962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b26ea2-0326-44af-acdb-1088f1dcd255 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.558240 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b26ea2-0326-44af-acdb-1088f1dcd255 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.558506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b26ea2-0326-44af-acdb-1088f1dcd255 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.569219 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b26ea2-0326-44af-acdb-1088f1dcd255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-68b26ea2-0326-44af-acdb-1088f1dcd255 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:54.574600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:54.575709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:54.576622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:54.576622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:54.576622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:54.576622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:54.576622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:54.576622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:54.576622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:54.576622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:54.576622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:54.576622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:54.576622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:31:54.576622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:54.576622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 543/1088] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Aug 29 22:31:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:54.581697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b26ea2-0326-44af-acdb-1088f1dcd255 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:54.607806 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 546/1089] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:31:54.672380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:54.681892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b26ea2-0326-44af-acdb-1088f1dcd255 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:54.718455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3a839-0918-4c68-972b-1c8de8ba89f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:54.719067 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a839-0918-4c68-972b-1c8de8ba89f4 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.719348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a839-0918-4c68-972b-1c8de8ba89f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.719625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a839-0918-4c68-972b-1c8de8ba89f4 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.720316 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3a839-0918-4c68-972b-1c8de8ba89f4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:54.720620 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3a839-0918-4c68-972b-1c8de8ba89f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:54.721968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3a839-0918-4c68-972b-1c8de8ba89f4 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:54.730830 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 544/1090] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Aug 29 22:31:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:54.736851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfdcc1-c52c-44fc-9512-6783e5c3f815 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:54.838473 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfdcc1-c52c-44fc-9512-6783e5c3f815 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:54.840226 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:54.875645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac9db7-aeec-4fc1-97dc-9debc521c9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:54.876311 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac9db7-aeec-4fc1-97dc-9debc521c9dc None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.876594 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac9db7-aeec-4fc1-97dc-9debc521c9dc None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.876918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac9db7-aeec-4fc1-97dc-9debc521c9dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.882310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3a839-0918-4c68-972b-1c8de8ba89f4 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:54.887324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac9db7-aeec-4fc1-97dc-9debc521c9dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:54.888818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac9db7-aeec-4fc1-97dc-9debc521c9dc None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-d7ac9db7-aeec-4fc1-97dc-9debc521c9dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:54.903798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:54.905766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:54.907253 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:54.907253 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:54.907253 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:54.907253 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 547/1091] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:54.910750 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac9db7-aeec-4fc1-97dc-9debc521c9dc None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:54.990018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3a839-0918-4c68-972b-1c8de8ba89f4 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.014994 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac9db7-aeec-4fc1-97dc-9debc521c9dc None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.024972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738a555-aa1c-411a-9147-4cfc000b7a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.025608 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738a555-aa1c-411a-9147-4cfc000b7a1f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.025911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738a555-aa1c-411a-9147-4cfc000b7a1f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.026684 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738a555-aa1c-411a-9147-4cfc000b7a1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.037621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738a555-aa1c-411a-9147-4cfc000b7a1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-c738a555-aa1c-411a-9147-4cfc000b7a1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:55.042960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:55.044169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:55.045277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:55.045277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:55.045277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:55.045277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:55.045277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:55.045277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:55.045277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:55.045277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:55.045277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:55.045277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:55.045277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:55.045277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:55.048397 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 545/1092] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:55.050174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738a555-aa1c-411a-9147-4cfc000b7a1f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.050584 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e02b5-350d-4b0a-b001-3eb250a189f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.051193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e02b5-350d-4b0a-b001-3eb250a189f6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.051474 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e02b5-350d-4b0a-b001-3eb250a189f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.051750 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e02b5-350d-4b0a-b001-3eb250a189f6 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.052432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e02b5-350d-4b0a-b001-3eb250a189f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:55.052740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e02b5-350d-4b0a-b001-3eb250a189f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.054121 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e02b5-350d-4b0a-b001-3eb250a189f6 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.066176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 548/1093] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:55.066777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.071854 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e02b5-350d-4b0a-b001-3eb250a189f6 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.087189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.157812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738a555-aa1c-411a-9147-4cfc000b7a1f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.173409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e02b5-350d-4b0a-b001-3eb250a189f6 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.192884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96b271-5bb7-4bb6-a784-fc998e6b6ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.193504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96b271-5bb7-4bb6-a784-fc998e6b6ab9 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.193787 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96b271-5bb7-4bb6-a784-fc998e6b6ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.194061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96b271-5bb7-4bb6-a784-fc998e6b6ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.194726 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96b271-5bb7-4bb6-a784-fc998e6b6ab9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:55.195028 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96b271-5bb7-4bb6-a784-fc998e6b6ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.196435 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96b271-5bb7-4bb6-a784-fc998e6b6ab9 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.205800 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 546/1094] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:55.211018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973570a-2a94-471b-a2d2-163597fc4bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.211517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96b271-5bb7-4bb6-a784-fc998e6b6ab9 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.211663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973570a-2a94-471b-a2d2-163597fc4bbd None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.211948 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973570a-2a94-471b-a2d2-163597fc4bbd None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.212269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973570a-2a94-471b-a2d2-163597fc4bbd None admin] PATH_INFO: `/v3/users/nova` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.220203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973570a-2a94-471b-a2d2-163597fc4bbd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.221649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973570a-2a94-471b-a2d2-163597fc4bbd None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-7973570a-2a94-471b-a2d2-163597fc4bbd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:31:55.234483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:55.235510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:55.236564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:55.236564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:55.236564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:31:55.236564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:31:55.236564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:31:55.236564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:31:55.236564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:31:55.236564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:31:55.236564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:31:55.236564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:55.236564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 549/1095] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:55.241659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973570a-2a94-471b-a2d2-163597fc4bbd None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.286338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.312005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96b271-5bb7-4bb6-a784-fc998e6b6ab9 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.319514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.343967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973570a-2a94-471b-a2d2-163597fc4bbd None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.347607 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baf694-6d7a-4035-a425-b013ee00dc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.348272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf694-6d7a-4035-a425-b013ee00dc5b None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.348555 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf694-6d7a-4035-a425-b013ee00dc5b None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.348832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf694-6d7a-4035-a425-b013ee00dc5b None admin] PATH_INFO: `/v3/users/1da17daf1c2a4a7ab58445338952bc3d` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.349991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baf694-6d7a-4035-a425-b013ee00dc5b None admin] RBAC: Authorizing `identity:get_user(user_id=1da17daf1c2a4a7ab58445338952bc3d)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.351413 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baf694-6d7a-4035-a425-b013ee00dc5b None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.353034 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 547/1096] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/users/1da17daf1c2a4a7ab58445338952bc3d => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:55.358885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baf694-6d7a-4035-a425-b013ee00dc5b None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.379153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7b4d6-9465-4c9c-9828-ee8f2d293c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.379766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b4d6-9465-4c9c-9828-ee8f2d293c75 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.380052 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b4d6-9465-4c9c-9828-ee8f2d293c75 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.380355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b4d6-9465-4c9c-9828-ee8f2d293c75 None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.381082 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7b4d6-9465-4c9c-9828-ee8f2d293c75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:55.381412 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7b4d6-9465-4c9c-9828-ee8f2d293c75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.382840 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7b4d6-9465-4c9c-9828-ee8f2d293c75 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.400691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 550/1097] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:55.406834 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7b4d6-9465-4c9c-9828-ee8f2d293c75 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.461547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baf694-6d7a-4035-a425-b013ee00dc5b None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.497412 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab7776-5ae0-463b-ac17-8d330d887fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.497950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab7776-5ae0-463b-ac17-8d330d887fac None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.498229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab7776-5ae0-463b-ac17-8d330d887fac None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.498502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab7776-5ae0-463b-ac17-8d330d887fac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.509563 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7b4d6-9465-4c9c-9828-ee8f2d293c75 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.510695 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.539054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.544549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4155fd-0090-414d-8a56-f01946e06135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.545191 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4155fd-0090-414d-8a56-f01946e06135 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.545476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4155fd-0090-414d-8a56-f01946e06135 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.545823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4155fd-0090-414d-8a56-f01946e06135 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.568283 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab7776-5ae0-463b-ac17-8d330d887fac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.569907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab7776-5ae0-463b-ac17-8d330d887fac None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.616081 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4155fd-0090-414d-8a56-f01946e06135 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.617564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4155fd-0090-414d-8a56-f01946e06135 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.672990 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 548/1098] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:31:55.679031 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab7776-5ae0-463b-ac17-8d330d887fac None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.719762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 551/1099] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:31:55.721761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.725779 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4155fd-0090-414d-8a56-f01946e06135 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.758492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.784355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab7776-5ae0-463b-ac17-8d330d887fac None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.823588 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40580b8-8fd2-4cca-84fc-6e802304f468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.824253 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40580b8-8fd2-4cca-84fc-6e802304f468 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.824540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40580b8-8fd2-4cca-84fc-6e802304f468 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.824810 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40580b8-8fd2-4cca-84fc-6e802304f468 None admin] PATH_INFO: `/v3/projects/52574ae3e0904812a92efd80ff527135` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.825928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40580b8-8fd2-4cca-84fc-6e802304f468 None admin] RBAC: Authorizing `identity:get_project(project_id=52574ae3e0904812a92efd80ff527135)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.827342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40580b8-8fd2-4cca-84fc-6e802304f468 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.828005 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4155fd-0090-414d-8a56-f01946e06135 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.829014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 549/1100] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/projects/52574ae3e0904812a92efd80ff527135 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:55.835170 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40580b8-8fd2-4cca-84fc-6e802304f468 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.864052 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efb575-c568-4432-863a-277708b07a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.864708 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efb575-c568-4432-863a-277708b07a72 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.864989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efb575-c568-4432-863a-277708b07a72 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.865269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efb575-c568-4432-863a-277708b07a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.875616 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efb575-c568-4432-863a-277708b07a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.877103 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efb575-c568-4432-863a-277708b07a72 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-32efb575-c568-4432-863a-277708b07a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:55.891494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:55.892602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:55.894184 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:55.894184 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:55.894184 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:31:55.894184 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 552/1101] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:55.898288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efb575-c568-4432-863a-277708b07a72 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.939259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40580b8-8fd2-4cca-84fc-6e802304f468 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.950583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.974104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e732304-4235-4aab-9f6b-0f2b3f7d624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.974693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e732304-4235-4aab-9f6b-0f2b3f7d624e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.974966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e732304-4235-4aab-9f6b-0f2b3f7d624e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.975244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e732304-4235-4aab-9f6b-0f2b3f7d624e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.975957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e732304-4235-4aab-9f6b-0f2b3f7d624e None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=52574ae3e0904812a92efd80ff527135, user.id=1da17daf1c2a4a7ab58445338952bc3d) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:55.976313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e732304-4235-4aab-9f6b-0f2b3f7d624e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.977723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e732304-4235-4aab-9f6b-0f2b3f7d624e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.984050 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.984245 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 550/1102] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/role_assignments?user.id=1da17daf1c2a4a7ab58445338952bc3d&scope.project.id=52574ae3e0904812a92efd80ff527135&role.id=a7d59d2982de4bfeb758dce70808029f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:56.015615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efb575-c568-4432-863a-277708b07a72 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:56.063650 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f481b1-cacc-4a5d-9d0c-c70797b9203b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:56.064333 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f481b1-cacc-4a5d-9d0c-c70797b9203b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:56.065740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f481b1-cacc-4a5d-9d0c-c70797b9203b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:56.066081 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f481b1-cacc-4a5d-9d0c-c70797b9203b None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:56.066793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f481b1-cacc-4a5d-9d0c-c70797b9203b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:56.067479 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f481b1-cacc-4a5d-9d0c-c70797b9203b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:56.068501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f481b1-cacc-4a5d-9d0c-c70797b9203b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:56.082446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 553/1103] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:56.088716 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e732304-4235-4aab-9f6b-0f2b3f7d624e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:56.198166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e732304-4235-4aab-9f6b-0f2b3f7d624e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:56.232421 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf0afd-da63-4d6a-b18b-f76aab095e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:56.233055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf0afd-da63-4d6a-b18b-f76aab095e52 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:56.233332 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf0afd-da63-4d6a-b18b-f76aab095e52 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:56.233604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf0afd-da63-4d6a-b18b-f76aab095e52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:56.240458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf0afd-da63-4d6a-b18b-f76aab095e52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:56.241931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf0afd-da63-4d6a-b18b-f76aab095e52 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:56.254344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-4ddf0afd-da63-4d6a-b18b-f76aab095e52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:56.254344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:56.254344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:56.254344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:56.254344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:56.254344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:56.254344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:56.254344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:56.254344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:56.254344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:56.254344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:56.254344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:56.254344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:31:56.254344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:31:56.254344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:56.255438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:56.256455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:31:56.256455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:31:56.256455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:31:56.256455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:31:56.256455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:31:56.256455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:31:56.256455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:31:56.256455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:31:56.256455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 551/1104] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:56.261497 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f481b1-cacc-4a5d-9d0c-c70797b9203b None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:56.360622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f481b1-cacc-4a5d-9d0c-c70797b9203b None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:56.394017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb706b-f994-4121-8438-41f06208c290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:56.394614 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb706b-f994-4121-8438-41f06208c290 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:56.394892 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb706b-f994-4121-8438-41f06208c290 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:56.395163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb706b-f994-4121-8438-41f06208c290 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:56.395851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb706b-f994-4121-8438-41f06208c290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:56.396187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb706b-f994-4121-8438-41f06208c290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:56.397606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb706b-f994-4121-8438-41f06208c290 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:56.408849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 554/1105] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:31:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:56.414923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf0afd-da63-4d6a-b18b-f76aab095e52 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:56.449305 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:56.513821 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf0afd-da63-4d6a-b18b-f76aab095e52 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:56.548682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070354f-b370-44dd-811d-e91fb6d3d071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:56.549539 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070354f-b370-44dd-811d-e91fb6d3d071 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:56.549812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070354f-b370-44dd-811d-e91fb6d3d071 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:56.550080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070354f-b370-44dd-811d-e91fb6d3d071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:56.550797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070354f-b370-44dd-811d-e91fb6d3d071 None admin] RBAC: Adding query filter params (role.id=4ae46f00844c4ee79187b2dbaaf21a43, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=f06d910badb84c6aa6b48f3b56b91f82) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:56.551134 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070354f-b370-44dd-811d-e91fb6d3d071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:56.552571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070354f-b370-44dd-811d-e91fb6d3d071 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:56.558340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 552/1106] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:56 2022] GET /identity/v3/role_assignments?user.id=f06d910badb84c6aa6b48f3b56b91f82&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=4ae46f00844c4ee79187b2dbaaf21a43 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:57.949691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349202ca-3cab-487c-b27e-9cffd694c3b0 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:57.950216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349202ca-3cab-487c-b27e-9cffd694c3b0 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:57.950216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349202ca-3cab-487c-b27e-9cffd694c3b0 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:57.951461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 555/1107] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:57.956726 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7cea6-9d71-467e-a962-42d51d9cd725 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:57.957117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7cea6-9d71-467e-a962-42d51d9cd725 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:57.957277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7cea6-9d71-467e-a962-42d51d9cd725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:57.976256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-11b7cea6-9d71-467e-a962-42d51d9cd725 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:57.977436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-11b7cea6-9d71-467e-a962-42d51d9cd725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:58.043926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 553/1108] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:31:58.311029 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349202ca-3cab-487c-b27e-9cffd694c3b0 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:58.314796 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:58.414053 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349202ca-3cab-487c-b27e-9cffd694c3b0 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:58.447314 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5dd52-37e0-41a7-9414-48f47ad15f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:58.448479 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5dd52-37e0-41a7-9414-48f47ad15f4c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:58.448750 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5dd52-37e0-41a7-9414-48f47ad15f4c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:58.449018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5dd52-37e0-41a7-9414-48f47ad15f4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:58.450119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5dd52-37e0-41a7-9414-48f47ad15f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:58.451564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5dd52-37e0-41a7-9414-48f47ad15f4c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:58.453117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 556/1109] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:58.458835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7cea6-9d71-467e-a962-42d51d9cd725 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:58.486615 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:58.596378 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7cea6-9d71-467e-a962-42d51d9cd725 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:58.629751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c033d4b-c63c-4427-8973-9c7d1f618274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:58.630355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c033d4b-c63c-4427-8973-9c7d1f618274 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:58.630631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c033d4b-c63c-4427-8973-9c7d1f618274 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:58.630900 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c033d4b-c63c-4427-8973-9c7d1f618274 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:58.631548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c033d4b-c63c-4427-8973-9c7d1f618274 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:58.632999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c033d4b-c63c-4427-8973-9c7d1f618274 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:58.735388 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 554/1110] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:31:58 2022] POST /identity/v3/users => generated 286 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:32:00.685397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349011b-e07d-402e-b1ab-cb386cd43076 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:00.685944 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349011b-e07d-402e-b1ab-cb386cd43076 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:00.685944 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349011b-e07d-402e-b1ab-cb386cd43076 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:00.687242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 557/1111] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:00.692616 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dd182-7301-478b-a8b4-90cf3285c5d6 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:00.693068 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dd182-7301-478b-a8b4-90cf3285c5d6 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:00.693171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dd182-7301-478b-a8b4-90cf3285c5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:00.711600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-5b9dd182-7301-478b-a8b4-90cf3285c5d6 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:00.712806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5b9dd182-7301-478b-a8b4-90cf3285c5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:00.779535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 555/1112] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:01.051010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349011b-e07d-402e-b1ab-cb386cd43076 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:01.120105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:01.149570 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349011b-e07d-402e-b1ab-cb386cd43076 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:01.185342 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb28a8-ae7e-48f3-9ac8-110525a2f665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:01.185969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb28a8-ae7e-48f3-9ac8-110525a2f665 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:01.186251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb28a8-ae7e-48f3-9ac8-110525a2f665 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:01.186525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb28a8-ae7e-48f3-9ac8-110525a2f665 None admin] PATH_INFO: `/v3/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:01.187917 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb28a8-ae7e-48f3-9ac8-110525a2f665 None admin] RBAC: Authorizing `identity:get_role(role_id=dcd0c9dbe86e4660b3d7ab1bce4762b1)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:01.189392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb28a8-ae7e-48f3-9ac8-110525a2f665 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:01.190722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 558/1113] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:01 2022] GET /identity/v3/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:01.196639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dd182-7301-478b-a8b4-90cf3285c5d6 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:01.211312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:01.295916 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dd182-7301-478b-a8b4-90cf3285c5d6 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:01.328969 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa57bd7-2388-432a-9934-aac2a19ad429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:01.329595 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa57bd7-2388-432a-9934-aac2a19ad429 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:01.329876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa57bd7-2388-432a-9934-aac2a19ad429 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:01.330150 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa57bd7-2388-432a-9934-aac2a19ad429 None admin] PATH_INFO: `/v3/users/4b8f2abbbdcb4116b003db4788c7de1c` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:01.343423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa57bd7-2388-432a-9934-aac2a19ad429 None admin] RBAC: Authorizing `identity:get_user(user_id=4b8f2abbbdcb4116b003db4788c7de1c)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:01.344921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa57bd7-2388-432a-9934-aac2a19ad429 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:01.346485 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 556/1114] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:01 2022] GET /identity/v3/users/4b8f2abbbdcb4116b003db4788c7de1c => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:01.352305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb28a8-ae7e-48f3-9ac8-110525a2f665 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:01.453581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb28a8-ae7e-48f3-9ac8-110525a2f665 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:01.487568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d467acf-8c0f-4b33-889c-d6f83fb548d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:01.488236 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d467acf-8c0f-4b33-889c-d6f83fb548d1 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:01.488515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d467acf-8c0f-4b33-889c-d6f83fb548d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:01.488785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d467acf-8c0f-4b33-889c-d6f83fb548d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:01.499681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:01.556104 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d467acf-8c0f-4b33-889c-d6f83fb548d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:01.558286 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d467acf-8c0f-4b33-889c-d6f83fb548d1 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:01.654754 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 559/1115] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:32:01.660685 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa57bd7-2388-432a-9934-aac2a19ad429 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:01.730797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:01.758993 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa57bd7-2388-432a-9934-aac2a19ad429 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:01.794581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44882e54-039f-41c9-9213-37744d0faaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:01.795206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44882e54-039f-41c9-9213-37744d0faaa2 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:01.795482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44882e54-039f-41c9-9213-37744d0faaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:01.795750 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44882e54-039f-41c9-9213-37744d0faaa2 None admin] PATH_INFO: `/v3/projects/52574ae3e0904812a92efd80ff527135` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:01.796904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44882e54-039f-41c9-9213-37744d0faaa2 None admin] RBAC: Authorizing `identity:get_project(project_id=52574ae3e0904812a92efd80ff527135)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:01.798321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44882e54-039f-41c9-9213-37744d0faaa2 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:01.800243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 557/1116] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:01 2022] GET /identity/v3/projects/52574ae3e0904812a92efd80ff527135 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:01.806467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d467acf-8c0f-4b33-889c-d6f83fb548d1 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:01.849084 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:01.906230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d467acf-8c0f-4b33-889c-d6f83fb548d1 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:01.940808 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1871221-58dd-4dc8-94c3-be0743213675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:01.941406 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1871221-58dd-4dc8-94c3-be0743213675 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:01.941685 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1871221-58dd-4dc8-94c3-be0743213675 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:01.941958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1871221-58dd-4dc8-94c3-be0743213675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:01.942669 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1871221-58dd-4dc8-94c3-be0743213675 None admin] RBAC: Adding query filter params (role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1, scope.project.id=52574ae3e0904812a92efd80ff527135, user.id=4b8f2abbbdcb4116b003db4788c7de1c) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:01.942976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1871221-58dd-4dc8-94c3-be0743213675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:01.944437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1871221-58dd-4dc8-94c3-be0743213675 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:01.949752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 560/1117] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:01 2022] GET /identity/v3/role_assignments?user.id=4b8f2abbbdcb4116b003db4788c7de1c&scope.project.id=52574ae3e0904812a92efd80ff527135&role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:03.854478 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b152e9-5be6-4578-94db-d37e04936000 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:03.855004 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b152e9-5be6-4578-94db-d37e04936000 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:03.855004 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b152e9-5be6-4578-94db-d37e04936000 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:03.856286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 558/1118] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:03.861550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110ab5b-9f8f-4d98-9790-19a872ce6f09 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:03.862277 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110ab5b-9f8f-4d98-9790-19a872ce6f09 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:03.862555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110ab5b-9f8f-4d98-9790-19a872ce6f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:03.881270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-4110ab5b-9f8f-4d98-9790-19a872ce6f09 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:03.882457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4110ab5b-9f8f-4d98-9790-19a872ce6f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:03.949572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 561/1119] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:04.218664 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b152e9-5be6-4578-94db-d37e04936000 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:04.316637 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b152e9-5be6-4578-94db-d37e04936000 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:04.349301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d5439-729c-47da-ab15-b8eeb7ded529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:04.349915 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d5439-729c-47da-ab15-b8eeb7ded529 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:04.350194 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d5439-729c-47da-ab15-b8eeb7ded529 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:04.350465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d5439-729c-47da-ab15-b8eeb7ded529 None admin] PATH_INFO: `/v3/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:04.351835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d5439-729c-47da-ab15-b8eeb7ded529 None admin] RBAC: Authorizing `identity:get_role(role_id=dcd0c9dbe86e4660b3d7ab1bce4762b1)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:04.353230 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d5439-729c-47da-ab15-b8eeb7ded529 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:04.355084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 559/1120] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:04 2022] GET /identity/v3/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:04.361000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110ab5b-9f8f-4d98-9790-19a872ce6f09 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:04.393657 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:04.458416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110ab5b-9f8f-4d98-9790-19a872ce6f09 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:04.491541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134023c-e9ee-41f4-85fa-9f5c41d9755d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:04.492114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134023c-e9ee-41f4-85fa-9f5c41d9755d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:04.492396 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134023c-e9ee-41f4-85fa-9f5c41d9755d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:04.492668 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134023c-e9ee-41f4-85fa-9f5c41d9755d None admin] PATH_INFO: `/v3/users/4b8f2abbbdcb4116b003db4788c7de1c` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:04.493773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134023c-e9ee-41f4-85fa-9f5c41d9755d None admin] RBAC: Authorizing `identity:get_user(user_id=4b8f2abbbdcb4116b003db4788c7de1c)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:04.495222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134023c-e9ee-41f4-85fa-9f5c41d9755d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:04.496823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 562/1121] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:04 2022] GET /identity/v3/users/4b8f2abbbdcb4116b003db4788c7de1c => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:04.502744 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d5439-729c-47da-ab15-b8eeb7ded529 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:04.514101 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:04.603099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d5439-729c-47da-ab15-b8eeb7ded529 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:04.637515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2173a-c67f-45c3-9944-4f270dc6d831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:04.638145 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2173a-c67f-45c3-9944-4f270dc6d831 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:04.638428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2173a-c67f-45c3-9944-4f270dc6d831 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:04.638704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2173a-c67f-45c3-9944-4f270dc6d831 None admin] PATH_INFO: `/v3/projects/52574ae3e0904812a92efd80ff527135` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:04.639816 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2173a-c67f-45c3-9944-4f270dc6d831 None admin] RBAC: Authorizing `identity:get_project(project_id=52574ae3e0904812a92efd80ff527135)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:04.641266 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2173a-c67f-45c3-9944-4f270dc6d831 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:04.642926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 560/1122] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:04 2022] GET /identity/v3/projects/52574ae3e0904812a92efd80ff527135 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:04.648954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134023c-e9ee-41f4-85fa-9f5c41d9755d None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:04.746997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134023c-e9ee-41f4-85fa-9f5c41d9755d None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:04.748512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:04.781793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc27d9-af92-4908-883d-116ac0bca02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:04.782448 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc27d9-af92-4908-883d-116ac0bca02a None admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:04.782724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc27d9-af92-4908-883d-116ac0bca02a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:04.782993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc27d9-af92-4908-883d-116ac0bca02a None admin] PATH_INFO: `/v3/projects/52574ae3e0904812a92efd80ff527135/users/4b8f2abbbdcb4116b003db4788c7de1c/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:04.785304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc27d9-af92-4908-883d-116ac0bca02a None admin] RBAC: Authorizing `identity:create_grant(project_id=52574ae3e0904812a92efd80ff527135, user_id=4b8f2abbbdcb4116b003db4788c7de1c, role_id=dcd0c9dbe86e4660b3d7ab1bce4762b1)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:04.786801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc27d9-af92-4908-883d-116ac0bca02a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:04.848692 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 563/1123] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:32:04 2022] PUT /identity/v3/projects/52574ae3e0904812a92efd80ff527135/users/4b8f2abbbdcb4116b003db4788c7de1c/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:06.754704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed36925-912b-44a6-94c3-30089b31a65e None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:06.755271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed36925-912b-44a6-94c3-30089b31a65e None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:06.755271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed36925-912b-44a6-94c3-30089b31a65e None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:06.756618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 561/1124] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:06.761954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4832e0-e2c4-4454-b7c0-ac5d597da92d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:06.762382 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4832e0-e2c4-4454-b7c0-ac5d597da92d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:06.762493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4832e0-e2c4-4454-b7c0-ac5d597da92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:06.781099 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-0a4832e0-e2c4-4454-b7c0-ac5d597da92d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:06.782313 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0a4832e0-e2c4-4454-b7c0-ac5d597da92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:06.848436 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 564/1125] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:07.122578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed36925-912b-44a6-94c3-30089b31a65e None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:07.200017 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:07.223302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed36925-912b-44a6-94c3-30089b31a65e None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:07.259104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295e2b3-2f0c-466a-863f-2b22b0ce9e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:07.259731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295e2b3-2f0c-466a-863f-2b22b0ce9e05 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:07.260035 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295e2b3-2f0c-466a-863f-2b22b0ce9e05 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:07.260344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295e2b3-2f0c-466a-863f-2b22b0ce9e05 None admin] PATH_INFO: `/v3/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:07.261725 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295e2b3-2f0c-466a-863f-2b22b0ce9e05 None admin] RBAC: Authorizing `identity:get_role(role_id=dcd0c9dbe86e4660b3d7ab1bce4762b1)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:07.263129 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295e2b3-2f0c-466a-863f-2b22b0ce9e05 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:07.264490 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 562/1126] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:07 2022] GET /identity/v3/roles/dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:07.270452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4832e0-e2c4-4454-b7c0-ac5d597da92d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:07.365003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:07.375967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4832e0-e2c4-4454-b7c0-ac5d597da92d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:07.407980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd767b0-163c-4039-ac3b-9f07e7e177fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:07.408627 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd767b0-163c-4039-ac3b-9f07e7e177fd None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:07.408900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd767b0-163c-4039-ac3b-9f07e7e177fd None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:07.409173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd767b0-163c-4039-ac3b-9f07e7e177fd None admin] PATH_INFO: `/v3/users/4b8f2abbbdcb4116b003db4788c7de1c` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:07.410287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd767b0-163c-4039-ac3b-9f07e7e177fd None admin] RBAC: Authorizing `identity:get_user(user_id=4b8f2abbbdcb4116b003db4788c7de1c)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:07.411740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd767b0-163c-4039-ac3b-9f07e7e177fd None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:07.413341 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 565/1127] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:07 2022] GET /identity/v3/users/4b8f2abbbdcb4116b003db4788c7de1c => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:07.419239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295e2b3-2f0c-466a-863f-2b22b0ce9e05 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:07.518092 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295e2b3-2f0c-466a-863f-2b22b0ce9e05 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:07.552989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfe443-0f07-406a-a91b-39884814f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:07.553595 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfe443-0f07-406a-a91b-39884814f138 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:07.553874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfe443-0f07-406a-a91b-39884814f138 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:07.554151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfe443-0f07-406a-a91b-39884814f138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:07.568610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:07.622676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfe443-0f07-406a-a91b-39884814f138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:07.624159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfe443-0f07-406a-a91b-39884814f138 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:07.723569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 563/1128] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:32:07.729529 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd767b0-163c-4039-ac3b-9f07e7e177fd None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:07.830892 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd767b0-163c-4039-ac3b-9f07e7e177fd None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:07.864134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf9791-94a2-48dc-91e1-718c3f058a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:07.864761 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf9791-94a2-48dc-91e1-718c3f058a94 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:07.865044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf9791-94a2-48dc-91e1-718c3f058a94 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:07.865320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf9791-94a2-48dc-91e1-718c3f058a94 None admin] PATH_INFO: `/v3/projects/52574ae3e0904812a92efd80ff527135` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:07.866431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf9791-94a2-48dc-91e1-718c3f058a94 None admin] RBAC: Authorizing `identity:get_project(project_id=52574ae3e0904812a92efd80ff527135)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:07.867870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf9791-94a2-48dc-91e1-718c3f058a94 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:07.870085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 566/1129] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:07 2022] GET /identity/v3/projects/52574ae3e0904812a92efd80ff527135 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:07.876666 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfe443-0f07-406a-a91b-39884814f138 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:07.921106 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:07.974191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfe443-0f07-406a-a91b-39884814f138 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:08.007193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e89a8f-9505-4448-a739-d8ccdb48075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:08.007787 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e89a8f-9505-4448-a739-d8ccdb48075f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:08.008064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e89a8f-9505-4448-a739-d8ccdb48075f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:08.008439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e89a8f-9505-4448-a739-d8ccdb48075f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:08.009056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e89a8f-9505-4448-a739-d8ccdb48075f None admin] RBAC: Adding query filter params (role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1, scope.project.id=52574ae3e0904812a92efd80ff527135, user.id=4b8f2abbbdcb4116b003db4788c7de1c) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:08.009356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e89a8f-9505-4448-a739-d8ccdb48075f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:08.011363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e89a8f-9505-4448-a739-d8ccdb48075f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:08.017309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 564/1130] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:07 2022] GET /identity/v3/role_assignments?user.id=4b8f2abbbdcb4116b003db4788c7de1c&scope.project.id=52574ae3e0904812a92efd80ff527135&role.id=dcd0c9dbe86e4660b3d7ab1bce4762b1 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:09.932801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8d47c-8a2d-48ae-8556-12e07757cbdd None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:09.933375 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8d47c-8a2d-48ae-8556-12e07757cbdd None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:09.933375 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8d47c-8a2d-48ae-8556-12e07757cbdd None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:09.934591 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 567/1131] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:09.940228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e8187-741a-4f09-a4d0-fee904262e23 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:09.940674 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e8187-741a-4f09-a4d0-fee904262e23 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:09.940800 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e8187-741a-4f09-a4d0-fee904262e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:09.959379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-dc8e8187-741a-4f09-a4d0-fee904262e23 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:09.960583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-dc8e8187-741a-4f09-a4d0-fee904262e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:10.026611 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 565/1132] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:10.297211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8d47c-8a2d-48ae-8556-12e07757cbdd None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:10.326059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:10.397707 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8d47c-8a2d-48ae-8556-12e07757cbdd None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:10.430724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ea2a0-14ec-4fe9-8025-74012adb94e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:10.431335 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ea2a0-14ec-4fe9-8025-74012adb94e3 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:10.432243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ea2a0-14ec-4fe9-8025-74012adb94e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:10.432514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ea2a0-14ec-4fe9-8025-74012adb94e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:10.433615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ea2a0-14ec-4fe9-8025-74012adb94e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:10.435038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ea2a0-14ec-4fe9-8025-74012adb94e3 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:10.436612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 568/1133] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:10.442443 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e8187-741a-4f09-a4d0-fee904262e23 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:10.480754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:10.537278 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e8187-741a-4f09-a4d0-fee904262e23 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:10.570721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c6085-2d9d-4d15-854a-0cafba69afb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:10.571322 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6085-2d9d-4d15-854a-0cafba69afb5 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:10.571601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6085-2d9d-4d15-854a-0cafba69afb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:10.571878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6085-2d9d-4d15-854a-0cafba69afb5 None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:10.572571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c6085-2d9d-4d15-854a-0cafba69afb5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:10.573974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c6085-2d9d-4d15-854a-0cafba69afb5 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:10.668221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 566/1134] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 29 22:32:10 2022] POST /identity/v3/projects => generated 311 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:32:12.616455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99396985-bda9-4670-9551-db60328df88a None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:12.616976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99396985-bda9-4670-9551-db60328df88a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:12.617087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99396985-bda9-4670-9551-db60328df88a None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:12.618320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 569/1135] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:12.624214 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b86efb-1ea7-41a4-9354-84e7c28b5ac7 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:12.624703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b86efb-1ea7-41a4-9354-84e7c28b5ac7 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:12.624794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b86efb-1ea7-41a4-9354-84e7c28b5ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:12.642873 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-04b86efb-1ea7-41a4-9354-84e7c28b5ac7 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:12.644048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-04b86efb-1ea7-41a4-9354-84e7c28b5ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:12.709347 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 567/1136] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:12.978449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99396985-bda9-4670-9551-db60328df88a None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:13.072367 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:13.079435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99396985-bda9-4670-9551-db60328df88a None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:13.113284 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dc74a-06df-4b4f-8ec6-e32fc1357308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:13.113899 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dc74a-06df-4b4f-8ec6-e32fc1357308 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:13.114179 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dc74a-06df-4b4f-8ec6-e32fc1357308 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:13.114452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dc74a-06df-4b4f-8ec6-e32fc1357308 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:13.115549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dc74a-06df-4b4f-8ec6-e32fc1357308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:13.117110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dc74a-06df-4b4f-8ec6-e32fc1357308 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:13.118664 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 570/1137] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:13.124493 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b86efb-1ea7-41a4-9354-84e7c28b5ac7 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:13.146133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:13.222530 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b86efb-1ea7-41a4-9354-84e7c28b5ac7 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:13.255501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e3ceb-bcb3-4241-9180-b836708cd45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:13.256021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e3ceb-bcb3-4241-9180-b836708cd45f None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:13.256327 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e3ceb-bcb3-4241-9180-b836708cd45f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:13.256599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e3ceb-bcb3-4241-9180-b836708cd45f None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:13.257247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e3ceb-bcb3-4241-9180-b836708cd45f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:13.258654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e3ceb-bcb3-4241-9180-b836708cd45f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:13.329627 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 568/1138] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:32:13 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:32:15.338449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a2a7e-b6ed-46a8-8405-0dbee8f47637 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:15.339033 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a2a7e-b6ed-46a8-8405-0dbee8f47637 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:15.339033 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a2a7e-b6ed-46a8-8405-0dbee8f47637 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:15.340853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 571/1139] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:32:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:15.346191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8a62a-af79-4054-9cf4-baacc2a250fe None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:15.346643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8a62a-af79-4054-9cf4-baacc2a250fe None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:15.346737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8a62a-af79-4054-9cf4-baacc2a250fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:15.365727 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-06e8a62a-af79-4054-9cf4-baacc2a250fe None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:15.366918 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-06e8a62a-af79-4054-9cf4-baacc2a250fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:15.434065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 569/1140] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:15.707661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a2a7e-b6ed-46a8-8405-0dbee8f47637 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:15.806531 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a2a7e-b6ed-46a8-8405-0dbee8f47637 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:15.840761 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08166bf-b9ba-4808-b33c-4418d23385ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:15.841377 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08166bf-b9ba-4808-b33c-4418d23385ea None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:15.841656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08166bf-b9ba-4808-b33c-4418d23385ea None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:15.841926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08166bf-b9ba-4808-b33c-4418d23385ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:15.851581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08166bf-b9ba-4808-b33c-4418d23385ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-c08166bf-b9ba-4808-b33c-4418d23385ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:15.856310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:15.860149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:15.861072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:15.861072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:15.861072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:15.861072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:15.861072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:15.861072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:15.861072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:15.861072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:15.861072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:15.861072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:15.861072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:15.861072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:32:15.861072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 572/1141] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:15.863450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8a62a-af79-4054-9cf4-baacc2a250fe None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:15.872028 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:15.962213 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8a62a-af79-4054-9cf4-baacc2a250fe None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:15.995962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f9e6e-8fc2-41e3-afda-b4ba007ad5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:15.996602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f9e6e-8fc2-41e3-afda-b4ba007ad5a0 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:15.996880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f9e6e-8fc2-41e3-afda-b4ba007ad5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:15.997151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f9e6e-8fc2-41e3-afda-b4ba007ad5a0 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:15.997815 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f9e6e-8fc2-41e3-afda-b4ba007ad5a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:15.998114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f9e6e-8fc2-41e3-afda-b4ba007ad5a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:15.999483 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f9e6e-8fc2-41e3-afda-b4ba007ad5a0 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:16.007356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 570/1142] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:16.013248 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08166bf-b9ba-4808-b33c-4418d23385ea None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:16.040264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:16.115376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08166bf-b9ba-4808-b33c-4418d23385ea None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:16.149652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dda2f0-44c0-4bf3-a2dc-26114ecc14eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:16.150274 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dda2f0-44c0-4bf3-a2dc-26114ecc14eb None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:16.150556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dda2f0-44c0-4bf3-a2dc-26114ecc14eb None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:16.150833 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dda2f0-44c0-4bf3-a2dc-26114ecc14eb None admin] PATH_INFO: `/v3/users/8dbc0a6d0fb547529ed7b62e429f09ee` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:16.163925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dda2f0-44c0-4bf3-a2dc-26114ecc14eb None admin] RBAC: Authorizing `identity:get_user(user_id=8dbc0a6d0fb547529ed7b62e429f09ee)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:16.165404 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dda2f0-44c0-4bf3-a2dc-26114ecc14eb None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:16.167504 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 573/1143] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:16 2022] GET /identity/v3/users/8dbc0a6d0fb547529ed7b62e429f09ee => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:16.173481 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f9e6e-8fc2-41e3-afda-b4ba007ad5a0 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:16.239036 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:16.271888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f9e6e-8fc2-41e3-afda-b4ba007ad5a0 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:16.306466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea76a9-4f54-44a8-8688-6314d432d1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:16.307073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea76a9-4f54-44a8-8688-6314d432d1d6 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:16.307352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea76a9-4f54-44a8-8688-6314d432d1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:16.307629 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea76a9-4f54-44a8-8688-6314d432d1d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:16.372429 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea76a9-4f54-44a8-8688-6314d432d1d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:16.373858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea76a9-4f54-44a8-8688-6314d432d1d6 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:16.435357 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:16.468197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 571/1144] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:32:16.473895 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dda2f0-44c0-4bf3-a2dc-26114ecc14eb None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:16.553158 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:16.570881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dda2f0-44c0-4bf3-a2dc-26114ecc14eb None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:16.605537 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb5e37-089b-4bc2-9767-352b45fe8272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:16.606166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb5e37-089b-4bc2-9767-352b45fe8272 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:16.606442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb5e37-089b-4bc2-9767-352b45fe8272 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:16.606712 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb5e37-089b-4bc2-9767-352b45fe8272 None admin] PATH_INFO: `/v3/projects/b64b44080eb54e93baf9e68b2a21c718` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:16.607830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb5e37-089b-4bc2-9767-352b45fe8272 None admin] RBAC: Authorizing `identity:get_project(project_id=b64b44080eb54e93baf9e68b2a21c718)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:16.609444 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb5e37-089b-4bc2-9767-352b45fe8272 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:16.611078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 574/1145] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:16 2022] GET /identity/v3/projects/b64b44080eb54e93baf9e68b2a21c718 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:16.617234 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea76a9-4f54-44a8-8688-6314d432d1d6 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:16.714767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea76a9-4f54-44a8-8688-6314d432d1d6 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:16.747681 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8dd91-2e66-4083-b891-bcfd271a267a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:16.748299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8dd91-2e66-4083-b891-bcfd271a267a None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:16.748581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8dd91-2e66-4083-b891-bcfd271a267a None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:16.748855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8dd91-2e66-4083-b891-bcfd271a267a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:16.749569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8dd91-2e66-4083-b891-bcfd271a267a None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=b64b44080eb54e93baf9e68b2a21c718, user.id=8dbc0a6d0fb547529ed7b62e429f09ee) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:16.749877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8dd91-2e66-4083-b891-bcfd271a267a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:16.751279 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8dd91-2e66-4083-b891-bcfd271a267a None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:16.756538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 572/1146] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:16 2022] GET /identity/v3/role_assignments?user.id=8dbc0a6d0fb547529ed7b62e429f09ee&scope.project.id=b64b44080eb54e93baf9e68b2a21c718&role.id=a7d59d2982de4bfeb758dce70808029f => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:18.730766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598775a3-50d2-41b7-a8c3-d826af71b713 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:18.731520 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598775a3-50d2-41b7-a8c3-d826af71b713 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:18.731520 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598775a3-50d2-41b7-a8c3-d826af71b713 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:18.732681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 575/1147] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:18.737910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2cd13-bba7-4460-84eb-affc6e3e6867 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:18.738304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2cd13-bba7-4460-84eb-affc6e3e6867 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:18.738461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2cd13-bba7-4460-84eb-affc6e3e6867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:18.756529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d4d2cd13-bba7-4460-84eb-affc6e3e6867 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:18.757713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d4d2cd13-bba7-4460-84eb-affc6e3e6867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:18.784556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:18.827943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 573/1148] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:19.099085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598775a3-50d2-41b7-a8c3-d826af71b713 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:19.200583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598775a3-50d2-41b7-a8c3-d826af71b713 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:19.234474 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee455bf-6fdd-467d-837d-33f4d6a78c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:19.235094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee455bf-6fdd-467d-837d-33f4d6a78c6d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:19.235376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee455bf-6fdd-467d-837d-33f4d6a78c6d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:19.235653 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee455bf-6fdd-467d-837d-33f4d6a78c6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:19.246133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee455bf-6fdd-467d-837d-33f4d6a78c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-2ee455bf-6fdd-467d-837d-33f4d6a78c6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:19.250888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:19.251981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:19.252888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:19.252888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:19.252888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:19.252888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:19.252888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:19.252888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:19.252888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:19.252888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:19.252888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:19.252888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:19.252888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:19.252888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:32:19.252888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 576/1149] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:19.258084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2cd13-bba7-4460-84eb-affc6e3e6867 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:19.355712 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2cd13-bba7-4460-84eb-affc6e3e6867 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:19.389900 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67144cc5-bc9e-40ae-9a36-747a4d4b41fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:19.390463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67144cc5-bc9e-40ae-9a36-747a4d4b41fc None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:19.390744 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67144cc5-bc9e-40ae-9a36-747a4d4b41fc None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:19.391014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67144cc5-bc9e-40ae-9a36-747a4d4b41fc None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:19.391673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67144cc5-bc9e-40ae-9a36-747a4d4b41fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:19.391976 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67144cc5-bc9e-40ae-9a36-747a4d4b41fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:19.393404 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67144cc5-bc9e-40ae-9a36-747a4d4b41fc None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:19.401887 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 574/1150] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:19.407924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee455bf-6fdd-467d-837d-33f4d6a78c6d None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:19.422110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:19.507955 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee455bf-6fdd-467d-837d-33f4d6a78c6d None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:19.541450 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fd60f-4e84-4191-94ac-829bf59aaa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:19.542683 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fd60f-4e84-4191-94ac-829bf59aaa7c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:19.542964 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fd60f-4e84-4191-94ac-829bf59aaa7c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:19.543239 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fd60f-4e84-4191-94ac-829bf59aaa7c None admin] PATH_INFO: `/v3/users/8dbc0a6d0fb547529ed7b62e429f09ee` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:19.544385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fd60f-4e84-4191-94ac-829bf59aaa7c None admin] RBAC: Authorizing `identity:get_user(user_id=8dbc0a6d0fb547529ed7b62e429f09ee)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:19.545810 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fd60f-4e84-4191-94ac-829bf59aaa7c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:19.547381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 577/1151] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:19 2022] GET /identity/v3/users/8dbc0a6d0fb547529ed7b62e429f09ee => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:19.553507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67144cc5-bc9e-40ae-9a36-747a4d4b41fc None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:19.578494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:19.653896 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67144cc5-bc9e-40ae-9a36-747a4d4b41fc None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:19.686462 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb62e4e-cec1-486a-bcc9-d92c1f03bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:19.687083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb62e4e-cec1-486a-bcc9-d92c1f03bea9 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:19.687364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb62e4e-cec1-486a-bcc9-d92c1f03bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:19.687640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb62e4e-cec1-486a-bcc9-d92c1f03bea9 None admin] PATH_INFO: `/v3/projects/b64b44080eb54e93baf9e68b2a21c718` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:19.688782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb62e4e-cec1-486a-bcc9-d92c1f03bea9 None admin] RBAC: Authorizing `identity:get_project(project_id=b64b44080eb54e93baf9e68b2a21c718)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:19.690200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb62e4e-cec1-486a-bcc9-d92c1f03bea9 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:19.691825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 575/1152] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:19 2022] GET /identity/v3/projects/b64b44080eb54e93baf9e68b2a21c718 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:19.697803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fd60f-4e84-4191-94ac-829bf59aaa7c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:19.782367 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:19.803773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fd60f-4e84-4191-94ac-829bf59aaa7c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:19.840141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd4e50-c922-4e4d-8566-8821d7329200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:19.840818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd4e50-c922-4e4d-8566-8821d7329200 None admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:19.841091 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd4e50-c922-4e4d-8566-8821d7329200 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:19.841365 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd4e50-c922-4e4d-8566-8821d7329200 None admin] PATH_INFO: `/v3/projects/b64b44080eb54e93baf9e68b2a21c718/users/8dbc0a6d0fb547529ed7b62e429f09ee/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:19.843244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd4e50-c922-4e4d-8566-8821d7329200 None admin] RBAC: Authorizing `identity:create_grant(project_id=b64b44080eb54e93baf9e68b2a21c718, user_id=8dbc0a6d0fb547529ed7b62e429f09ee, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:19.844684 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd4e50-c922-4e4d-8566-8821d7329200 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:19.924742 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 578/1153] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:32:19 2022] PUT /identity/v3/projects/b64b44080eb54e93baf9e68b2a21c718/users/8dbc0a6d0fb547529ed7b62e429f09ee/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:21.815447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5072a-39d8-45ea-82a0-25c108c7ca3c None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:21.815992 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5072a-39d8-45ea-82a0-25c108c7ca3c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:21.815992 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5072a-39d8-45ea-82a0-25c108c7ca3c None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:21.817348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 576/1154] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:21.822546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80857d92-e3a0-4081-a239-5d6a53bd1c8a None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:21.822984 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80857d92-e3a0-4081-a239-5d6a53bd1c8a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:21.823080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80857d92-e3a0-4081-a239-5d6a53bd1c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:21.841258 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-80857d92-e3a0-4081-a239-5d6a53bd1c8a None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:21.842355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-80857d92-e3a0-4081-a239-5d6a53bd1c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:21.908997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 579/1155] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:22.172293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5072a-39d8-45ea-82a0-25c108c7ca3c None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:22.262414 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:22.272127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5072a-39d8-45ea-82a0-25c108c7ca3c None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:22.305252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f815b2-63b3-4897-904b-18337ddf8351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:22.305875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f815b2-63b3-4897-904b-18337ddf8351 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:22.306155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f815b2-63b3-4897-904b-18337ddf8351 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:22.306428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f815b2-63b3-4897-904b-18337ddf8351 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:22.316754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f815b2-63b3-4897-904b-18337ddf8351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-17f815b2-63b3-4897-904b-18337ddf8351 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:22.321552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:22.322655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:22.324239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:22.324239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:22.324239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:22.324239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:22.324239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:22.324239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:22.324239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:22.324239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:22.324239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:22.324239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:22.324239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:22.324239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:32:22.324239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 577/1156] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:22.329194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80857d92-e3a0-4081-a239-5d6a53bd1c8a None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:22.394208 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:22.425844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80857d92-e3a0-4081-a239-5d6a53bd1c8a None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:22.459607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0b588-83ce-4925-ad0a-052849053ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:22.460238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0b588-83ce-4925-ad0a-052849053ce5 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:22.460521 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0b588-83ce-4925-ad0a-052849053ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:22.460795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0b588-83ce-4925-ad0a-052849053ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:22.461459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0b588-83ce-4925-ad0a-052849053ce5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:22.461762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0b588-83ce-4925-ad0a-052849053ce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:22.463124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0b588-83ce-4925-ad0a-052849053ce5 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:22.471975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 580/1157] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:22.477802 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f815b2-63b3-4897-904b-18337ddf8351 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:22.575910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f815b2-63b3-4897-904b-18337ddf8351 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:22.609885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714d63-fa46-4765-9ad6-8c52cb01785e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:22.610500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714d63-fa46-4765-9ad6-8c52cb01785e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:22.610781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714d63-fa46-4765-9ad6-8c52cb01785e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:22.611055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714d63-fa46-4765-9ad6-8c52cb01785e None admin] PATH_INFO: `/v3/users/8dbc0a6d0fb547529ed7b62e429f09ee` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:22.612342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c714d63-fa46-4765-9ad6-8c52cb01785e None admin] RBAC: Authorizing `identity:get_user(user_id=8dbc0a6d0fb547529ed7b62e429f09ee)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:22.613756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c714d63-fa46-4765-9ad6-8c52cb01785e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:22.615336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 578/1158] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:22 2022] GET /identity/v3/users/8dbc0a6d0fb547529ed7b62e429f09ee => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:22.621769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0b588-83ce-4925-ad0a-052849053ce5 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:22.717774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0b588-83ce-4925-ad0a-052849053ce5 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:22.744620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:22.750500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3af831-d7d0-48ab-8292-9d359c161f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:22.752257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3af831-d7d0-48ab-8292-9d359c161f71 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:22.752555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3af831-d7d0-48ab-8292-9d359c161f71 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:22.752832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3af831-d7d0-48ab-8292-9d359c161f71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:22.821236 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3af831-d7d0-48ab-8292-9d359c161f71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:22.822673 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3af831-d7d0-48ab-8292-9d359c161f71 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:22.919688 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 581/1159] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:32:22.925986 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714d63-fa46-4765-9ad6-8c52cb01785e None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:22.948099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:23.024016 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714d63-fa46-4765-9ad6-8c52cb01785e None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:23.061576 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a697e0e-c894-49da-8f03-f09e955a3ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:23.062192 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a697e0e-c894-49da-8f03-f09e955a3ef5 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:23.062469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a697e0e-c894-49da-8f03-f09e955a3ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:23.062740 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a697e0e-c894-49da-8f03-f09e955a3ef5 None admin] PATH_INFO: `/v3/projects/b64b44080eb54e93baf9e68b2a21c718` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:23.063824 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a697e0e-c894-49da-8f03-f09e955a3ef5 None admin] RBAC: Authorizing `identity:get_project(project_id=b64b44080eb54e93baf9e68b2a21c718)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:23.065265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a697e0e-c894-49da-8f03-f09e955a3ef5 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:23.066874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 579/1160] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:22 2022] GET /identity/v3/projects/b64b44080eb54e93baf9e68b2a21c718 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:23.073108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3af831-d7d0-48ab-8292-9d359c161f71 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:23.101583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:23.171575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3af831-d7d0-48ab-8292-9d359c161f71 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:23.204357 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c12fa9-fcd1-4f65-99a7-f05f937f21c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:23.204946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c12fa9-fcd1-4f65-99a7-f05f937f21c2 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:23.205222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c12fa9-fcd1-4f65-99a7-f05f937f21c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:23.205490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c12fa9-fcd1-4f65-99a7-f05f937f21c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:23.206199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c12fa9-fcd1-4f65-99a7-f05f937f21c2 None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=b64b44080eb54e93baf9e68b2a21c718, user.id=8dbc0a6d0fb547529ed7b62e429f09ee) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:23.206504 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c12fa9-fcd1-4f65-99a7-f05f937f21c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:23.207915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c12fa9-fcd1-4f65-99a7-f05f937f21c2 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:23.213487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 582/1161] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:23 2022] GET /identity/v3/role_assignments?user.id=8dbc0a6d0fb547529ed7b62e429f09ee&scope.project.id=b64b44080eb54e93baf9e68b2a21c718&role.id=a7d59d2982de4bfeb758dce70808029f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:25.131382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c161a-fc4a-4fdd-b5dd-cecc3613fe19 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:25.131916 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c161a-fc4a-4fdd-b5dd-cecc3613fe19 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:25.131916 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c161a-fc4a-4fdd-b5dd-cecc3613fe19 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:25.133269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 580/1162] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:25.138546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301eef5-8721-4ffc-9965-00563d04dfc8 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:25.138960 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301eef5-8721-4ffc-9965-00563d04dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:25.139097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301eef5-8721-4ffc-9965-00563d04dfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:25.156987 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-0301eef5-8721-4ffc-9965-00563d04dfc8 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:25.158165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0301eef5-8721-4ffc-9965-00563d04dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:25.224991 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 583/1163] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:25.491952 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c161a-fc4a-4fdd-b5dd-cecc3613fe19 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:25.579117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:25.592432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c161a-fc4a-4fdd-b5dd-cecc3613fe19 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:25.626057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a65ca-89cf-4bde-b8b2-b7dcd20afef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:25.626666 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a65ca-89cf-4bde-b8b2-b7dcd20afef6 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:25.626946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a65ca-89cf-4bde-b8b2-b7dcd20afef6 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:25.627222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a65ca-89cf-4bde-b8b2-b7dcd20afef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:25.692333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a65ca-89cf-4bde-b8b2-b7dcd20afef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:25.693762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a65ca-89cf-4bde-b8b2-b7dcd20afef6 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:25.779389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:25.791515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 581/1164] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:32:25.797467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301eef5-8721-4ffc-9965-00563d04dfc8 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:25.821635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:25.893785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301eef5-8721-4ffc-9965-00563d04dfc8 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:25.927151 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433107a3-882e-43f2-98cd-64d73963247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:25.927769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433107a3-882e-43f2-98cd-64d73963247d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:25.928048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433107a3-882e-43f2-98cd-64d73963247d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:25.928351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433107a3-882e-43f2-98cd-64d73963247d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:25.934934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433107a3-882e-43f2-98cd-64d73963247d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:25.936397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433107a3-882e-43f2-98cd-64d73963247d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-433107a3-882e-43f2-98cd-64d73963247d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:25.947482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:25.949244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:25.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:25.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:25.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:25.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:25.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:25.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:25.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:25.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:25.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:25.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:25.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 22:32:25.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:25.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 22:32:25.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:32:25.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 584/1165] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 29 22:32:25 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:25.955107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a65ca-89cf-4bde-b8b2-b7dcd20afef6 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:26.061861 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a65ca-89cf-4bde-b8b2-b7dcd20afef6 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:26.098888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24a0f7-bd69-4327-998f-023c81f47b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:26.099497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24a0f7-bd69-4327-998f-023c81f47b19 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:26.099778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24a0f7-bd69-4327-998f-023c81f47b19 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:26.100052 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24a0f7-bd69-4327-998f-023c81f47b19 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:26.100725 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24a0f7-bd69-4327-998f-023c81f47b19 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:26.101033 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24a0f7-bd69-4327-998f-023c81f47b19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:26.102391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24a0f7-bd69-4327-998f-023c81f47b19 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:26.110126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 582/1166] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Aug 29 22:32:25 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:28.038669 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaead1c-c5f1-49f1-ae40-cf1c3c8ea002 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:28.039223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaead1c-c5f1-49f1-ae40-cf1c3c8ea002 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:28.039223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaead1c-c5f1-49f1-ae40-cf1c3c8ea002 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:28.040509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 585/1167] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:28.046112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8409ed1-fda1-4943-b93a-4261d3636e2e None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:28.046516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8409ed1-fda1-4943-b93a-4261d3636e2e None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:28.046670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8409ed1-fda1-4943-b93a-4261d3636e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:28.065452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d8409ed1-fda1-4943-b93a-4261d3636e2e None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:28.066638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d8409ed1-fda1-4943-b93a-4261d3636e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:28.111995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:28.131667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 583/1168] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:28.409322 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaead1c-c5f1-49f1-ae40-cf1c3c8ea002 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:28.494098 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:28.510358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaead1c-c5f1-49f1-ae40-cf1c3c8ea002 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:28.544524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2a444-dd54-47ad-8d7f-72064e6cd379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:28.545126 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2a444-dd54-47ad-8d7f-72064e6cd379 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:28.545416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2a444-dd54-47ad-8d7f-72064e6cd379 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:28.545684 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2a444-dd54-47ad-8d7f-72064e6cd379 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:28.546355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2a444-dd54-47ad-8d7f-72064e6cd379 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:28.547718 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2a444-dd54-47ad-8d7f-72064e6cd379 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:28.627579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 586/1169] 10.222.0.62 () {60 vars in 1138 bytes} [Mon Aug 29 22:32:28 2022] POST /identity/v3/domains => generated 267 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:32:30.574296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb85eaa-7043-4f66-af43-b07aeca0deaa None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:30.574857 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb85eaa-7043-4f66-af43-b07aeca0deaa None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:30.574857 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb85eaa-7043-4f66-af43-b07aeca0deaa None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:30.576224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 584/1170] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:30.581444 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74545c45-223e-4caf-8c45-03351349a90c None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:30.581856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74545c45-223e-4caf-8c45-03351349a90c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:30.581983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74545c45-223e-4caf-8c45-03351349a90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:30.601899 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-74545c45-223e-4caf-8c45-03351349a90c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:30.603092 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-74545c45-223e-4caf-8c45-03351349a90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:30.669866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 587/1171] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:32:30.949242 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb85eaa-7043-4f66-af43-b07aeca0deaa None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:31.050180 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb85eaa-7043-4f66-af43-b07aeca0deaa None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:31.082795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b4958-6176-45b7-a7d3-e23cc8b16e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:31.083409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b4958-6176-45b7-a7d3-e23cc8b16e6e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:31.083684 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b4958-6176-45b7-a7d3-e23cc8b16e6e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:31.083953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b4958-6176-45b7-a7d3-e23cc8b16e6e None admin] PATH_INFO: `/v3/domains/6c317e7de4b144dba58d4e4c91dd70dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:31.093987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b4958-6176-45b7-a7d3-e23cc8b16e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=6c317e7de4b144dba58d4e4c91dd70dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:31.095404 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b4958-6176-45b7-a7d3-e23cc8b16e6e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:31.097002 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 585/1172] 10.222.0.62 () {56 vars in 1183 bytes} [Mon Aug 29 22:32:30 2022] GET /identity/v3/domains/6c317e7de4b144dba58d4e4c91dd70dd => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:31.102934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74545c45-223e-4caf-8c45-03351349a90c None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:31.178662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:31.203211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74545c45-223e-4caf-8c45-03351349a90c None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:31.236873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990acd15-5855-4a11-8bca-49a10a7d5007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:31.237484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990acd15-5855-4a11-8bca-49a10a7d5007 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:31.237764 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990acd15-5855-4a11-8bca-49a10a7d5007 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:31.238036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990acd15-5855-4a11-8bca-49a10a7d5007 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:31.238691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990acd15-5855-4a11-8bca-49a10a7d5007 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:31.240143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990acd15-5855-4a11-8bca-49a10a7d5007 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:31.324329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 588/1173] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 29 22:32:31 2022] POST /identity/v3/projects => generated 361 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:32:33.252248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dad4a-39dc-49aa-82fc-37522cab8bd9 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:33.252807 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dad4a-39dc-49aa-82fc-37522cab8bd9 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:33.252807 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dad4a-39dc-49aa-82fc-37522cab8bd9 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:33.254117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 586/1174] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:33.259218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e975d8-ae61-48f6-9b84-a37a9c81a27e None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:33.259606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e975d8-ae61-48f6-9b84-a37a9c81a27e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:33.259776 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e975d8-ae61-48f6-9b84-a37a9c81a27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:33.279150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-a4e975d8-ae61-48f6-9b84-a37a9c81a27e None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:33.280397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a4e975d8-ae61-48f6-9b84-a37a9c81a27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:33.347391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 589/1175] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:33.617298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dad4a-39dc-49aa-82fc-37522cab8bd9 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:33.661615 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:33.718530 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dad4a-39dc-49aa-82fc-37522cab8bd9 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:33.751654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4d5fb-82f7-468d-984e-00b535b4ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:33.752303 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4d5fb-82f7-468d-984e-00b535b4ae5e None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:33.752583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4d5fb-82f7-468d-984e-00b535b4ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:33.752855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4d5fb-82f7-468d-984e-00b535b4ae5e None admin] PATH_INFO: `/v3/domains/6c317e7de4b144dba58d4e4c91dd70dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:33.753963 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4d5fb-82f7-468d-984e-00b535b4ae5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=6c317e7de4b144dba58d4e4c91dd70dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:33.755393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4d5fb-82f7-468d-984e-00b535b4ae5e None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:33.756990 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 587/1176] 10.222.0.62 () {56 vars in 1183 bytes} [Mon Aug 29 22:32:33 2022] GET /identity/v3/domains/6c317e7de4b144dba58d4e4c91dd70dd => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:33.763308 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e975d8-ae61-48f6-9b84-a37a9c81a27e None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:33.823642 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:33.866003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e975d8-ae61-48f6-9b84-a37a9c81a27e None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:33.900984 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abb78a-6083-4c50-acbd-c6f93d46a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:33.901588 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abb78a-6083-4c50-acbd-c6f93d46a048 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:33.901867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abb78a-6083-4c50-acbd-c6f93d46a048 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:33.902139 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abb78a-6083-4c50-acbd-c6f93d46a048 None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:33.902796 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abb78a-6083-4c50-acbd-c6f93d46a048 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:33.904268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abb78a-6083-4c50-acbd-c6f93d46a048 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:34.015054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 590/1177] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:32:33 2022] POST /identity/v3/users => generated 311 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:32:35.957198 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeed46-8909-46a8-a386-ebb728f98eaa None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.957780 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeed46-8909-46a8-a386-ebb728f98eaa None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.957780 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeed46-8909-46a8-a386-ebb728f98eaa None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.959013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 588/1178] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:35.964304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a17c3-ce4f-441e-a9fb-49057f6716ca None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.964724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a17c3-ce4f-441e-a9fb-49057f6716ca None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.964848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a17c3-ce4f-441e-a9fb-49057f6716ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.983592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-d15a17c3-ce4f-441e-a9fb-49057f6716ca None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:35.984796 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d15a17c3-ce4f-441e-a9fb-49057f6716ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:36.049693 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 591/1179] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:36.317718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeed46-8909-46a8-a386-ebb728f98eaa None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.417528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeed46-8909-46a8-a386-ebb728f98eaa None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:36.427823 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:36.450251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6737fa-256e-4dc3-82f0-661d5f4cdcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:36.450860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6737fa-256e-4dc3-82f0-661d5f4cdcd5 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:36.451135 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6737fa-256e-4dc3-82f0-661d5f4cdcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:36.451402 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6737fa-256e-4dc3-82f0-661d5f4cdcd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:36.461503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6737fa-256e-4dc3-82f0-661d5f4cdcd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-bf6737fa-256e-4dc3-82f0-661d5f4cdcd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:36.466543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:36.470083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:36.471220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:36.471220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:36.471220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:36.471220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:36.471220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:36.471220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:36.471220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:36.471220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:36.471220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:36.471220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:36.471220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:36.471220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:32:36.471220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 589/1180] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:36.474198 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a17c3-ce4f-441e-a9fb-49057f6716ca None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.518989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:36.575905 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a17c3-ce4f-441e-a9fb-49057f6716ca None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:36.610841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65a235-90bd-4087-852f-7b564f52dfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:36.612489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65a235-90bd-4087-852f-7b564f52dfe9 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:36.612489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65a235-90bd-4087-852f-7b564f52dfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:36.612489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65a235-90bd-4087-852f-7b564f52dfe9 None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:36.612756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65a235-90bd-4087-852f-7b564f52dfe9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:36.612962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65a235-90bd-4087-852f-7b564f52dfe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:36.614338 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65a235-90bd-4087-852f-7b564f52dfe9 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:36.623199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 592/1181] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:36.629181 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6737fa-256e-4dc3-82f0-661d5f4cdcd5 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.757284 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6737fa-256e-4dc3-82f0-661d5f4cdcd5 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:36.790364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012f5d8-e1f5-4488-b27e-0e522093babb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:36.790991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012f5d8-e1f5-4488-b27e-0e522093babb None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:36.791859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012f5d8-e1f5-4488-b27e-0e522093babb None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:36.792160 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012f5d8-e1f5-4488-b27e-0e522093babb None admin] PATH_INFO: `/v3/users/be82b2eb104f476bb14c518992b7c7c4` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:36.805590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012f5d8-e1f5-4488-b27e-0e522093babb None admin] RBAC: Authorizing `identity:get_user(user_id=be82b2eb104f476bb14c518992b7c7c4)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:36.807479 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012f5d8-e1f5-4488-b27e-0e522093babb None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:36.809154 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 590/1182] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:36 2022] GET /identity/v3/users/be82b2eb104f476bb14c518992b7c7c4 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:36.819307 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65a235-90bd-4087-852f-7b564f52dfe9 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.919319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65a235-90bd-4087-852f-7b564f52dfe9 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:36.921593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:36.952408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3d080-6a27-4415-b159-030956f4a2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:36.953008 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3d080-6a27-4415-b159-030956f4a2c5 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:36.953288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3d080-6a27-4415-b159-030956f4a2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:36.953562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3d080-6a27-4415-b159-030956f4a2c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:37.021604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3d080-6a27-4415-b159-030956f4a2c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:37.023083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3d080-6a27-4415-b159-030956f4a2c5 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:37.118636 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 593/1183] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:32:37.124688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012f5d8-e1f5-4488-b27e-0e522093babb None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:37.153117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:37.221516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012f5d8-e1f5-4488-b27e-0e522093babb None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:37.253241 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b5353-39ad-4796-89f4-c308659cba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:37.253850 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b5353-39ad-4796-89f4-c308659cba41 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:37.254128 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b5353-39ad-4796-89f4-c308659cba41 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:37.254396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b5353-39ad-4796-89f4-c308659cba41 None admin] PATH_INFO: `/v3/projects/5398af86503b4e17938e7881af087b7c` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:37.255494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b5353-39ad-4796-89f4-c308659cba41 None admin] RBAC: Authorizing `identity:get_project(project_id=5398af86503b4e17938e7881af087b7c)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:37.256919 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b5353-39ad-4796-89f4-c308659cba41 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:37.258521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 591/1184] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:37 2022] GET /identity/v3/projects/5398af86503b4e17938e7881af087b7c => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:37.265377 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3d080-6a27-4415-b159-030956f4a2c5 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:37.268961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:37.364923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3d080-6a27-4415-b159-030956f4a2c5 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:37.399141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cddc04-312d-41aa-af4c-9cecb7a73fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:37.399741 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cddc04-312d-41aa-af4c-9cecb7a73fa4 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:37.400020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cddc04-312d-41aa-af4c-9cecb7a73fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:37.400327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cddc04-312d-41aa-af4c-9cecb7a73fa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:37.401076 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cddc04-312d-41aa-af4c-9cecb7a73fa4 None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=5398af86503b4e17938e7881af087b7c, user.id=be82b2eb104f476bb14c518992b7c7c4) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:37.401388 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cddc04-312d-41aa-af4c-9cecb7a73fa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:37.402822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cddc04-312d-41aa-af4c-9cecb7a73fa4 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:37.408058 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 594/1185] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:37 2022] GET /identity/v3/role_assignments?user.id=be82b2eb104f476bb14c518992b7c7c4&scope.project.id=5398af86503b4e17938e7881af087b7c&role.id=a7d59d2982de4bfeb758dce70808029f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:39.287127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b95b2-8be4-4b39-9084-9dd0004ab40a None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:39.287689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b95b2-8be4-4b39-9084-9dd0004ab40a None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:39.287689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b95b2-8be4-4b39-9084-9dd0004ab40a None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:39.289042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 592/1186] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:39.294459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7cf12-e42f-4904-b661-dd08ca1ea475 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:39.294914 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7cf12-e42f-4904-b661-dd08ca1ea475 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:39.295018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7cf12-e42f-4904-b661-dd08ca1ea475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:39.313115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-90a7cf12-e42f-4904-b661-dd08ca1ea475 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:39.314292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-90a7cf12-e42f-4904-b661-dd08ca1ea475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:39.375162 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:39.380514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 595/1187] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:39.650807 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b95b2-8be4-4b39-9084-9dd0004ab40a None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:39.741978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:39.748997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b95b2-8be4-4b39-9084-9dd0004ab40a None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:39.782107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd497e-29d3-4427-971b-204800c73f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:39.782730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd497e-29d3-4427-971b-204800c73f0c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:39.783005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd497e-29d3-4427-971b-204800c73f0c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:39.783276 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd497e-29d3-4427-971b-204800c73f0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:39.793334 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd497e-29d3-4427-971b-204800c73f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-47bd497e-29d3-4427-971b-204800c73f0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:39.798029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:39.799434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:39.800512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:39.800512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:39.800512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:39.800512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:39.800512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:39.800512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:39.800512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:39.800512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:39.800512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:39.800512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:39.800512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:39.800512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:32:39.800512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 593/1188] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:39.805422 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7cf12-e42f-4904-b661-dd08ca1ea475 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:39.902352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7cf12-e42f-4904-b661-dd08ca1ea475 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:39.936890 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e33362-d3bc-44b5-b946-101f921bae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:39.937510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e33362-d3bc-44b5-b946-101f921bae1d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:39.937866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e33362-d3bc-44b5-b946-101f921bae1d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:39.938147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e33362-d3bc-44b5-b946-101f921bae1d None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:39.938826 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e33362-d3bc-44b5-b946-101f921bae1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:39.939136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e33362-d3bc-44b5-b946-101f921bae1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:39.940564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e33362-d3bc-44b5-b946-101f921bae1d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:39.949500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 596/1189] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:39.955324 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd497e-29d3-4427-971b-204800c73f0c None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:40.054521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd497e-29d3-4427-971b-204800c73f0c None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:40.087451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c39601-0b32-4c89-860f-7af3c911e65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:40.088072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c39601-0b32-4c89-860f-7af3c911e65f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:40.088374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c39601-0b32-4c89-860f-7af3c911e65f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:40.088644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c39601-0b32-4c89-860f-7af3c911e65f None admin] PATH_INFO: `/v3/users/be82b2eb104f476bb14c518992b7c7c4` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:40.089761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c39601-0b32-4c89-860f-7af3c911e65f None admin] RBAC: Authorizing `identity:get_user(user_id=be82b2eb104f476bb14c518992b7c7c4)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:40.091170 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c39601-0b32-4c89-860f-7af3c911e65f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:40.092767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 594/1190] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:39 2022] GET /identity/v3/users/be82b2eb104f476bb14c518992b7c7c4 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:40.098676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e33362-d3bc-44b5-b946-101f921bae1d None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:40.159527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:40.200869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e33362-d3bc-44b5-b946-101f921bae1d None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:40.233995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9a179-4528-4855-8a05-2d4ec896af76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:40.234622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9a179-4528-4855-8a05-2d4ec896af76 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:40.234903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9a179-4528-4855-8a05-2d4ec896af76 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:40.235183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9a179-4528-4855-8a05-2d4ec896af76 None admin] PATH_INFO: `/v3/projects/5398af86503b4e17938e7881af087b7c` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:40.236319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9a179-4528-4855-8a05-2d4ec896af76 None admin] RBAC: Authorizing `identity:get_project(project_id=5398af86503b4e17938e7881af087b7c)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:40.237752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9a179-4528-4855-8a05-2d4ec896af76 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:40.239367 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 597/1191] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:40 2022] GET /identity/v3/projects/5398af86503b4e17938e7881af087b7c => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:40.246020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c39601-0b32-4c89-860f-7af3c911e65f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:40.271043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:40.345006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c39601-0b32-4c89-860f-7af3c911e65f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:40.378054 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4426b-3678-497e-a278-b01b0ddf30c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:40.378703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4426b-3678-497e-a278-b01b0ddf30c1 None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:40.378983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4426b-3678-497e-a278-b01b0ddf30c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:40.379255 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4426b-3678-497e-a278-b01b0ddf30c1 None admin] PATH_INFO: `/v3/projects/5398af86503b4e17938e7881af087b7c/users/be82b2eb104f476bb14c518992b7c7c4/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:40.381165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4426b-3678-497e-a278-b01b0ddf30c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5398af86503b4e17938e7881af087b7c, user_id=be82b2eb104f476bb14c518992b7c7c4, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:40.382579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4426b-3678-497e-a278-b01b0ddf30c1 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:40.454926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 595/1192] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:32:40 2022] PUT /identity/v3/projects/5398af86503b4e17938e7881af087b7c/users/be82b2eb104f476bb14c518992b7c7c4/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:42.328048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641016c2-1b9d-4d6f-860b-c5804761b48d None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.328629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641016c2-1b9d-4d6f-860b-c5804761b48d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.328629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641016c2-1b9d-4d6f-860b-c5804761b48d None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.329926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 598/1193] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:42.334983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15dbea-b337-4a84-80b0-b0b4cf945eec None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.335375 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15dbea-b337-4a84-80b0-b0b4cf945eec None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.335527 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15dbea-b337-4a84-80b0-b0b4cf945eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.353797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-fd15dbea-b337-4a84-80b0-b0b4cf945eec None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:42.354961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-fd15dbea-b337-4a84-80b0-b0b4cf945eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:42.418380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 596/1194] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:42.688620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641016c2-1b9d-4d6f-860b-c5804761b48d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:42.795308 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641016c2-1b9d-4d6f-860b-c5804761b48d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:42.821557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:42.829617 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2a907-4bd0-4b6a-a42a-38cc70717b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:42.832736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2a907-4bd0-4b6a-a42a-38cc70717b5e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.832736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2a907-4bd0-4b6a-a42a-38cc70717b5e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.832736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2a907-4bd0-4b6a-a42a-38cc70717b5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.840557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2a907-4bd0-4b6a-a42a-38cc70717b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-f8e2a907-4bd0-4b6a-a42a-38cc70717b5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:42.845249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:42.846440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:42.847781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:42.847781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:42.847781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:42.847781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:42.847781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:42.847781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:42.847781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:42.847781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:42.847781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:42.847781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:42.847781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:42.847781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:32:42.847781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 599/1195] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:42.852439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15dbea-b337-4a84-80b0-b0b4cf945eec None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:42.866901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:42.950407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15dbea-b337-4a84-80b0-b0b4cf945eec None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:42.983182 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac23db-96ec-4175-ac14-d353605ec65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:42.983771 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac23db-96ec-4175-ac14-d353605ec65f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.984050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac23db-96ec-4175-ac14-d353605ec65f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.984343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac23db-96ec-4175-ac14-d353605ec65f None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.984996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac23db-96ec-4175-ac14-d353605ec65f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:42.985290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac23db-96ec-4175-ac14-d353605ec65f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:42.986632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac23db-96ec-4175-ac14-d353605ec65f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:42.995049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 597/1196] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:43.000923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2a907-4bd0-4b6a-a42a-38cc70717b5e None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:43.099584 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2a907-4bd0-4b6a-a42a-38cc70717b5e None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:43.133686 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdc24c-8f3c-4f2d-91f9-f5f067d82ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:43.134305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdc24c-8f3c-4f2d-91f9-f5f067d82ef4 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.134608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdc24c-8f3c-4f2d-91f9-f5f067d82ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.134886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdc24c-8f3c-4f2d-91f9-f5f067d82ef4 None admin] PATH_INFO: `/v3/users/be82b2eb104f476bb14c518992b7c7c4` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.136034 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdc24c-8f3c-4f2d-91f9-f5f067d82ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=be82b2eb104f476bb14c518992b7c7c4)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:43.137496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdc24c-8f3c-4f2d-91f9-f5f067d82ef4 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:43.139065 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 600/1197] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:42 2022] GET /identity/v3/users/be82b2eb104f476bb14c518992b7c7c4 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:43.144988 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac23db-96ec-4175-ac14-d353605ec65f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:43.218652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:43.240879 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac23db-96ec-4175-ac14-d353605ec65f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:43.273206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6554c-6202-42a1-81c2-6486b8272217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:43.273800 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6554c-6202-42a1-81c2-6486b8272217 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.274075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6554c-6202-42a1-81c2-6486b8272217 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.274344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6554c-6202-42a1-81c2-6486b8272217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.339518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6554c-6202-42a1-81c2-6486b8272217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:43.340965 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6554c-6202-42a1-81c2-6486b8272217 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:43.416866 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:43.440014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 598/1198] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:32:43.445973 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdc24c-8f3c-4f2d-91f9-f5f067d82ef4 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:43.502014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:43.546743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdc24c-8f3c-4f2d-91f9-f5f067d82ef4 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:43.581559 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f02e10-5e44-4782-adbc-344cc351460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:43.582193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f02e10-5e44-4782-adbc-344cc351460e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.582477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f02e10-5e44-4782-adbc-344cc351460e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.582753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f02e10-5e44-4782-adbc-344cc351460e None admin] PATH_INFO: `/v3/projects/5398af86503b4e17938e7881af087b7c` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.583881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f02e10-5e44-4782-adbc-344cc351460e None admin] RBAC: Authorizing `identity:get_project(project_id=5398af86503b4e17938e7881af087b7c)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:43.585396 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f02e10-5e44-4782-adbc-344cc351460e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:43.587029 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 601/1199] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:43 2022] GET /identity/v3/projects/5398af86503b4e17938e7881af087b7c => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:43.593798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6554c-6202-42a1-81c2-6486b8272217 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:43.691013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6554c-6202-42a1-81c2-6486b8272217 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:43.723919 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b8ce5-3218-4333-856b-9ab9dda84bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:43.724547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b8ce5-3218-4333-856b-9ab9dda84bdb None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.724828 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b8ce5-3218-4333-856b-9ab9dda84bdb None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.725104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b8ce5-3218-4333-856b-9ab9dda84bdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.725825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b8ce5-3218-4333-856b-9ab9dda84bdb None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=5398af86503b4e17938e7881af087b7c, user.id=be82b2eb104f476bb14c518992b7c7c4) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:43.726134 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b8ce5-3218-4333-856b-9ab9dda84bdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:43.727547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b8ce5-3218-4333-856b-9ab9dda84bdb None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:43.733923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 599/1200] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:43 2022] GET /identity/v3/role_assignments?user.id=be82b2eb104f476bb14c518992b7c7c4&scope.project.id=5398af86503b4e17938e7881af087b7c&role.id=a7d59d2982de4bfeb758dce70808029f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:53.576306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=38 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:53.731253 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=80 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:58.507899 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd0a0-e1bc-4877-acdd-d4e76a02781a None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:58.508536 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd0a0-e1bc-4877-acdd-d4e76a02781a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:58.508536 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd0a0-e1bc-4877-acdd-d4e76a02781a None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:58.509832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 602/1201] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:58.514891 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931424c2-3cef-4b7b-b431-a6d641c22b77 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:58.515389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931424c2-3cef-4b7b-b431-a6d641c22b77 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:58.515496 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931424c2-3cef-4b7b-b431-a6d641c22b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:58.533990 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-931424c2-3cef-4b7b-b431-a6d641c22b77 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:58.535184 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-931424c2-3cef-4b7b-b431-a6d641c22b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:58.603521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 600/1202] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:58.875667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdd0a0-e1bc-4877-acdd-d4e76a02781a None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:58.981064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdd0a0-e1bc-4877-acdd-d4e76a02781a None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:59.014920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c047ab9-4fca-4267-b293-f8a966e1a52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:59.015553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c047ab9-4fca-4267-b293-f8a966e1a52c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:59.015841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c047ab9-4fca-4267-b293-f8a966e1a52c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:59.016127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c047ab9-4fca-4267-b293-f8a966e1a52c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:59.027024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c047ab9-4fca-4267-b293-f8a966e1a52c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:59.028657 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c047ab9-4fca-4267-b293-f8a966e1a52c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-1c047ab9-4fca-4267-b293-f8a966e1a52c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:59.044304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:59.045739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:59.046782 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:59.046782 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:59.046782 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:33:59.046782 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 603/1203] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:59.052112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931424c2-3cef-4b7b-b431-a6d641c22b77 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:59.158914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931424c2-3cef-4b7b-b431-a6d641c22b77 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:59.193162 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:59.199760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5e493-c5ce-4220-bbe5-cc74d4db10c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:59.200401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5e493-c5ce-4220-bbe5-cc74d4db10c4 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:59.200680 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5e493-c5ce-4220-bbe5-cc74d4db10c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:59.200953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5e493-c5ce-4220-bbe5-cc74d4db10c4 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:59.201598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5e493-c5ce-4220-bbe5-cc74d4db10c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:59.201900 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5e493-c5ce-4220-bbe5-cc74d4db10c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:59.203254 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5e493-c5ce-4220-bbe5-cc74d4db10c4 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:59.214953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 601/1204] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:59.221818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c047ab9-4fca-4267-b293-f8a966e1a52c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:59.281699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:59.332687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c047ab9-4fca-4267-b293-f8a966e1a52c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:59.366315 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54d2bd-0f2e-4074-9e0c-057728486042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:59.366923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54d2bd-0f2e-4074-9e0c-057728486042 None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:59.367201 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54d2bd-0f2e-4074-9e0c-057728486042 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:59.367474 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54d2bd-0f2e-4074-9e0c-057728486042 None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:59.368154 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54d2bd-0f2e-4074-9e0c-057728486042 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:59.370085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54d2bd-0f2e-4074-9e0c-057728486042 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:59.527933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 604/1205] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 29 22:33:59 2022] POST /identity/v3/users => generated 251 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:34:01.473906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64747547-2846-47c8-88f6-788e02aac197 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:01.474546 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64747547-2846-47c8-88f6-788e02aac197 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:01.474546 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64747547-2846-47c8-88f6-788e02aac197 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:01.475777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 602/1206] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:01.481703 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b7f7f-28d6-4694-861b-5c62e17d022f None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:01.482112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b7f7f-28d6-4694-861b-5c62e17d022f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:01.482263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b7f7f-28d6-4694-861b-5c62e17d022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:01.500412 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-227b7f7f-28d6-4694-861b-5c62e17d022f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:01.501596 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-227b7f7f-28d6-4694-861b-5c62e17d022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:01.568528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 605/1207] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:01.844407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64747547-2846-47c8-88f6-788e02aac197 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:01.949768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64747547-2846-47c8-88f6-788e02aac197 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:01.996366 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ade5-99a7-4e25-8580-2dce8228694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:01.997022 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ade5-99a7-4e25-8580-2dce8228694f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:01.997327 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ade5-99a7-4e25-8580-2dce8228694f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:01.997573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ade5-99a7-4e25-8580-2dce8228694f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.011243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2ade5-99a7-4e25-8580-2dce8228694f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-19e2ade5-99a7-4e25-8580-2dce8228694f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:34:02.016122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:02.022582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:02.023458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:02.023458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:02.023458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:02.023458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:02.023458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:34:02.023458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:34:02.023458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:34:02.023458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:34:02.023458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:34:02.023458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:34:02.023458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:34:02.023458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:02.023458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 603/1208] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:34:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:02.024283 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b7f7f-28d6-4694-861b-5c62e17d022f None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.063981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:02.123879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b7f7f-28d6-4694-861b-5c62e17d022f None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.158885 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc002658-3f49-4eef-9773-27f1e65306fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.159488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002658-3f49-4eef-9773-27f1e65306fe None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.159766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002658-3f49-4eef-9773-27f1e65306fe None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.160035 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002658-3f49-4eef-9773-27f1e65306fe None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.160729 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc002658-3f49-4eef-9773-27f1e65306fe None admin] RBAC: Adding query filter params (name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:02.161036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc002658-3f49-4eef-9773-27f1e65306fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.162399 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc002658-3f49-4eef-9773-27f1e65306fe None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.170319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 606/1209] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:34:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:02.176675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ade5-99a7-4e25-8580-2dce8228694f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.226294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:02.275278 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ade5-99a7-4e25-8580-2dce8228694f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.309371 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484d9c1-4e23-4cd8-8b7f-22420ede6761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.310106 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484d9c1-4e23-4cd8-8b7f-22420ede6761 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.310391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484d9c1-4e23-4cd8-8b7f-22420ede6761 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.310662 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484d9c1-4e23-4cd8-8b7f-22420ede6761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.322082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484d9c1-4e23-4cd8-8b7f-22420ede6761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.327507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484d9c1-4e23-4cd8-8b7f-22420ede6761 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-c484d9c1-4e23-4cd8-8b7f-22420ede6761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:34:02.338175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:02.339356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:34:02.340497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:34:02.340497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:02.340497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:02.340497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 604/1210] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:02.345309 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc002658-3f49-4eef-9773-27f1e65306fe None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.448444 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:02.451315 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc002658-3f49-4eef-9773-27f1e65306fe None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.484690 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c585943-5669-4d2d-a717-130ca0cf0dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.485327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c585943-5669-4d2d-a717-130ca0cf0dd7 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.485551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c585943-5669-4d2d-a717-130ca0cf0dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.485824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c585943-5669-4d2d-a717-130ca0cf0dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.486461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c585943-5669-4d2d-a717-130ca0cf0dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:02.486770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c585943-5669-4d2d-a717-130ca0cf0dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.488160 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c585943-5669-4d2d-a717-130ca0cf0dd7 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.499883 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 607/1211] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:02.505630 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484d9c1-4e23-4cd8-8b7f-22420ede6761 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.606346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484d9c1-4e23-4cd8-8b7f-22420ede6761 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.607977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:02.640266 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a02685-8908-4c6c-89d7-3b91ffab0d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.640892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a02685-8908-4c6c-89d7-3b91ffab0d40 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.641175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a02685-8908-4c6c-89d7-3b91ffab0d40 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.641453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a02685-8908-4c6c-89d7-3b91ffab0d40 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.649704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a02685-8908-4c6c-89d7-3b91ffab0d40 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.651271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a02685-8908-4c6c-89d7-3b91ffab0d40 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-45a02685-8908-4c6c-89d7-3b91ffab0d40 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:34:02.662364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:02.663581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:02.664858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:02.664858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:02.664858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:34:02.664858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:34:02.664858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:34:02.664858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:34:02.664858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:34:02.664858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:34:02.664858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:34:02.664858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:02.664858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 605/1212] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:02.670199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c585943-5669-4d2d-a717-130ca0cf0dd7 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.774968 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c585943-5669-4d2d-a717-130ca0cf0dd7 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.810106 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abda24-874d-4f7e-ae0d-6832dc8fc5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.810719 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abda24-874d-4f7e-ae0d-6832dc8fc5b6 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.810993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abda24-874d-4f7e-ae0d-6832dc8fc5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.811264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abda24-874d-4f7e-ae0d-6832dc8fc5b6 None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:02.811992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abda24-874d-4f7e-ae0d-6832dc8fc5b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:02.812333 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abda24-874d-4f7e-ae0d-6832dc8fc5b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:02.813760 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abda24-874d-4f7e-ae0d-6832dc8fc5b6 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:02.831396 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 608/1213] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Aug 29 22:34:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:02.837465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a02685-8908-4c6c-89d7-3b91ffab0d40 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:02.937980 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a02685-8908-4c6c-89d7-3b91ffab0d40 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:02.972468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d2a3d-cc7b-4f3b-b62e-42a00f0b033c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:02.973076 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d2a3d-cc7b-4f3b-b62e-42a00f0b033c None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:02.973356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d2a3d-cc7b-4f3b-b62e-42a00f0b033c None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:02.973632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d2a3d-cc7b-4f3b-b62e-42a00f0b033c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:03.005070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:03.043670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d2a3d-cc7b-4f3b-b62e-42a00f0b033c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:03.045146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d2a3d-cc7b-4f3b-b62e-42a00f0b033c None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:03.148272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 606/1214] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:34:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:34:03.154866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abda24-874d-4f7e-ae0d-6832dc8fc5b6 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:03.174685 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:03.255159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abda24-874d-4f7e-ae0d-6832dc8fc5b6 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:03.289938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89373e7-032f-49ee-b3a1-c3d921d4272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:03.290548 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89373e7-032f-49ee-b3a1-c3d921d4272c None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:03.290830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89373e7-032f-49ee-b3a1-c3d921d4272c None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:03.291135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89373e7-032f-49ee-b3a1-c3d921d4272c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:03.301800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89373e7-032f-49ee-b3a1-c3d921d4272c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:03.303182 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89373e7-032f-49ee-b3a1-c3d921d4272c None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-a89373e7-032f-49ee-b3a1-c3d921d4272c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:34:03.317496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:03.318622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:34:03.319562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:34:03.319562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:03.319562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:34:03.319562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 609/1215] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:03.325191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d2a3d-cc7b-4f3b-b62e-42a00f0b033c None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:03.386555 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:03.426937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d2a3d-cc7b-4f3b-b62e-42a00f0b033c None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:03.466409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8601f63-47c6-454a-a6dc-68c6e1da0222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:03.467057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8601f63-47c6-454a-a6dc-68c6e1da0222 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:03.467299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8601f63-47c6-454a-a6dc-68c6e1da0222 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:03.467571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8601f63-47c6-454a-a6dc-68c6e1da0222 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:03.468302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8601f63-47c6-454a-a6dc-68c6e1da0222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:03.468550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8601f63-47c6-454a-a6dc-68c6e1da0222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:03.469905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8601f63-47c6-454a-a6dc-68c6e1da0222 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:03.481141 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 607/1216] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:03.487372 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89373e7-032f-49ee-b3a1-c3d921d4272c None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:03.557398 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:03.588186 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89373e7-032f-49ee-b3a1-c3d921d4272c None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:03.622081 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2855328-c67a-4d77-8b23-0a2e97ada5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:03.622725 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2855328-c67a-4d77-8b23-0a2e97ada5e2 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:03.622997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2855328-c67a-4d77-8b23-0a2e97ada5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:03.623266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2855328-c67a-4d77-8b23-0a2e97ada5e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:03.630072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2855328-c67a-4d77-8b23-0a2e97ada5e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:03.634074 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2855328-c67a-4d77-8b23-0a2e97ada5e2 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:03.643737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-d2855328-c67a-4d77-8b23-0a2e97ada5e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:34:03.643737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:03.643737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:03.643737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:03.643737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:03.643737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:03.643737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:03.643737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:03.643737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:03.643737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:03.643737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:03.643737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:03.643737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:34:03.643737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:34:03.643737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:03.644851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:03.646344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:34:03.646344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:34:03.646344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:34:03.646344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:34:03.646344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:34:03.646344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:34:03.646344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:34:03.646344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:34:03.646344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 610/1217] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:34:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:03.650888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8601f63-47c6-454a-a6dc-68c6e1da0222 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:03.752537 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8601f63-47c6-454a-a6dc-68c6e1da0222 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:03.774728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:03.786559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39d096-31b9-42e1-8836-4053e261ba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:03.787128 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39d096-31b9-42e1-8836-4053e261ba79 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:03.787409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39d096-31b9-42e1-8836-4053e261ba79 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:03.787687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39d096-31b9-42e1-8836-4053e261ba79 None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:03.788422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39d096-31b9-42e1-8836-4053e261ba79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:03.788724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39d096-31b9-42e1-8836-4053e261ba79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:03.790142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39d096-31b9-42e1-8836-4053e261ba79 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:03.802642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 608/1218] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:34:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:03.809428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2855328-c67a-4d77-8b23-0a2e97ada5e2 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:03.909389 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2855328-c67a-4d77-8b23-0a2e97ada5e2 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:03.939196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:03.945084 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3b9eb-817f-4796-8f55-01c5218a0f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:03.945686 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3b9eb-817f-4796-8f55-01c5218a0f16 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:03.945966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3b9eb-817f-4796-8f55-01c5218a0f16 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:03.946238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3b9eb-817f-4796-8f55-01c5218a0f16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:03.946961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3b9eb-817f-4796-8f55-01c5218a0f16 None admin] RBAC: Adding query filter params (role.id=5f0de9d8946f41e8a26d355448071297, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=2991c613878e4993901199434f384f49) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:03.947300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3b9eb-817f-4796-8f55-01c5218a0f16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:03.948798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3b9eb-817f-4796-8f55-01c5218a0f16 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:03.954176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 611/1219] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:34:03 2022] GET /identity/v3/role_assignments?user.id=2991c613878e4993901199434f384f49&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=5f0de9d8946f41e8a26d355448071297 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:05.867503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282c414-42c6-4dfa-b86c-c17a5149d1ae None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:05.868177 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282c414-42c6-4dfa-b86c-c17a5149d1ae None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:05.868177 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282c414-42c6-4dfa-b86c-c17a5149d1ae None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:05.875118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 609/1220] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:05.875217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a64fa6-88e0-4ddd-a2af-c8c678e52a9c None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:05.875217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a64fa6-88e0-4ddd-a2af-c8c678e52a9c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:05.875699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a64fa6-88e0-4ddd-a2af-c8c678e52a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:05.893492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-73a64fa6-88e0-4ddd-a2af-c8c678e52a9c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:05.894689 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-73a64fa6-88e0-4ddd-a2af-c8c678e52a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:05.964215 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 612/1221] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:06.240280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282c414-42c6-4dfa-b86c-c17a5149d1ae None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:06.342896 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282c414-42c6-4dfa-b86c-c17a5149d1ae None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:06.381297 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accbc51-da1e-43ad-9160-0023e8478b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:06.381978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accbc51-da1e-43ad-9160-0023e8478b39 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:06.382201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accbc51-da1e-43ad-9160-0023e8478b39 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:06.382468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accbc51-da1e-43ad-9160-0023e8478b39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:06.392434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accbc51-da1e-43ad-9160-0023e8478b39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-6accbc51-da1e-43ad-9160-0023e8478b39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:34:06.397205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:06.398363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:06.399372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:06.399372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:06.399372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:06.399372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:06.399372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:34:06.399372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:34:06.399372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:34:06.399372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:34:06.399372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:34:06.399372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:34:06.399372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:34:06.399372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:06.399372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 610/1222] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:34:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:34:06.404512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a64fa6-88e0-4ddd-a2af-c8c678e52a9c None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:06.503632 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a64fa6-88e0-4ddd-a2af-c8c678e52a9c None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:06.527756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:06.538170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330feff-4777-4f75-bd69-b9ca15063c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:06.538773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330feff-4777-4f75-bd69-b9ca15063c4d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:06.539050 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330feff-4777-4f75-bd69-b9ca15063c4d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:06.539321 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330feff-4777-4f75-bd69-b9ca15063c4d None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:06.539982 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330feff-4777-4f75-bd69-b9ca15063c4d None admin] RBAC: Adding query filter params (name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:06.540318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330feff-4777-4f75-bd69-b9ca15063c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:06.542292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330feff-4777-4f75-bd69-b9ca15063c4d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:06.550436 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 613/1223] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:34:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:06.556251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accbc51-da1e-43ad-9160-0023e8478b39 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:06.599763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:06.658824 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accbc51-da1e-43ad-9160-0023e8478b39 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:06.694027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8393b8f-1d17-4384-aa36-ba094966c4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:06.694660 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8393b8f-1d17-4384-aa36-ba094966c4a4 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:06.694940 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8393b8f-1d17-4384-aa36-ba094966c4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:06.695211 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8393b8f-1d17-4384-aa36-ba094966c4a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:06.705181 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8393b8f-1d17-4384-aa36-ba094966c4a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:06.706606 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8393b8f-1d17-4384-aa36-ba094966c4a4 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-a8393b8f-1d17-4384-aa36-ba094966c4a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:34:06.722455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:06.723618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:34:06.724793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:34:06.724793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:06.724793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:06.724793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 611/1224] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:06.730174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330feff-4777-4f75-bd69-b9ca15063c4d None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:06.832194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330feff-4777-4f75-bd69-b9ca15063c4d None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:06.866057 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537e95e-283a-44c5-ba9d-183c6900edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:06.866648 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537e95e-283a-44c5-ba9d-183c6900edde None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:06.866933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537e95e-283a-44c5-ba9d-183c6900edde None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:06.867207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537e95e-283a-44c5-ba9d-183c6900edde None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:06.867870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537e95e-283a-44c5-ba9d-183c6900edde None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:06.868228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537e95e-283a-44c5-ba9d-183c6900edde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:06.869597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537e95e-283a-44c5-ba9d-183c6900edde None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:06.881489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 614/1225] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:06.887826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8393b8f-1d17-4384-aa36-ba094966c4a4 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:06.982878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:06.989347 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8393b8f-1d17-4384-aa36-ba094966c4a4 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.023649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af4deb-6f61-406f-a00c-8a24c646b6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.024333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af4deb-6f61-406f-a00c-8a24c646b6bc None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.024612 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af4deb-6f61-406f-a00c-8a24c646b6bc None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.024885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af4deb-6f61-406f-a00c-8a24c646b6bc None admin] PATH_INFO: `/v3/users/placement` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.035502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af4deb-6f61-406f-a00c-8a24c646b6bc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:07.037788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af4deb-6f61-406f-a00c-8a24c646b6bc None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-36af4deb-6f61-406f-a00c-8a24c646b6bc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:34:07.051090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:07.052477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:07.053645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:07.053645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:07.053645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:34:07.053645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:34:07.053645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:34:07.053645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:34:07.053645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:34:07.053645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:34:07.053645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:34:07.053645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:07.053645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 612/1226] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:07.058833 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537e95e-283a-44c5-ba9d-183c6900edde None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.106407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:07.157649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537e95e-283a-44c5-ba9d-183c6900edde None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.191750 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410431c4-a41d-4e38-af94-489b9b14a6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.192364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410431c4-a41d-4e38-af94-489b9b14a6c9 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.192704 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410431c4-a41d-4e38-af94-489b9b14a6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.192981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410431c4-a41d-4e38-af94-489b9b14a6c9 None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.193701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410431c4-a41d-4e38-af94-489b9b14a6c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:07.194005 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410431c4-a41d-4e38-af94-489b9b14a6c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:07.195421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410431c4-a41d-4e38-af94-489b9b14a6c9 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.212853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 615/1227] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Aug 29 22:34:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:07.219356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af4deb-6f61-406f-a00c-8a24c646b6bc None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.319669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af4deb-6f61-406f-a00c-8a24c646b6bc None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.353907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36939894-75c9-46e5-8b75-8a75f1177f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.354550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36939894-75c9-46e5-8b75-8a75f1177f68 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.357468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36939894-75c9-46e5-8b75-8a75f1177f68 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.357468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36939894-75c9-46e5-8b75-8a75f1177f68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.365795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36939894-75c9-46e5-8b75-8a75f1177f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:07.367220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36939894-75c9-46e5-8b75-8a75f1177f68 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-36939894-75c9-46e5-8b75-8a75f1177f68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:34:07.381690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:07.382840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:34:07.383966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:34:07.383966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:07.383966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:07.383966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 613/1228] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:07.389414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410431c4-a41d-4e38-af94-489b9b14a6c9 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.488556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410431c4-a41d-4e38-af94-489b9b14a6c9 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.491053 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:07.523456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91af0a-cf54-4eb2-a8ac-87149eb0de27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.524059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91af0a-cf54-4eb2-a8ac-87149eb0de27 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.524371 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91af0a-cf54-4eb2-a8ac-87149eb0de27 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.524649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91af0a-cf54-4eb2-a8ac-87149eb0de27 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.525432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91af0a-cf54-4eb2-a8ac-87149eb0de27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:07.525740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91af0a-cf54-4eb2-a8ac-87149eb0de27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:07.527150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91af0a-cf54-4eb2-a8ac-87149eb0de27 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.538946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 616/1229] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:07.544859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36939894-75c9-46e5-8b75-8a75f1177f68 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.554406 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:07.645658 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36939894-75c9-46e5-8b75-8a75f1177f68 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.678784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c708a71-e01a-499f-8b16-ef536f3c9036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.679416 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c708a71-e01a-499f-8b16-ef536f3c9036 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.679704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c708a71-e01a-499f-8b16-ef536f3c9036 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.679979 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c708a71-e01a-499f-8b16-ef536f3c9036 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.687180 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c708a71-e01a-499f-8b16-ef536f3c9036 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:07.688644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c708a71-e01a-499f-8b16-ef536f3c9036 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.699702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-7c708a71-e01a-499f-8b16-ef536f3c9036 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:34:07.699702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:07.699702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:07.699702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:07.699702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:07.699702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:07.699702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:07.699702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:07.699702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:07.699702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:07.699702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:07.699702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:07.699702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:34:07.699702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:34:07.699702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:07.700825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:07.701954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:34:07.701954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:34:07.701954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:34:07.701954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:34:07.701954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:34:07.701954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:34:07.701954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:34:07.701954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:07.701954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 614/1230] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:34:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:07.706687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91af0a-cf54-4eb2-a8ac-87149eb0de27 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.807291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91af0a-cf54-4eb2-a8ac-87149eb0de27 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.840980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c49bc8-7222-4e9b-9e49-0d2a6071e364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.841580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c49bc8-7222-4e9b-9e49-0d2a6071e364 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.841863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c49bc8-7222-4e9b-9e49-0d2a6071e364 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.842138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c49bc8-7222-4e9b-9e49-0d2a6071e364 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.842827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c49bc8-7222-4e9b-9e49-0d2a6071e364 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:07.843164 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c49bc8-7222-4e9b-9e49-0d2a6071e364 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:07.844629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c49bc8-7222-4e9b-9e49-0d2a6071e364 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.856930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 617/1231] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:34:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:07.863035 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c708a71-e01a-499f-8b16-ef536f3c9036 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.929152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:07.964764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c708a71-e01a-499f-8b16-ef536f3c9036 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.998345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df003b-ac7c-4e89-bd70-33f826fcc9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.998993 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df003b-ac7c-4e89-bd70-33f826fcc9f7 None admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.999270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df003b-ac7c-4e89-bd70-33f826fcc9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.999540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df003b-ac7c-4e89-bd70-33f826fcc9f7 None admin] PATH_INFO: `/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/2991c613878e4993901199434f384f49/roles/5f0de9d8946f41e8a26d355448071297` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:08.014295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df003b-ac7c-4e89-bd70-33f826fcc9f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdd2d14c7e884b8b8f340183a79fd481, user_id=2991c613878e4993901199434f384f49, role_id=5f0de9d8946f41e8a26d355448071297)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:08.015716 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df003b-ac7c-4e89-bd70-33f826fcc9f7 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:08.097918 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 615/1232] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:34:07 2022] PUT /identity/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/2991c613878e4993901199434f384f49/roles/5f0de9d8946f41e8a26d355448071297 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:10.005108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed9915-d14e-4141-a598-af47b0099c16 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:10.005773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed9915-d14e-4141-a598-af47b0099c16 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:10.005773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed9915-d14e-4141-a598-af47b0099c16 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:10.006898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 618/1233] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:10.012162 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089eb37-d190-4d1e-86f0-ee50d4e25e68 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:10.012638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089eb37-d190-4d1e-86f0-ee50d4e25e68 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:10.012735 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089eb37-d190-4d1e-86f0-ee50d4e25e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:10.030625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-0089eb37-d190-4d1e-86f0-ee50d4e25e68 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:10.031815 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-0089eb37-d190-4d1e-86f0-ee50d4e25e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:10.099566 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 616/1234] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:10.375748 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed9915-d14e-4141-a598-af47b0099c16 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:10.402416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:10.479383 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed9915-d14e-4141-a598-af47b0099c16 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:10.513597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55040e6-9ee4-43b9-8521-f0893f29ac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:10.515484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55040e6-9ee4-43b9-8521-f0893f29ac78 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:10.515484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55040e6-9ee4-43b9-8521-f0893f29ac78 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:10.515484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55040e6-9ee4-43b9-8521-f0893f29ac78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:10.524852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55040e6-9ee4-43b9-8521-f0893f29ac78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-d55040e6-9ee4-43b9-8521-f0893f29ac78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:34:10.529644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:10.530978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:10.532217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:10.532217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:10.532217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:10.532217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:10.532217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:34:10.532217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:34:10.532217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:34:10.532217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:34:10.532217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:34:10.532217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:34:10.532217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:34:10.532217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:34:10.532217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 619/1235] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 29 22:34:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:10.537226 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089eb37-d190-4d1e-86f0-ee50d4e25e68 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:10.585438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:10.637599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089eb37-d190-4d1e-86f0-ee50d4e25e68 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:10.671953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fae9bc-7256-4ff8-bf99-eb68399ab16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:10.672587 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fae9bc-7256-4ff8-bf99-eb68399ab16f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:10.672870 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fae9bc-7256-4ff8-bf99-eb68399ab16f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:10.673151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fae9bc-7256-4ff8-bf99-eb68399ab16f None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:10.674065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fae9bc-7256-4ff8-bf99-eb68399ab16f None admin] RBAC: Adding query filter params (name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:10.674372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fae9bc-7256-4ff8-bf99-eb68399ab16f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:10.675726 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fae9bc-7256-4ff8-bf99-eb68399ab16f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:10.684154 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 617/1236] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 29 22:34:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:10.689953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55040e6-9ee4-43b9-8521-f0893f29ac78 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:10.776621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:10.792613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55040e6-9ee4-43b9-8521-f0893f29ac78 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:10.827306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3f3c7-a915-4ded-a336-a097bf312137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:10.827992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3f3c7-a915-4ded-a336-a097bf312137 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:10.828317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3f3c7-a915-4ded-a336-a097bf312137 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:10.828594 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3f3c7-a915-4ded-a336-a097bf312137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:10.839115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3f3c7-a915-4ded-a336-a097bf312137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:10.840649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3f3c7-a915-4ded-a336-a097bf312137 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-89d3f3c7-a915-4ded-a336-a097bf312137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:34:10.855880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:10.857049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:34:10.858180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:34:10.858180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:10.858180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:34:10.858180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 620/1237] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:10.863000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fae9bc-7256-4ff8-bf99-eb68399ab16f None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:10.967267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fae9bc-7256-4ff8-bf99-eb68399ab16f None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:10.976081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:11.001428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe794a-32c8-4dfc-8665-ce326838a0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:11.002031 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe794a-32c8-4dfc-8665-ce326838a0c8 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:11.002315 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe794a-32c8-4dfc-8665-ce326838a0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:11.002590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe794a-32c8-4dfc-8665-ce326838a0c8 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:11.003571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe794a-32c8-4dfc-8665-ce326838a0c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:11.003571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe794a-32c8-4dfc-8665-ce326838a0c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:11.004969 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe794a-32c8-4dfc-8665-ce326838a0c8 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:11.017371 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 618/1238] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:11.023408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3f3c7-a915-4ded-a336-a097bf312137 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:11.124499 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3f3c7-a915-4ded-a336-a097bf312137 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:11.158313 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc72cf-3cbd-4b6f-b656-ca034c8ca716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:11.158927 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc72cf-3cbd-4b6f-b656-ca034c8ca716 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:11.159208 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc72cf-3cbd-4b6f-b656-ca034c8ca716 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:11.159579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc72cf-3cbd-4b6f-b656-ca034c8ca716 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:11.162247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:11.167260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc72cf-3cbd-4b6f-b656-ca034c8ca716 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:11.175019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc72cf-3cbd-4b6f-b656-ca034c8ca716 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-02fc72cf-3cbd-4b6f-b656-ca034c8ca716 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:34:11.179774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:11.180817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:11.181852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:11.181852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:11.181852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:34:11.181852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:34:11.181852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:34:11.181852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:34:11.181852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:34:11.181852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:34:11.181852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:34:11.181852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:34:11.181852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 621/1239] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:11.187565 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe794a-32c8-4dfc-8665-ce326838a0c8 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:11.287398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe794a-32c8-4dfc-8665-ce326838a0c8 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:11.321045 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a170c5-ad72-4c01-b550-9907da12c959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:11.321713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a170c5-ad72-4c01-b550-9907da12c959 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:11.321993 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a170c5-ad72-4c01-b550-9907da12c959 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:11.322268 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a170c5-ad72-4c01-b550-9907da12c959 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:11.323576 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a170c5-ad72-4c01-b550-9907da12c959 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:11.323882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a170c5-ad72-4c01-b550-9907da12c959 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:11.325418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a170c5-ad72-4c01-b550-9907da12c959 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:11.342452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 619/1240] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Aug 29 22:34:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:11.348343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc72cf-3cbd-4b6f-b656-ca034c8ca716 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:11.450768 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc72cf-3cbd-4b6f-b656-ca034c8ca716 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:11.485643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e788d-cba7-42a3-b7b5-72d1f367a5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:11.486272 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e788d-cba7-42a3-b7b5-72d1f367a5ba None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:11.486552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e788d-cba7-42a3-b7b5-72d1f367a5ba None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:11.486863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e788d-cba7-42a3-b7b5-72d1f367a5ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:11.548908 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:11.555355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e788d-cba7-42a3-b7b5-72d1f367a5ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:11.556869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e788d-cba7-42a3-b7b5-72d1f367a5ba None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:11.656669 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 622/1241] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:34:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:34:11.662674 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a170c5-ad72-4c01-b550-9907da12c959 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:11.691706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:11.764103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a170c5-ad72-4c01-b550-9907da12c959 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:11.800186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1875261-8821-478d-b387-4201586138bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:11.800741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1875261-8821-478d-b387-4201586138bf None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:11.801017 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1875261-8821-478d-b387-4201586138bf None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:11.801287 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1875261-8821-478d-b387-4201586138bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:11.815662 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1875261-8821-478d-b387-4201586138bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:11.817160 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1875261-8821-478d-b387-4201586138bf None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-d1875261-8821-478d-b387-4201586138bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:34:11.832514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:11.834130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:34:11.835200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:34:11.835200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:11.835200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:11.835200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 620/1242] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:11.839502 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e788d-cba7-42a3-b7b5-72d1f367a5ba None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:11.954768 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:11.960957 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e788d-cba7-42a3-b7b5-72d1f367a5ba None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:11.996834 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c26402-765d-472f-b785-866cafadccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:11.997486 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c26402-765d-472f-b785-866cafadccd2 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:11.997813 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c26402-765d-472f-b785-866cafadccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:11.998135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c26402-765d-472f-b785-866cafadccd2 None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:11.998813 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c26402-765d-472f-b785-866cafadccd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:11.999151 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c26402-765d-472f-b785-866cafadccd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:12.001543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c26402-765d-472f-b785-866cafadccd2 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:12.022091 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 623/1243] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:12.027805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1875261-8821-478d-b387-4201586138bf None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:12.106487 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:12.127885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1875261-8821-478d-b387-4201586138bf None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:12.161794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0e429-ee4d-4a5e-b9ac-b601acad1cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:12.170030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0e429-ee4d-4a5e-b9ac-b601acad1cfa None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:12.170030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0e429-ee4d-4a5e-b9ac-b601acad1cfa None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:12.170030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0e429-ee4d-4a5e-b9ac-b601acad1cfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:12.170030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0e429-ee4d-4a5e-b9ac-b601acad1cfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:12.171034 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0e429-ee4d-4a5e-b9ac-b601acad1cfa None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:12.182200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-20b0e429-ee4d-4a5e-b9ac-b601acad1cfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:34:12.182200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:12.182200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:12.182200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:12.182200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:12.182200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:12.182200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:12.182200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:12.182200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:12.182200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:12.182200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:12.182200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:12.182200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:34:12.182200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:34:12.182200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:12.183691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:12.184989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:34:12.184989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:34:12.184989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:34:12.184989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:34:12.184989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:34:12.184989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:34:12.184989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:34:12.184989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:12.184989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 621/1244] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:34:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:34:12.189144 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c26402-765d-472f-b785-866cafadccd2 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:12.290131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c26402-765d-472f-b785-866cafadccd2 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:12.323994 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff96d8-bf1a-4d03-92c8-0f5229950a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:12.324626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff96d8-bf1a-4d03-92c8-0f5229950a75 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:12.324895 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff96d8-bf1a-4d03-92c8-0f5229950a75 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:12.325235 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff96d8-bf1a-4d03-92c8-0f5229950a75 None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:12.325847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff96d8-bf1a-4d03-92c8-0f5229950a75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:12.326148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff96d8-bf1a-4d03-92c8-0f5229950a75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:12.327566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff96d8-bf1a-4d03-92c8-0f5229950a75 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:12.339904 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 624/1245] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:34:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:12.346166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0e429-ee4d-4a5e-b9ac-b601acad1cfa None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:12.448996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0e429-ee4d-4a5e-b9ac-b601acad1cfa None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:12.482024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aa337-d2a6-4cca-a03b-75fb503e76f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:12.482614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aa337-d2a6-4cca-a03b-75fb503e76f6 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:12.482891 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aa337-d2a6-4cca-a03b-75fb503e76f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:12.483156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aa337-d2a6-4cca-a03b-75fb503e76f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:12.483863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5aa337-d2a6-4cca-a03b-75fb503e76f6 None admin] RBAC: Adding query filter params (role.id=5f0de9d8946f41e8a26d355448071297, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=2991c613878e4993901199434f384f49) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:12.484194 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5aa337-d2a6-4cca-a03b-75fb503e76f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:12.485600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5aa337-d2a6-4cca-a03b-75fb503e76f6 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:12.491281 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 622/1246] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:34:12 2022] GET /identity/v3/role_assignments?user.id=2991c613878e4993901199434f384f49&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=5f0de9d8946f41e8a26d355448071297 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:14.468060 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09ee87-782e-4f1a-9930-4c46410500f1 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:14.468687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09ee87-782e-4f1a-9930-4c46410500f1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:14.468687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09ee87-782e-4f1a-9930-4c46410500f1 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:14.469952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 625/1247] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:14.475195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59af1d-625a-4635-9325-49323e3cf14c None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:14.475614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59af1d-625a-4635-9325-49323e3cf14c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:14.475745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59af1d-625a-4635-9325-49323e3cf14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:14.482075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:14.494142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-7e59af1d-625a-4635-9325-49323e3cf14c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:14.495392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-7e59af1d-625a-4635-9325-49323e3cf14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:14.561633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 623/1248] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:14.833853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09ee87-782e-4f1a-9930-4c46410500f1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:14.851992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:14.936511 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09ee87-782e-4f1a-9930-4c46410500f1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:14.971710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec232e2-9059-4284-bfe9-e6f33b3bce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:14.972360 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec232e2-9059-4284-bfe9-e6f33b3bce46 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:14.972639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec232e2-9059-4284-bfe9-e6f33b3bce46 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:14.972911 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec232e2-9059-4284-bfe9-e6f33b3bce46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:14.982802 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec232e2-9059-4284-bfe9-e6f33b3bce46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-cec232e2-9059-4284-bfe9-e6f33b3bce46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:34:14.987600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:14.988798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:14.989789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:14.989789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:14.989789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:14.989789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:14.989789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:34:14.989789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:34:14.989789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:34:14.989789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:34:14.989789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:34:14.989789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:34:14.989789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:14.989789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:34:14.989789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 626/1249] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:34:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:14.995558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59af1d-625a-4635-9325-49323e3cf14c None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:15.096375 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59af1d-625a-4635-9325-49323e3cf14c None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:15.128285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:15.133455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa4c1d-c17d-4171-ab2f-904ddf9dbceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:15.134104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa4c1d-c17d-4171-ab2f-904ddf9dbceb None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:15.134435 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa4c1d-c17d-4171-ab2f-904ddf9dbceb None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:15.134710 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa4c1d-c17d-4171-ab2f-904ddf9dbceb None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:15.136002 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa4c1d-c17d-4171-ab2f-904ddf9dbceb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:15.136341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa4c1d-c17d-4171-ab2f-904ddf9dbceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:15.137763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa4c1d-c17d-4171-ab2f-904ddf9dbceb None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:15.146007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 624/1250] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:34:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:34:15.152036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec232e2-9059-4284-bfe9-e6f33b3bce46 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:15.230814 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:15.253657 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec232e2-9059-4284-bfe9-e6f33b3bce46 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:15.286352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848220c-79ee-4318-94f2-c4ffcb7417ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:15.286973 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848220c-79ee-4318-94f2-c4ffcb7417ce None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:15.287254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848220c-79ee-4318-94f2-c4ffcb7417ce None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:15.287537 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848220c-79ee-4318-94f2-c4ffcb7417ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:15.297888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848220c-79ee-4318-94f2-c4ffcb7417ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:15.299584 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848220c-79ee-4318-94f2-c4ffcb7417ce None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-1848220c-79ee-4318-94f2-c4ffcb7417ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:34:15.315301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:15.316476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:34:15.317385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:34:15.317385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:15.317385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:34:15.317385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 627/1251] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:15.322643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa4c1d-c17d-4171-ab2f-904ddf9dbceb None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:15.422507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa4c1d-c17d-4171-ab2f-904ddf9dbceb None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:15.455953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77e8ed-cf63-479d-81c0-46993df5d1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:15.456626 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77e8ed-cf63-479d-81c0-46993df5d1c0 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:15.456904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77e8ed-cf63-479d-81c0-46993df5d1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:15.457179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77e8ed-cf63-479d-81c0-46993df5d1c0 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:15.457819 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77e8ed-cf63-479d-81c0-46993df5d1c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:15.458125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77e8ed-cf63-479d-81c0-46993df5d1c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:15.459486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77e8ed-cf63-479d-81c0-46993df5d1c0 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:15.471268 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 625/1252] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:15.477111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848220c-79ee-4318-94f2-c4ffcb7417ce None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:15.577852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848220c-79ee-4318-94f2-c4ffcb7417ce None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:15.605132 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:15.612888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded83da8-34ac-4ad1-a02d-d4d9407f5fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:15.613514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded83da8-34ac-4ad1-a02d-d4d9407f5fd3 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:15.613871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded83da8-34ac-4ad1-a02d-d4d9407f5fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:15.614310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded83da8-34ac-4ad1-a02d-d4d9407f5fd3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:15.624201 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded83da8-34ac-4ad1-a02d-d4d9407f5fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:15.625641 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded83da8-34ac-4ad1-a02d-d4d9407f5fd3 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-ded83da8-34ac-4ad1-a02d-d4d9407f5fd3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:34:15.636635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:15.637580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:15.638949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:15.638949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:15.638949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:34:15.638949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:34:15.638949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:34:15.638949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:34:15.638949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:34:15.638949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:34:15.638949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:34:15.638949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:34:15.638949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 628/1253] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:15.643617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77e8ed-cf63-479d-81c0-46993df5d1c0 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:15.700178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:15.743344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77e8ed-cf63-479d-81c0-46993df5d1c0 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:15.779055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f8760-78f7-4889-9d16-06dd40cf7ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:15.779659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f8760-78f7-4889-9d16-06dd40cf7ced None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:15.779939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f8760-78f7-4889-9d16-06dd40cf7ced None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:15.780246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f8760-78f7-4889-9d16-06dd40cf7ced None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:15.780978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f8760-78f7-4889-9d16-06dd40cf7ced None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:15.781284 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f8760-78f7-4889-9d16-06dd40cf7ced None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:15.782714 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f8760-78f7-4889-9d16-06dd40cf7ced None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:15.800888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 626/1254] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Aug 29 22:34:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:15.807129 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded83da8-34ac-4ad1-a02d-d4d9407f5fd3 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:15.908900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded83da8-34ac-4ad1-a02d-d4d9407f5fd3 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:15.941608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56079540-26cb-4c12-915b-7db8990745b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:15.942205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56079540-26cb-4c12-915b-7db8990745b1 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:15.942481 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56079540-26cb-4c12-915b-7db8990745b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:15.942753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56079540-26cb-4c12-915b-7db8990745b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:15.998895 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:16.011525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56079540-26cb-4c12-915b-7db8990745b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:16.013016 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56079540-26cb-4c12-915b-7db8990745b1 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:16.112959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 629/1255] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:34:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:34:16.118862 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f8760-78f7-4889-9d16-06dd40cf7ced None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:16.220306 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f8760-78f7-4889-9d16-06dd40cf7ced None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:16.233818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:16.255012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c4ef3-0431-4e4f-80d2-e78858759bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:16.255554 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c4ef3-0431-4e4f-80d2-e78858759bf0 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:16.255811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c4ef3-0431-4e4f-80d2-e78858759bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:16.256107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c4ef3-0431-4e4f-80d2-e78858759bf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:16.266595 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c4ef3-0431-4e4f-80d2-e78858759bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:16.269059 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c4ef3-0431-4e4f-80d2-e78858759bf0 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-397c4ef3-0431-4e4f-80d2-e78858759bf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:34:16.283905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:16.285083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:34:16.286006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:34:16.286006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:16.286006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:16.286006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 627/1256] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:16.291214 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56079540-26cb-4c12-915b-7db8990745b1 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:16.378775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:16.390669 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56079540-26cb-4c12-915b-7db8990745b1 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:16.424732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c72b1-26c5-48a0-a954-e439884444fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:16.425366 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c72b1-26c5-48a0-a954-e439884444fa None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:16.425643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c72b1-26c5-48a0-a954-e439884444fa None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:16.425912 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c72b1-26c5-48a0-a954-e439884444fa None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:16.426545 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c72b1-26c5-48a0-a954-e439884444fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:16.426842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c72b1-26c5-48a0-a954-e439884444fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:16.428227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c72b1-26c5-48a0-a954-e439884444fa None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:16.439924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 630/1257] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:16.445956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c4ef3-0431-4e4f-80d2-e78858759bf0 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:16.547048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c4ef3-0431-4e4f-80d2-e78858759bf0 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:16.581309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac7a64-612a-4f45-b0e0-704412a9795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:16.581939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac7a64-612a-4f45-b0e0-704412a9795d None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:16.582218 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac7a64-612a-4f45-b0e0-704412a9795d None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:16.582497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac7a64-612a-4f45-b0e0-704412a9795d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:16.589747 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac7a64-612a-4f45-b0e0-704412a9795d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:16.591181 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac7a64-612a-4f45-b0e0-704412a9795d None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:16.602590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-42ac7a64-612a-4f45-b0e0-704412a9795d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:34:16.602590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:16.602590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:16.602590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:16.602590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:16.602590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:16.602590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:16.602590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:16.602590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:16.602590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:16.602590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:16.602590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:16.602590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:34:16.602590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:34:16.602590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:16.603617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:16.604617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:34:16.604617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:34:16.604617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:34:16.604617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:34:16.604617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:34:16.604617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:34:16.604617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:34:16.604617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:16.604617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 628/1258] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:34:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:16.609927 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c72b1-26c5-48a0-a954-e439884444fa None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:16.711906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c72b1-26c5-48a0-a954-e439884444fa None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:16.745830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c08a5d-f1a1-4c95-a1f7-72ed1912d24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:16.746440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c08a5d-f1a1-4c95-a1f7-72ed1912d24d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:16.746711 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c08a5d-f1a1-4c95-a1f7-72ed1912d24d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:16.746982 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c08a5d-f1a1-4c95-a1f7-72ed1912d24d None admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:16.747668 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c08a5d-f1a1-4c95-a1f7-72ed1912d24d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:16.747972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c08a5d-f1a1-4c95-a1f7-72ed1912d24d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:16.749437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c08a5d-f1a1-4c95-a1f7-72ed1912d24d None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:16.761472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 631/1259] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:34:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:16.767841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac7a64-612a-4f45-b0e0-704412a9795d None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:16.794256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:16.865792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac7a64-612a-4f45-b0e0-704412a9795d None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:16.901501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e61070-cf49-4af7-9ad3-b387e4e143e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:16.902153 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e61070-cf49-4af7-9ad3-b387e4e143e0 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:16.902432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e61070-cf49-4af7-9ad3-b387e4e143e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:16.902704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e61070-cf49-4af7-9ad3-b387e4e143e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:16.903427 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e61070-cf49-4af7-9ad3-b387e4e143e0 None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=2991c613878e4993901199434f384f49) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:16.903737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e61070-cf49-4af7-9ad3-b387e4e143e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:16.905181 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e61070-cf49-4af7-9ad3-b387e4e143e0 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:16.910502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 629/1260] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:34:16 2022] GET /identity/v3/role_assignments?user.id=2991c613878e4993901199434f384f49&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=a7d59d2982de4bfeb758dce70808029f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:18.813323 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676cf73-f6bf-47cc-bf16-9ab01046aed8 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:18.813955 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676cf73-f6bf-47cc-bf16-9ab01046aed8 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:18.813955 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676cf73-f6bf-47cc-bf16-9ab01046aed8 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:18.815355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 632/1261] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:34:18.821497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e626c8-1023-4432-b7b2-deb60cf5ecbc None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:18.821962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e626c8-1023-4432-b7b2-deb60cf5ecbc None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:18.829945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e626c8-1023-4432-b7b2-deb60cf5ecbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:18.843557 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-c4e626c8-1023-4432-b7b2-deb60cf5ecbc None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:18.844690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-c4e626c8-1023-4432-b7b2-deb60cf5ecbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:18.915378 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 630/1262] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:19.185320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676cf73-f6bf-47cc-bf16-9ab01046aed8 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:19.196778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:19.298633 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676cf73-f6bf-47cc-bf16-9ab01046aed8 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:19.337169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5639b34-c851-47af-807e-796dbe91840d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:19.337849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5639b34-c851-47af-807e-796dbe91840d None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:19.338136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5639b34-c851-47af-807e-796dbe91840d None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:19.338408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5639b34-c851-47af-807e-796dbe91840d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:19.349149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5639b34-c851-47af-807e-796dbe91840d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-e5639b34-c851-47af-807e-796dbe91840d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:34:19.353972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:19.354938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:19.355910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:19.355910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:19.355910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:19.355910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:19.355910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:34:19.355910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:34:19.355910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:34:19.355910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:34:19.355910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:34:19.355910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:34:19.355910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:19.355910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:34:19.355910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 633/1263] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:34:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:19.361503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e626c8-1023-4432-b7b2-deb60cf5ecbc None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:19.381963 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:19.472647 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e626c8-1023-4432-b7b2-deb60cf5ecbc None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:19.507860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a061bb-29fe-470a-8108-71a4ebd5f738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:19.508504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a061bb-29fe-470a-8108-71a4ebd5f738 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:19.509013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a061bb-29fe-470a-8108-71a4ebd5f738 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:19.509013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a061bb-29fe-470a-8108-71a4ebd5f738 None admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:19.509685 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a061bb-29fe-470a-8108-71a4ebd5f738 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:19.510614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a061bb-29fe-470a-8108-71a4ebd5f738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:19.511981 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a061bb-29fe-470a-8108-71a4ebd5f738 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:19.523973 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 631/1264] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:34:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:19.530371 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5639b34-c851-47af-807e-796dbe91840d None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:19.603498 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:19.637730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5639b34-c851-47af-807e-796dbe91840d None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:19.675492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d3ee8-1643-4f39-8514-f689e356c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:19.676150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d3ee8-1643-4f39-8514-f689e356c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:19.676435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d3ee8-1643-4f39-8514-f689e356c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:19.676824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d3ee8-1643-4f39-8514-f689e356c9a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:19.688179 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d3ee8-1643-4f39-8514-f689e356c9a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:19.689951 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d3ee8-1643-4f39-8514-f689e356c9a3 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-884d3ee8-1643-4f39-8514-f689e356c9a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:34:19.704874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:19.707153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:34:19.708291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:34:19.708291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:19.708291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:34:19.708291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 634/1265] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:34:19.712336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a061bb-29fe-470a-8108-71a4ebd5f738 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:19.803241 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:19.823716 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a061bb-29fe-470a-8108-71a4ebd5f738 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:19.858302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d1eef-948b-4d3b-abb7-c401f9bca8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:19.858911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d1eef-948b-4d3b-abb7-c401f9bca8fd None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:19.859197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d1eef-948b-4d3b-abb7-c401f9bca8fd None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:19.859470 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d1eef-948b-4d3b-abb7-c401f9bca8fd None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:19.860136 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d1eef-948b-4d3b-abb7-c401f9bca8fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:19.860464 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d1eef-948b-4d3b-abb7-c401f9bca8fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:19.861800 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d1eef-948b-4d3b-abb7-c401f9bca8fd None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:19.875264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 632/1266] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:19.881320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d3ee8-1643-4f39-8514-f689e356c9a3 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:19.989205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d3ee8-1643-4f39-8514-f689e356c9a3 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:20.013524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:20.029418 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a539b46-e1ea-4963-b6fc-94eec6691f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:20.030069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a539b46-e1ea-4963-b6fc-94eec6691f9e None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:20.030348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a539b46-e1ea-4963-b6fc-94eec6691f9e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:20.030641 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a539b46-e1ea-4963-b6fc-94eec6691f9e None admin] PATH_INFO: `/v3/users/placement` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:20.038408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a539b46-e1ea-4963-b6fc-94eec6691f9e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:20.039978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a539b46-e1ea-4963-b6fc-94eec6691f9e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-2a539b46-e1ea-4963-b6fc-94eec6691f9e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:34:20.052257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:20.058647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:20.059699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:20.059699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:20.059699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:34:20.059699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:34:20.059699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:34:20.059699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:34:20.059699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:34:20.059699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:34:20.059699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:34:20.059699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:34:20.059699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 635/1267] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:20.061016 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d1eef-948b-4d3b-abb7-c401f9bca8fd None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:20.167528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d1eef-948b-4d3b-abb7-c401f9bca8fd None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:20.204977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db1b27-95da-4c87-896f-fccdf385f345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:20.205678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db1b27-95da-4c87-896f-fccdf385f345 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:20.205959 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db1b27-95da-4c87-896f-fccdf385f345 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:20.206234 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db1b27-95da-4c87-896f-fccdf385f345 None admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:20.207119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db1b27-95da-4c87-896f-fccdf385f345 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:20.207409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db1b27-95da-4c87-896f-fccdf385f345 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:20.208929 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db1b27-95da-4c87-896f-fccdf385f345 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:20.219789 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:20.230171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 633/1268] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Aug 29 22:34:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:20.236292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a539b46-e1ea-4963-b6fc-94eec6691f9e None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:20.345933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a539b46-e1ea-4963-b6fc-94eec6691f9e None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:20.379652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01ad80-8780-4fbb-88e1-2b95abf538e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:20.380298 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01ad80-8780-4fbb-88e1-2b95abf538e9 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:20.380997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01ad80-8780-4fbb-88e1-2b95abf538e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:20.380997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01ad80-8780-4fbb-88e1-2b95abf538e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:20.391806 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01ad80-8780-4fbb-88e1-2b95abf538e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:20.393281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01ad80-8780-4fbb-88e1-2b95abf538e9 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-4b01ad80-8780-4fbb-88e1-2b95abf538e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:34:20.408170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:20.409402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:34:20.410415 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:34:20.410415 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:20.410415 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:34:20.410415 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 636/1269] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:20.415300 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db1b27-95da-4c87-896f-fccdf385f345 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:20.516443 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db1b27-95da-4c87-896f-fccdf385f345 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:20.553044 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde5fcf-32b9-4906-8107-e788fd72c014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:20.553650 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde5fcf-32b9-4906-8107-e788fd72c014 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:20.553931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde5fcf-32b9-4906-8107-e788fd72c014 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:20.554204 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde5fcf-32b9-4906-8107-e788fd72c014 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:20.554845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde5fcf-32b9-4906-8107-e788fd72c014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:20.555148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde5fcf-32b9-4906-8107-e788fd72c014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:20.556542 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde5fcf-32b9-4906-8107-e788fd72c014 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:20.568271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 634/1270] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:34:20.574823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01ad80-8780-4fbb-88e1-2b95abf538e9 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:20.608375 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:20.675868 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01ad80-8780-4fbb-88e1-2b95abf538e9 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:20.712291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde4887-1bdb-4738-860a-fabd6af17172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:20.713578 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde4887-1bdb-4738-860a-fabd6af17172 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:20.713903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde4887-1bdb-4738-860a-fabd6af17172 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:20.714183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde4887-1bdb-4738-860a-fabd6af17172 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:20.721780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde4887-1bdb-4738-860a-fabd6af17172 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:20.723254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde4887-1bdb-4738-860a-fabd6af17172 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:20.735267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-efde4887-1bdb-4738-860a-fabd6af17172 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:34:20.735267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:20.735267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:20.735267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:20.735267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:20.735267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:20.735267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:20.735267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:20.735267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:20.735267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:20.735267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:20.735267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:20.735267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:34:20.735267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:34:20.735267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:20.736405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:20.737512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:34:20.737512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:34:20.737512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:34:20.737512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:34:20.737512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:34:20.737512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:34:20.737512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:34:20.737512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:34:20.737512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 637/1271] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:34:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:20.742741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde5fcf-32b9-4906-8107-e788fd72c014 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:20.805453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:20.847668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde5fcf-32b9-4906-8107-e788fd72c014 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:20.883555 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ec3a1-40a2-497e-9acf-a90872c5dd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:20.884123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ec3a1-40a2-497e-9acf-a90872c5dd4f None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:20.884394 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ec3a1-40a2-497e-9acf-a90872c5dd4f None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:20.884666 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ec3a1-40a2-497e-9acf-a90872c5dd4f None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:20.885937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ec3a1-40a2-497e-9acf-a90872c5dd4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:20.886243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ec3a1-40a2-497e-9acf-a90872c5dd4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:20.887659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ec3a1-40a2-497e-9acf-a90872c5dd4f None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:20.900667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 635/1272] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:34:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:20.907135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde4887-1bdb-4738-860a-fabd6af17172 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:21.002035 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:21.011580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde4887-1bdb-4738-860a-fabd6af17172 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:21.045310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b19b5b-7e06-4d15-80d2-5215eb955643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:21.045972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b19b5b-7e06-4d15-80d2-5215eb955643 None admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:21.046254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b19b5b-7e06-4d15-80d2-5215eb955643 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:21.046528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b19b5b-7e06-4d15-80d2-5215eb955643 None admin] PATH_INFO: `/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/2991c613878e4993901199434f384f49/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:21.048784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b19b5b-7e06-4d15-80d2-5215eb955643 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdd2d14c7e884b8b8f340183a79fd481, user_id=2991c613878e4993901199434f384f49, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:21.050219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b19b5b-7e06-4d15-80d2-5215eb955643 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:21.224148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 638/1273] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 29 22:34:20 2022] PUT /identity/v3/projects/fdd2d14c7e884b8b8f340183a79fd481/users/2991c613878e4993901199434f384f49/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:23.129970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e8321-86a9-4946-99d1-c40604d1cccc None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:23.130544 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e8321-86a9-4946-99d1-c40604d1cccc None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:23.130544 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e8321-86a9-4946-99d1-c40604d1cccc None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:23.131907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 636/1274] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:23.137116 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a019a9-937b-47a6-bb6b-1adeb563fa4b None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:23.137564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a019a9-937b-47a6-bb6b-1adeb563fa4b None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:23.137748 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a019a9-937b-47a6-bb6b-1adeb563fa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:23.156494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-10a019a9-937b-47a6-bb6b-1adeb563fa4b None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:23.159010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-10a019a9-937b-47a6-bb6b-1adeb563fa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:23.225198 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 639/1275] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:23.496129 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e8321-86a9-4946-99d1-c40604d1cccc None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:23.599076 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e8321-86a9-4946-99d1-c40604d1cccc None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:23.617444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:23.633686 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5383a-f4a1-4062-9b54-34bea8ceb899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:23.634305 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5383a-f4a1-4062-9b54-34bea8ceb899 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:23.635099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5383a-f4a1-4062-9b54-34bea8ceb899 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:23.635369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5383a-f4a1-4062-9b54-34bea8ceb899 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:23.645177 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5383a-f4a1-4062-9b54-34bea8ceb899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-a7e5383a-f4a1-4062-9b54-34bea8ceb899 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:34:23.649908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:23.651080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:23.652012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:23.652012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:23.652012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:23.652012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:23.652012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:34:23.652012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:34:23.652012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:34:23.652012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:34:23.652012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:34:23.652012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:34:23.652012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:23.652012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:23.652012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 637/1276] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 29 22:34:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:23.661295 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a019a9-937b-47a6-bb6b-1adeb563fa4b None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:23.739620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:23.759250 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a019a9-937b-47a6-bb6b-1adeb563fa4b None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:23.793851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d61396-835e-4196-ba37-d1b3fdd8304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:23.794468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61396-835e-4196-ba37-d1b3fdd8304f None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:23.794744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61396-835e-4196-ba37-d1b3fdd8304f None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:23.795017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61396-835e-4196-ba37-d1b3fdd8304f None admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:23.795691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d61396-835e-4196-ba37-d1b3fdd8304f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:23.795995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d61396-835e-4196-ba37-d1b3fdd8304f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:23.797389 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d61396-835e-4196-ba37-d1b3fdd8304f None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:23.806335 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 640/1277] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 29 22:34:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:23.812315 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5383a-f4a1-4062-9b54-34bea8ceb899 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:23.914996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5383a-f4a1-4062-9b54-34bea8ceb899 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:23.950211 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ead1e-18f2-4a0b-af6a-9b5ae28c37a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:23.955100 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ead1e-18f2-4a0b-af6a-9b5ae28c37a1 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:23.962338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ead1e-18f2-4a0b-af6a-9b5ae28c37a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:23.962338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ead1e-18f2-4a0b-af6a-9b5ae28c37a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:23.968384 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ead1e-18f2-4a0b-af6a-9b5ae28c37a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:23.969849 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ead1e-18f2-4a0b-af6a-9b5ae28c37a1 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-507ead1e-18f2-4a0b-af6a-9b5ae28c37a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:34:23.984482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:23.985632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:34:23.986769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:34:23.986769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:23.986769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:23.986769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 638/1278] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:23.992213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d61396-835e-4196-ba37-d1b3fdd8304f None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:24.099284 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d61396-835e-4196-ba37-d1b3fdd8304f None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:24.136037 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79ad09-7322-4494-8bc7-582958041dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:24.136745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79ad09-7322-4494-8bc7-582958041dad None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:24.137027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79ad09-7322-4494-8bc7-582958041dad None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:24.137304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79ad09-7322-4494-8bc7-582958041dad None admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:24.137948 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79ad09-7322-4494-8bc7-582958041dad None admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:24.138252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79ad09-7322-4494-8bc7-582958041dad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:24.139629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79ad09-7322-4494-8bc7-582958041dad None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:24.151442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 641/1279] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:24.157492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ead1e-18f2-4a0b-af6a-9b5ae28c37a1 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:24.191100 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:24.261203 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ead1e-18f2-4a0b-af6a-9b5ae28c37a1 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:24.295662 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a38dfe-0c28-412e-b22a-d56d40a7c5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:24.296408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a38dfe-0c28-412e-b22a-d56d40a7c5dd None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:24.296691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a38dfe-0c28-412e-b22a-d56d40a7c5dd None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:24.296964 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a38dfe-0c28-412e-b22a-d56d40a7c5dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:24.305587 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a38dfe-0c28-412e-b22a-d56d40a7c5dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:24.307812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a38dfe-0c28-412e-b22a-d56d40a7c5dd None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-31a38dfe-0c28-412e-b22a-d56d40a7c5dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:34:24.318763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:24.320907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:24.322087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:24.322087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:24.322087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:34:24.322087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:34:24.322087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:34:24.322087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:34:24.322087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:34:24.322087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:34:24.322087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:34:24.322087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:24.322087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 639/1280] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:24.325977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79ad09-7322-4494-8bc7-582958041dad None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:24.329800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:24.426871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79ad09-7322-4494-8bc7-582958041dad None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:24.462260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee8ecb-387c-427a-a135-de70bae62a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:24.462860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee8ecb-387c-427a-a135-de70bae62a75 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:24.463143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee8ecb-387c-427a-a135-de70bae62a75 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:24.463442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee8ecb-387c-427a-a135-de70bae62a75 None admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:24.464360 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee8ecb-387c-427a-a135-de70bae62a75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:24.464573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee8ecb-387c-427a-a135-de70bae62a75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:24.466061 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee8ecb-387c-427a-a135-de70bae62a75 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:24.484162 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 642/1281] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Aug 29 22:34:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:24.490090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a38dfe-0c28-412e-b22a-d56d40a7c5dd None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:24.582708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:24.595220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a38dfe-0c28-412e-b22a-d56d40a7c5dd None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:24.630248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bce38-d5ba-4af2-b23a-76378fbf7739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:24.630843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bce38-d5ba-4af2-b23a-76378fbf7739 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:24.631165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bce38-d5ba-4af2-b23a-76378fbf7739 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:24.631386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bce38-d5ba-4af2-b23a-76378fbf7739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:24.700378 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9bce38-d5ba-4af2-b23a-76378fbf7739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:24.701849 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9bce38-d5ba-4af2-b23a-76378fbf7739 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:24.790574 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:24.802850 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 640/1282] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 29 22:34:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:34:24.808836 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee8ecb-387c-427a-a135-de70bae62a75 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:24.874335 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:24.914907 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee8ecb-387c-427a-a135-de70bae62a75 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:24.952322 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e33ae-555f-4690-8485-77d48218ba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:24.952882 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e33ae-555f-4690-8485-77d48218ba11 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:24.953159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e33ae-555f-4690-8485-77d48218ba11 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:24.953429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e33ae-555f-4690-8485-77d48218ba11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:24.964263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e33ae-555f-4690-8485-77d48218ba11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:24.968507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e33ae-555f-4690-8485-77d48218ba11 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-f12e33ae-555f-4690-8485-77d48218ba11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:34:24.979936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:24.980983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:34:24.982000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:34:24.982000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:34:24.982000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:34:24.982000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 643/1283] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:24.987149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bce38-d5ba-4af2-b23a-76378fbf7739 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:25.094598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bce38-d5ba-4af2-b23a-76378fbf7739 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:25.128973 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996290c9-5fa1-44f4-bc46-2506bea1e2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:25.129580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996290c9-5fa1-44f4-bc46-2506bea1e2e1 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:25.129862 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996290c9-5fa1-44f4-bc46-2506bea1e2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:25.130289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996290c9-5fa1-44f4-bc46-2506bea1e2e1 None admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:25.130855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996290c9-5fa1-44f4-bc46-2506bea1e2e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:25.131161 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996290c9-5fa1-44f4-bc46-2506bea1e2e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:25.132558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996290c9-5fa1-44f4-bc46-2506bea1e2e1 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:25.144713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 641/1284] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 29 22:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:25.151508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e33ae-555f-4690-8485-77d48218ba11 None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:25.252394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e33ae-555f-4690-8485-77d48218ba11 None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:25.266694 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:25.287394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504550b9-59d5-4b21-b329-550dc7c7930a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:25.288029 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504550b9-59d5-4b21-b329-550dc7c7930a None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:25.288350 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504550b9-59d5-4b21-b329-550dc7c7930a None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:25.288623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504550b9-59d5-4b21-b329-550dc7c7930a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:25.295196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504550b9-59d5-4b21-b329-550dc7c7930a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:25.300822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504550b9-59d5-4b21-b329-550dc7c7930a None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:25.308869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application [None req-504550b9-59d5-4b21-b329-550dc7c7930a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:34:25.308869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:25.308869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:25.308869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:25.308869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:25.308869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:25.308869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:25.308869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:25.308869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:25.308869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:25.308869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:25.308869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:25.308869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:34:25.308869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:34:25.308869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:25.309755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:25.310663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:34:25.310663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:34:25.310663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:34:25.310663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:34:25.310663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:34:25.310663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:34:25.310663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:34:25.310663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: ERROR keystone.server.flask.application Aug 29 22:34:25.310663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 644/1285] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 29 22:34:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:25.316162 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996290c9-5fa1-44f4-bc46-2506bea1e2e1 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:25.366939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:25.417196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996290c9-5fa1-44f4-bc46-2506bea1e2e1 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:25.451873 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300eb19-6b7e-4402-8788-bf48312679c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:25.452495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300eb19-6b7e-4402-8788-bf48312679c2 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:25.452824 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300eb19-6b7e-4402-8788-bf48312679c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:25.453038 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300eb19-6b7e-4402-8788-bf48312679c2 None admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:25.453715 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300eb19-6b7e-4402-8788-bf48312679c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:25.454016 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300eb19-6b7e-4402-8788-bf48312679c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:25.455431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300eb19-6b7e-4402-8788-bf48312679c2 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:25.467601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 642/1286] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 29 22:34:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:25.473864 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504550b9-59d5-4b21-b329-550dc7c7930a None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:25.575176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504550b9-59d5-4b21-b329-550dc7c7930a None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:25.609838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535feec-173d-4501-942a-77d29ff5571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:25.610475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535feec-173d-4501-942a-77d29ff5571b None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:25.610757 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535feec-173d-4501-942a-77d29ff5571b None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:25.611028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535feec-173d-4501-942a-77d29ff5571b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:25.611758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535feec-173d-4501-942a-77d29ff5571b None admin] RBAC: Adding query filter params (role.id=a7d59d2982de4bfeb758dce70808029f, scope.project.id=fdd2d14c7e884b8b8f340183a79fd481, user.id=2991c613878e4993901199434f384f49) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:25.612064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535feec-173d-4501-942a-77d29ff5571b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:25.613562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535feec-173d-4501-942a-77d29ff5571b None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:25.620224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 645/1287] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 29 22:34:25 2022] GET /identity/v3/role_assignments?user.id=2991c613878e4993901199434f384f49&scope.project.id=fdd2d14c7e884b8b8f340183a79fd481&role.id=a7d59d2982de4bfeb758dce70808029f => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:27.563331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abe340-ffde-4d07-ab3e-7672373cd18b None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:27.563894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abe340-ffde-4d07-ab3e-7672373cd18b None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:27.563894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abe340-ffde-4d07-ab3e-7672373cd18b None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:27.565225 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 643/1288] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:27.570473 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a159f-6da0-4dff-a017-2323551a2dd2 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:27.570899 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a159f-6da0-4dff-a017-2323551a2dd2 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:27.571029 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a159f-6da0-4dff-a017-2323551a2dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:27.590221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-071a159f-6da0-4dff-a017-2323551a2dd2 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:27.591447 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-071a159f-6da0-4dff-a017-2323551a2dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:27.622743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:27.660075 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 646/1289] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:27.924704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abe340-ffde-4d07-ab3e-7672373cd18b None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:28.031997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abe340-ffde-4d07-ab3e-7672373cd18b None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:28.042771 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:28.069710 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae5372-6c6d-491d-85ad-36b073ae5fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:28.070369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae5372-6c6d-491d-85ad-36b073ae5fcd None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:28.070661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae5372-6c6d-491d-85ad-36b073ae5fcd None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:28.070911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae5372-6c6d-491d-85ad-36b073ae5fcd None admin] PATH_INFO: `/v3/services/placement` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:28.071577 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae5372-6c6d-491d-85ad-36b073ae5fcd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:28.073549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae5372-6c6d-491d-85ad-36b073ae5fcd None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-f6ae5372-6c6d-491d-85ad-36b073ae5fcd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:28.083603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:28.084923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:28.085809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:28.085809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:28.085809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:28.085809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:28.085809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:28.085809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:28.085809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:28.085809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:28.085809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:28.085809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:28.085809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:34:28.085809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:34:28.085809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:34:28.085809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:28.085809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 644/1290] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 29 22:34:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:28.091963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a159f-6da0-4dff-a017-2323551a2dd2 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:28.206912 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a159f-6da0-4dff-a017-2323551a2dd2 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:28.244133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b6379-f89e-4e02-9c2b-ddb460d01b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:28.244778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b6379-f89e-4e02-9c2b-ddb460d01b98 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:28.245062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b6379-f89e-4e02-9c2b-ddb460d01b98 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:28.245339 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b6379-f89e-4e02-9c2b-ddb460d01b98 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:28.245995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b6379-f89e-4e02-9c2b-ddb460d01b98 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:28.246335 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b6379-f89e-4e02-9c2b-ddb460d01b98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:28.247767 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b6379-f89e-4e02-9c2b-ddb460d01b98 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:28.253655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 647/1291] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Aug 29 22:34:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:28.261670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae5372-6c6d-491d-85ad-36b073ae5fcd None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:28.397670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae5372-6c6d-491d-85ad-36b073ae5fcd None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:28.434758 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ae14b-583e-4066-980c-a7e870f35642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:28.435359 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ae14b-583e-4066-980c-a7e870f35642 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:28.435639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ae14b-583e-4066-980c-a7e870f35642 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:28.435911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ae14b-583e-4066-980c-a7e870f35642 None admin] PATH_INFO: `/v3/services` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:28.436647 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ae14b-583e-4066-980c-a7e870f35642 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:28.436960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ae14b-583e-4066-980c-a7e870f35642 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:28.438412 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ae14b-583e-4066-980c-a7e870f35642 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:28.443292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 645/1292] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Aug 29 22:34:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:30.375455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c2d04-e5df-4f88-be23-86383af118c6 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.376111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c2d04-e5df-4f88-be23-86383af118c6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.376111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c2d04-e5df-4f88-be23-86383af118c6 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.377335 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 648/1293] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:30.382500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0642a0-c9dd-4fa6-8172-7532bd44dbe3 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.382918 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0642a0-c9dd-4fa6-8172-7532bd44dbe3 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.383048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0642a0-c9dd-4fa6-8172-7532bd44dbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.401274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-fc0642a0-c9dd-4fa6-8172-7532bd44dbe3 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:30.402464 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-fc0642a0-c9dd-4fa6-8172-7532bd44dbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:30.434605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:30.470544 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 646/1294] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:34:30.740131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c2d04-e5df-4f88-be23-86383af118c6 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:30.771636 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:30.844441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c2d04-e5df-4f88-be23-86383af118c6 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:30.877717 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80443f-eb7e-41dd-9651-8fa4ba70db7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:30.886740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80443f-eb7e-41dd-9651-8fa4ba70db7e None admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.886740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80443f-eb7e-41dd-9651-8fa4ba70db7e None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.886740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80443f-eb7e-41dd-9651-8fa4ba70db7e None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.886740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80443f-eb7e-41dd-9651-8fa4ba70db7e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:30.886740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80443f-eb7e-41dd-9651-8fa4ba70db7e None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:30.984569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 649/1295] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 29 22:34:30 2022] POST /identity/v3/services => generated 246 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:34:32.902578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b188d75-3aeb-4392-a932-3d0d714145df None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:32.903118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b188d75-3aeb-4392-a932-3d0d714145df None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:32.903118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b188d75-3aeb-4392-a932-3d0d714145df None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:32.904405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 647/1296] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:32.909525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c091fe7-fed2-40c1-b13f-21ed09b79d5d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:32.909946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c091fe7-fed2-40c1-b13f-21ed09b79d5d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:32.910098 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c091fe7-fed2-40c1-b13f-21ed09b79d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:32.929819 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-9c091fe7-fed2-40c1-b13f-21ed09b79d5d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:32.936788 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9c091fe7-fed2-40c1-b13f-21ed09b79d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:33.007346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 650/1297] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:33.278024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b188d75-3aeb-4392-a932-3d0d714145df None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:33.378360 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b188d75-3aeb-4392-a932-3d0d714145df None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:33.414148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e5c60-db00-43f3-9fc9-7afb0bcbbae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:33.414775 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e5c60-db00-43f3-9fc9-7afb0bcbbae0 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:33.415053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e5c60-db00-43f3-9fc9-7afb0bcbbae0 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:33.415324 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e5c60-db00-43f3-9fc9-7afb0bcbbae0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:33.415944 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e5c60-db00-43f3-9fc9-7afb0bcbbae0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:33.417329 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e5c60-db00-43f3-9fc9-7afb0bcbbae0 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-f72e5c60-db00-43f3-9fc9-7afb0bcbbae0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:33.426538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:33.428573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:33.430345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:33.430345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:33.430345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:33.430345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:33.430345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:33.430345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:33.430345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:33.430345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:33.430345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:33.430345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:33.430345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:34:33.430345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:34:33.430345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:34:33.430345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:33.430345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 648/1298] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 29 22:34:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:33.433919 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c091fe7-fed2-40c1-b13f-21ed09b79d5d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:33.452557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:33.533071 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c091fe7-fed2-40c1-b13f-21ed09b79d5d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:33.570242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8196979-1e24-474a-83f3-9a2cc1f424ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:33.570848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8196979-1e24-474a-83f3-9a2cc1f424ac None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:33.571130 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8196979-1e24-474a-83f3-9a2cc1f424ac None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:33.571406 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8196979-1e24-474a-83f3-9a2cc1f424ac None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:33.572728 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8196979-1e24-474a-83f3-9a2cc1f424ac None admin] RBAC: Adding query filter params (name=placement) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:33.573038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8196979-1e24-474a-83f3-9a2cc1f424ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:33.574451 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8196979-1e24-474a-83f3-9a2cc1f424ac None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:33.579638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 651/1299] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Aug 29 22:34:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:33.586385 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e5c60-db00-43f3-9fc9-7afb0bcbbae0 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:33.618237 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:33.686930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e5c60-db00-43f3-9fc9-7afb0bcbbae0 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:33.720007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abea07-e1c8-4082-a34b-c15c8e4118c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:33.720644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abea07-e1c8-4082-a34b-c15c8e4118c0 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:33.720923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abea07-e1c8-4082-a34b-c15c8e4118c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:33.721192 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abea07-e1c8-4082-a34b-c15c8e4118c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:33.721890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abea07-e1c8-4082-a34b-c15c8e4118c0 None admin] RBAC: Adding query filter params (interface=public, service_id=65ca615986ca4b40b80d6e42f471ebf2, region_id=RegionOne) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:33.722195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abea07-e1c8-4082-a34b-c15c8e4118c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:33.723543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abea07-e1c8-4082-a34b-c15c8e4118c0 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:33.728763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 649/1300] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 29 22:34:33 2022] GET /identity/v3/endpoints?service_id=65ca615986ca4b40b80d6e42f471ebf2&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:33.736310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8196979-1e24-474a-83f3-9a2cc1f424ac None admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:33.819906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:33.838323 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8196979-1e24-474a-83f3-9a2cc1f424ac None admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:33.873800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a2e9d-5459-4aac-9cd1-5c6d97feb148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:33.874412 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a2e9d-5459-4aac-9cd1-5c6d97feb148 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:33.874693 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a2e9d-5459-4aac-9cd1-5c6d97feb148 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:33.874968 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a2e9d-5459-4aac-9cd1-5c6d97feb148 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:33.875579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a2e9d-5459-4aac-9cd1-5c6d97feb148 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:33.877039 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a2e9d-5459-4aac-9cd1-5c6d97feb148 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:33.885041 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 652/1301] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 29 22:34:33 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:34:35.847421 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47a73b-81f2-4416-b31f-4e6a4591bc06 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:35.847937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47a73b-81f2-4416-b31f-4e6a4591bc06 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:35.847937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47a73b-81f2-4416-b31f-4e6a4591bc06 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:35.849321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 650/1302] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:35.854634 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377793e-b49d-4971-9520-bdf4b8e334d6 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:35.861353 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377793e-b49d-4971-9520-bdf4b8e334d6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:35.861353 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377793e-b49d-4971-9520-bdf4b8e334d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:35.874294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-3377793e-b49d-4971-9520-bdf4b8e334d6 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:35.875485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3377793e-b49d-4971-9520-bdf4b8e334d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:35.943302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 653/1303] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:36.219745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47a73b-81f2-4416-b31f-4e6a4591bc06 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:36.316195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:36.323308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47a73b-81f2-4416-b31f-4e6a4591bc06 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:36.356417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be843e-6e61-4532-97d1-0d03bc114352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:36.357064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be843e-6e61-4532-97d1-0d03bc114352 None admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:36.357345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be843e-6e61-4532-97d1-0d03bc114352 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:36.357618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be843e-6e61-4532-97d1-0d03bc114352 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:36.358306 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be843e-6e61-4532-97d1-0d03bc114352 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:36.359747 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be843e-6e61-4532-97d1-0d03bc114352 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application [None req-56be843e-6e61-4532-97d1-0d03bc114352 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:36.368331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:36.369522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:36.370391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:36.370391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:36.370391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:36.370391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:36.370391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:36.370391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:36.370391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:36.370391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:36.370391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:36.370391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:36.370391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:34:36.370391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:34:36.370391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:34:36.370391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: ERROR keystone.server.flask.application Aug 29 22:34:36.370391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 651/1304] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 29 22:34:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:36.375762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377793e-b49d-4971-9520-bdf4b8e334d6 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:36.454048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:36.477756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377793e-b49d-4971-9520-bdf4b8e334d6 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:36.512400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdda0e-b66e-42c9-833d-33a7dea90d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:36.513071 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdda0e-b66e-42c9-833d-33a7dea90d21 None admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:36.513351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdda0e-b66e-42c9-833d-33a7dea90d21 None admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:36.513623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdda0e-b66e-42c9-833d-33a7dea90d21 None admin] PATH_INFO: `/v3/services` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:36.514283 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdda0e-b66e-42c9-833d-33a7dea90d21 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:36.514588 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdda0e-b66e-42c9-833d-33a7dea90d21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:36.515983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdda0e-b66e-42c9-833d-33a7dea90d21 None admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:36.521432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 654/1305] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Aug 29 22:34:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:36.528941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be843e-6e61-4532-97d1-0d03bc114352 None admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:36.634900 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be843e-6e61-4532-97d1-0d03bc114352 None admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:36.668594 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4728658-2dd5-4a2a-8ab7-011c31e90580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:36.669274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4728658-2dd5-4a2a-8ab7-011c31e90580 None admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:36.669556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4728658-2dd5-4a2a-8ab7-011c31e90580 None admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:36.669820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4728658-2dd5-4a2a-8ab7-011c31e90580 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:36.670467 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4728658-2dd5-4a2a-8ab7-011c31e90580 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:36.671818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4728658-2dd5-4a2a-8ab7-011c31e90580 None admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:36.760248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 652/1306] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:34:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:34:46.518318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=30 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:46.754668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:19.953656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9b23-e6f1-4a5f-b654-f5c6010d5760 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:19.954197 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9b23-e6f1-4a5f-b654-f5c6010d5760 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:19.954197 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9b23-e6f1-4a5f-b654-f5c6010d5760 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:19.960775 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d58e71-7852-4dfe-99b9-55b3b374aa3f None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:19.961289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d58e71-7852-4dfe-99b9-55b3b374aa3f None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:19.961384 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d58e71-7852-4dfe-99b9-55b3b374aa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:19.966921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 655/1307] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:41:19 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:20.049391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-98d58e71-7852-4dfe-99b9-55b3b374aa3f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:20.050897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-98d58e71-7852-4dfe-99b9-55b3b374aa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:20.180491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 653/1308] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:41:20.478359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9cdc8-859b-46dc-9507-010e3a0cc02f None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:20.478623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9cdc8-859b-46dc-9507-010e3a0cc02f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:20.478898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9cdc8-859b-46dc-9507-010e3a0cc02f None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:20.480762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 656/1309] 10.222.0.62 () {54 vars in 965 bytes} [Mon Aug 29 22:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:20.488129 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf602d-cd23-45f4-ab2d-f19d86057616 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:20.488410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf602d-cd23-45f4-ab2d-f19d86057616 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:20.488694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf602d-cd23-45f4-ab2d-f19d86057616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:20.594939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-eadf602d-cd23-45f4-ab2d-f19d86057616 None None] MFA Rules not processed for user `d8794e99a0024672974412ca4c045b63`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:20.596298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-eadf602d-cd23-45f4-ab2d-f19d86057616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:20.619101 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:20.678673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 654/1310] 10.222.0.62 () {58 vars in 1062 bytes} [Mon Aug 29 22:41:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:20.688211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9cdc8-859b-46dc-9507-010e3a0cc02f None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:20.690104 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-20b9cdc8-859b-46dc-9507-010e3a0cc02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:20.829475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9cdc8-859b-46dc-9507-010e3a0cc02f None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:20.916426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a56f7-8940-4bca-8b06-f2cc570d84aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:20.917147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a56f7-8940-4bca-8b06-f2cc570d84aa service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:20.918070 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a56f7-8940-4bca-8b06-f2cc570d84aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:20.918408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a56f7-8940-4bca-8b06-f2cc570d84aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:20.920105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ee1a56f7-8940-4bca-8b06-f2cc570d84aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:20.978579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:21.041988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a56f7-8940-4bca-8b06-f2cc570d84aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:21.044186 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a56f7-8940-4bca-8b06-f2cc570d84aa service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:21.063942 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 657/1311] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:23.549354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adeca1-bca5-4698-80d7-686712322e65 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:23.550143 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adeca1-bca5-4698-80d7-686712322e65 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:23.550258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adeca1-bca5-4698-80d7-686712322e65 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:23.552006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 655/1312] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:23.557968 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435efa4-bc57-41a3-8482-2720b65a417c None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:23.558751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435efa4-bc57-41a3-8482-2720b65a417c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:23.558751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435efa4-bc57-41a3-8482-2720b65a417c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:23.645962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-6435efa4-bc57-41a3-8482-2720b65a417c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:23.648233 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-6435efa4-bc57-41a3-8482-2720b65a417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:23.760190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 658/1313] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:24.042310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adeca1-bca5-4698-80d7-686712322e65 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:24.043863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d5adeca1-bca5-4698-80d7-686712322e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:24.149924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adeca1-bca5-4698-80d7-686712322e65 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:24.219852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:24.222389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446766d-642f-4db4-9bc1-3d01c26cdfbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:24.223004 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446766d-642f-4db4-9bc1-3d01c26cdfbb service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:24.223281 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446766d-642f-4db4-9bc1-3d01c26cdfbb service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:24.223547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446766d-642f-4db4-9bc1-3d01c26cdfbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:24.225203 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5446766d-642f-4db4-9bc1-3d01c26cdfbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:24.339581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446766d-642f-4db4-9bc1-3d01c26cdfbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:24.341087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446766d-642f-4db4-9bc1-3d01c26cdfbb service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:24.362179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 656/1314] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:26.808777 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5ceca-bf6a-4fe7-ac43-9644fdffb4b1 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:26.809310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5ceca-bf6a-4fe7-ac43-9644fdffb4b1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:26.809310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5ceca-bf6a-4fe7-ac43-9644fdffb4b1 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:26.810676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 659/1315] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:26.815743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514301d-503f-4942-bc7e-bd4a5b9a24c4 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:26.816252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514301d-503f-4942-bc7e-bd4a5b9a24c4 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:26.816386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514301d-503f-4942-bc7e-bd4a5b9a24c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:26.887208 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-4514301d-503f-4942-bc7e-bd4a5b9a24c4 None None] MFA Rules not processed for user `342fd70c02c34a39b525655b3d8d3e46`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:26.888415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-4514301d-503f-4942-bc7e-bd4a5b9a24c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:26.941397 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:26.986438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 657/1316] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:27.274996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5ceca-bf6a-4fe7-ac43-9644fdffb4b1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:27.276575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-69b5ceca-bf6a-4fe7-ac43-9644fdffb4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:27.286601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:27.381579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5ceca-bf6a-4fe7-ac43-9644fdffb4b1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:27.459322 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0e3cc-6d9b-4fcf-9f56-a572e75065f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:27.459923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0e3cc-6d9b-4fcf-9f56-a572e75065f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:27.460231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0e3cc-6d9b-4fcf-9f56-a572e75065f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:27.460503 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0e3cc-6d9b-4fcf-9f56-a572e75065f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:27.462107 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-73d0e3cc-6d9b-4fcf-9f56-a572e75065f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:27.524879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:27.576754 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0e3cc-6d9b-4fcf-9f56-a572e75065f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:27.578258 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0e3cc-6d9b-4fcf-9f56-a572e75065f7 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:27.596840 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 660/1317] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:27 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:30.360873 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f6e70-d7a7-40c0-a08f-12ad5282ee12 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:30.361436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f6e70-d7a7-40c0-a08f-12ad5282ee12 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:30.361436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f6e70-d7a7-40c0-a08f-12ad5282ee12 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:30.362766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 658/1318] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:30.368034 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb1548-8fcb-4a3d-b7f0-7e4911aa8ec3 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:30.368476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb1548-8fcb-4a3d-b7f0-7e4911aa8ec3 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:30.368603 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb1548-8fcb-4a3d-b7f0-7e4911aa8ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:30.434938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-beeb1548-8fcb-4a3d-b7f0-7e4911aa8ec3 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:30.436195 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-beeb1548-8fcb-4a3d-b7f0-7e4911aa8ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:30.534263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 661/1319] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:41:30.825126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f6e70-d7a7-40c0-a08f-12ad5282ee12 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:30.826687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-126f6e70-d7a7-40c0-a08f-12ad5282ee12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:30.933473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f6e70-d7a7-40c0-a08f-12ad5282ee12 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:31.007278 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5d010-efb5-4f57-9b28-a324d76840df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:31.007889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5d010-efb5-4f57-9b28-a324d76840df service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:31.008205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5d010-efb5-4f57-9b28-a324d76840df service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:31.008491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5d010-efb5-4f57-9b28-a324d76840df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:31.010124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-faf5d010-efb5-4f57-9b28-a324d76840df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:31.018601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:31.126897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5d010-efb5-4f57-9b28-a324d76840df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:31.128289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5d010-efb5-4f57-9b28-a324d76840df service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:31.148030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 659/1320] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:41:34.275073 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10719b8c-ed71-4a65-844e-9cb5b5dcd429 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:34.275659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10719b8c-ed71-4a65-844e-9cb5b5dcd429 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:34.275659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10719b8c-ed71-4a65-844e-9cb5b5dcd429 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:34.277517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 662/1321] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:34.283081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8551feb-f808-4766-b8dd-087269309257 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:34.283840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8551feb-f808-4766-b8dd-087269309257 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:34.283996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8551feb-f808-4766-b8dd-087269309257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:34.354384 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-c8551feb-f808-4766-b8dd-087269309257 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:34.355630 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-c8551feb-f808-4766-b8dd-087269309257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:34.416489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:34.457802 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 660/1322] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:41:34.744687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10719b8c-ed71-4a65-844e-9cb5b5dcd429 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:34.746843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-10719b8c-ed71-4a65-844e-9cb5b5dcd429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:34.769429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:34.869203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10719b8c-ed71-4a65-844e-9cb5b5dcd429 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:34.966231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b98bf-6dd8-4cb4-8c51-6e2703b5a9d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:34.966838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b98bf-6dd8-4cb4-8c51-6e2703b5a9d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:34.967113 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b98bf-6dd8-4cb4-8c51-6e2703b5a9d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:34.967380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b98bf-6dd8-4cb4-8c51-6e2703b5a9d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:34.969171 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2b8b98bf-6dd8-4cb4-8c51-6e2703b5a9d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:35.047849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:35.091785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b98bf-6dd8-4cb4-8c51-6e2703b5a9d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:35.093261 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b98bf-6dd8-4cb4-8c51-6e2703b5a9d9 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:35.112656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 663/1323] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:37.136324 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c1643-3bf5-4989-be8f-47ed7c0d2d26 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:37.136893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c1643-3bf5-4989-be8f-47ed7c0d2d26 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:37.136893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c1643-3bf5-4989-be8f-47ed7c0d2d26 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:37.138242 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 661/1324] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:37.144498 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce764eb5-e3e6-4164-ac36-3b9ab4b8289a None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:37.145121 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce764eb5-e3e6-4164-ac36-3b9ab4b8289a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:37.145121 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce764eb5-e3e6-4164-ac36-3b9ab4b8289a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:37.232709 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ce764eb5-e3e6-4164-ac36-3b9ab4b8289a None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:37.233881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ce764eb5-e3e6-4164-ac36-3b9ab4b8289a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:37.339679 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 664/1325] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:37.642423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee070aea-597c-4d4f-b8ed-fb61b32185a3 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:37.642790 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee070aea-597c-4d4f-b8ed-fb61b32185a3 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:37.643247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee070aea-597c-4d4f-b8ed-fb61b32185a3 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:37.645042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 662/1326] 10.222.0.62 () {54 vars in 965 bytes} [Mon Aug 29 22:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:37.652489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80770ef9-1aac-4e70-a83f-2ab075c47cd3 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:37.652781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80770ef9-1aac-4e70-a83f-2ab075c47cd3 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:37.653095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80770ef9-1aac-4e70-a83f-2ab075c47cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:37.689459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:37.743278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-80770ef9-1aac-4e70-a83f-2ab075c47cd3 None None] MFA Rules not processed for user `d8794e99a0024672974412ca4c045b63`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:37.744534 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-80770ef9-1aac-4e70-a83f-2ab075c47cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:37.850208 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 665/1327] 10.222.0.62 () {58 vars in 1062 bytes} [Mon Aug 29 22:41:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:37.860264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee070aea-597c-4d4f-b8ed-fb61b32185a3 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:37.861857 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ee070aea-597c-4d4f-b8ed-fb61b32185a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:37.989873 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee070aea-597c-4d4f-b8ed-fb61b32185a3 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:38.073155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb4940-3504-413c-b935-f227cf30b9ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:38.073779 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb4940-3504-413c-b935-f227cf30b9ba service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:38.074056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb4940-3504-413c-b935-f227cf30b9ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:38.074328 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb4940-3504-413c-b935-f227cf30b9ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:38.075999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b4bb4940-3504-413c-b935-f227cf30b9ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:38.094042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:38.214658 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb4940-3504-413c-b935-f227cf30b9ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:38.216014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb4940-3504-413c-b935-f227cf30b9ba service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:38.235015 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 663/1328] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:40.487763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e399ffb-df2d-4c0f-b8fe-0e1f18b083b8 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:40.488393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e399ffb-df2d-4c0f-b8fe-0e1f18b083b8 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:40.488393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e399ffb-df2d-4c0f-b8fe-0e1f18b083b8 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:40.489894 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 666/1329] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:40.496546 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9c99c-aeb3-4037-bd6d-9f9d31bbdcc7 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:40.497107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9c99c-aeb3-4037-bd6d-9f9d31bbdcc7 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:40.497107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9c99c-aeb3-4037-bd6d-9f9d31bbdcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:40.589700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-ead9c99c-aeb3-4037-bd6d-9f9d31bbdcc7 None None] MFA Rules not processed for user `342fd70c02c34a39b525655b3d8d3e46`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:40.592312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ead9c99c-aeb3-4037-bd6d-9f9d31bbdcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:40.676892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:40.713699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 664/1330] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:41.004134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e399ffb-df2d-4c0f-b8fe-0e1f18b083b8 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:41.005682 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9e399ffb-df2d-4c0f-b8fe-0e1f18b083b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:41.120241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e399ffb-df2d-4c0f-b8fe-0e1f18b083b8 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:41.145309 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:41.201632 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000772c-df12-49a0-b3f5-f31a37d68951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:41.202150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000772c-df12-49a0-b3f5-f31a37d68951 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:41.202434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000772c-df12-49a0-b3f5-f31a37d68951 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:41.202706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000772c-df12-49a0-b3f5-f31a37d68951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:41.204377 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4000772c-df12-49a0-b3f5-f31a37d68951 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:41.342490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000772c-df12-49a0-b3f5-f31a37d68951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:41.343947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000772c-df12-49a0-b3f5-f31a37d68951 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:41.364724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 667/1331] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:44.046390 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b43d9-29d6-48f7-8415-e6ea8656e945 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:44.046935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b43d9-29d6-48f7-8415-e6ea8656e945 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:44.046935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b43d9-29d6-48f7-8415-e6ea8656e945 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:44.048253 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 665/1332] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:44.054012 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed2cfe-54b1-442f-8b5e-498dcd20ddd9 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:44.054459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed2cfe-54b1-442f-8b5e-498dcd20ddd9 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:44.054569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed2cfe-54b1-442f-8b5e-498dcd20ddd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:44.124644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:44.126191 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-c5ed2cfe-54b1-442f-8b5e-498dcd20ddd9 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:44.127409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c5ed2cfe-54b1-442f-8b5e-498dcd20ddd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:44.236514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 668/1333] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:44.517784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b43d9-29d6-48f7-8415-e6ea8656e945 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:44.519428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-157b43d9-29d6-48f7-8415-e6ea8656e945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:44.677023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b43d9-29d6-48f7-8415-e6ea8656e945 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:44.759686 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d174ab-dd61-4c05-9385-b59a63b00693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:44.760363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d174ab-dd61-4c05-9385-b59a63b00693 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:44.760646 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d174ab-dd61-4c05-9385-b59a63b00693 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:44.760905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d174ab-dd61-4c05-9385-b59a63b00693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:44.762621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-24d174ab-dd61-4c05-9385-b59a63b00693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:44.790249 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:44.878277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d174ab-dd61-4c05-9385-b59a63b00693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:44.879731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d174ab-dd61-4c05-9385-b59a63b00693 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:44.898846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 666/1334] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:46.881601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de856dd2-9a55-4a88-bf99-55fc47d2c526 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:46.882129 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de856dd2-9a55-4a88-bf99-55fc47d2c526 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:46.882129 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de856dd2-9a55-4a88-bf99-55fc47d2c526 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:46.883454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 669/1335] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:46.888766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1ec78-8fa4-4dea-95c2-cf5f2b1d3da6 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:46.889190 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1ec78-8fa4-4dea-95c2-cf5f2b1d3da6 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:46.889326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1ec78-8fa4-4dea-95c2-cf5f2b1d3da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:46.955457 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-29b1ec78-8fa4-4dea-95c2-cf5f2b1d3da6 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:46.956697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-29b1ec78-8fa4-4dea-95c2-cf5f2b1d3da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:47.033770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:47.057526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 667/1336] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:47.341172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de856dd2-9a55-4a88-bf99-55fc47d2c526 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:47.342899 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-de856dd2-9a55-4a88-bf99-55fc47d2c526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:47.447518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de856dd2-9a55-4a88-bf99-55fc47d2c526 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:47.476683 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:47.523502 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6fd6b-328d-4fbf-ba1b-5412d6aa7971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:47.524030 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6fd6b-328d-4fbf-ba1b-5412d6aa7971 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:47.524344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6fd6b-328d-4fbf-ba1b-5412d6aa7971 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:47.524627 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6fd6b-328d-4fbf-ba1b-5412d6aa7971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:47.526901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-20e6fd6b-328d-4fbf-ba1b-5412d6aa7971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:47.645814 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6fd6b-328d-4fbf-ba1b-5412d6aa7971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:47.647253 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6fd6b-328d-4fbf-ba1b-5412d6aa7971 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:47.667033 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 670/1337] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:50.310610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67ebd1-bcb7-4ece-87f5-29597cf8122c None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:50.311171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67ebd1-bcb7-4ece-87f5-29597cf8122c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:50.311264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67ebd1-bcb7-4ece-87f5-29597cf8122c None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:50.312598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 668/1338] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:50.317640 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d72d7d-2754-4499-98db-1394a3585d40 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:50.318067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d72d7d-2754-4499-98db-1394a3585d40 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:50.318186 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d72d7d-2754-4499-98db-1394a3585d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:50.388253 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-e9d72d7d-2754-4499-98db-1394a3585d40 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:50.389459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e9d72d7d-2754-4499-98db-1394a3585d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:50.400118 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:50.494532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 671/1339] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:50.781336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67ebd1-bcb7-4ece-87f5-29597cf8122c None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:50.782874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-2e67ebd1-bcb7-4ece-87f5-29597cf8122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:50.890107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67ebd1-bcb7-4ece-87f5-29597cf8122c None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:50.964065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c98201-5a9e-48b0-8825-b0f9efa62ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:50.964708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c98201-5a9e-48b0-8825-b0f9efa62ffd service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:50.964979 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c98201-5a9e-48b0-8825-b0f9efa62ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:50.965244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c98201-5a9e-48b0-8825-b0f9efa62ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:50.966925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-43c98201-5a9e-48b0-8825-b0f9efa62ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:51.002499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:51.079097 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c98201-5a9e-48b0-8825-b0f9efa62ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:51.080567 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c98201-5a9e-48b0-8825-b0f9efa62ffd service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:51.098984 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 669/1340] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:55.330025 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2e795-8a78-4a8e-9554-9971cf56c2fd None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:55.330589 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2e795-8a78-4a8e-9554-9971cf56c2fd None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:55.330589 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2e795-8a78-4a8e-9554-9971cf56c2fd None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:55.331962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 672/1341] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:55.337402 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608b962-3eeb-4dc6-a78f-0822d50b89e0 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:55.338107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608b962-3eeb-4dc6-a78f-0822d50b89e0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:55.338465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608b962-3eeb-4dc6-a78f-0822d50b89e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:55.405248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-a608b962-3eeb-4dc6-a78f-0822d50b89e0 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:55.406385 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a608b962-3eeb-4dc6-a78f-0822d50b89e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:55.496311 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:55.507931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 670/1342] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:55.790197 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2e795-8a78-4a8e-9554-9971cf56c2fd None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:55.791839 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-89b2e795-8a78-4a8e-9554-9971cf56c2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:55.897274 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2e795-8a78-4a8e-9554-9971cf56c2fd None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:55.937087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:55.977616 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74771df-15cb-4dbc-a8e7-da76eb61bbb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:55.978329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74771df-15cb-4dbc-a8e7-da76eb61bbb5 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:55.978576 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74771df-15cb-4dbc-a8e7-da76eb61bbb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:55.978851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74771df-15cb-4dbc-a8e7-da76eb61bbb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:55.980495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f74771df-15cb-4dbc-a8e7-da76eb61bbb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:56.094391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74771df-15cb-4dbc-a8e7-da76eb61bbb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:56.095873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74771df-15cb-4dbc-a8e7-da76eb61bbb5 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:56.114486 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 673/1343] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:59.087033 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed7184-ad38-4210-8067-ea3b95bdd6d2 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:59.087639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed7184-ad38-4210-8067-ea3b95bdd6d2 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:59.087639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed7184-ad38-4210-8067-ea3b95bdd6d2 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:59.089078 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 671/1344] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:59.094873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20013392-4ff4-4ce8-95b1-81334bc5f4b7 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:59.095332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20013392-4ff4-4ce8-95b1-81334bc5f4b7 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:59.095471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20013392-4ff4-4ce8-95b1-81334bc5f4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:59.168126 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-20013392-4ff4-4ce8-95b1-81334bc5f4b7 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:59.169241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-20013392-4ff4-4ce8-95b1-81334bc5f4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:59.187838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:59.270059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 674/1345] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:41:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:59.555758 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed7184-ad38-4210-8067-ea3b95bdd6d2 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:59.557493 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-48ed7184-ad38-4210-8067-ea3b95bdd6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:59.668732 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed7184-ad38-4210-8067-ea3b95bdd6d2 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:59.744731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed655767-aa94-497d-96dd-e53b7003e130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:59.745349 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed655767-aa94-497d-96dd-e53b7003e130 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:59.745626 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed655767-aa94-497d-96dd-e53b7003e130 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:59.745894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed655767-aa94-497d-96dd-e53b7003e130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:59.747536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ed655767-aa94-497d-96dd-e53b7003e130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:59.798693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:59.869401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed655767-aa94-497d-96dd-e53b7003e130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:59.870862 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed655767-aa94-497d-96dd-e53b7003e130 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:59.892395 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 672/1346] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:42:04.178957 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cad0a-7a30-4af6-b2ab-c8463b848150 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:04.179567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cad0a-7a30-4af6-b2ab-c8463b848150 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:04.179567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cad0a-7a30-4af6-b2ab-c8463b848150 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:04.180833 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 675/1347] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:04.186732 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559fc97-deb1-41ec-8e58-f1eb57729d66 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:04.187277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559fc97-deb1-41ec-8e58-f1eb57729d66 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:04.187277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559fc97-deb1-41ec-8e58-f1eb57729d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:04.261272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-5559fc97-deb1-41ec-8e58-f1eb57729d66 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:04.262538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5559fc97-deb1-41ec-8e58-f1eb57729d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:04.364504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:04.367087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 673/1348] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:04.653817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cad0a-7a30-4af6-b2ab-c8463b848150 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:04.655443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-074cad0a-7a30-4af6-b2ab-c8463b848150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:04.763835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cad0a-7a30-4af6-b2ab-c8463b848150 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:04.815675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:04.841747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67325d45-5fe0-4d73-a90b-ac348983ad40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:04.842350 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67325d45-5fe0-4d73-a90b-ac348983ad40 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:04.842629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67325d45-5fe0-4d73-a90b-ac348983ad40 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:04.842901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67325d45-5fe0-4d73-a90b-ac348983ad40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:04.844531 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-67325d45-5fe0-4d73-a90b-ac348983ad40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:04.954154 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67325d45-5fe0-4d73-a90b-ac348983ad40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:04.955644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67325d45-5fe0-4d73-a90b-ac348983ad40 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:04.974218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 676/1349] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:42:10.043083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7ec3a-67c4-4235-af7e-9e2cf5009619 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:10.043083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7ec3a-67c4-4235-af7e-9e2cf5009619 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:10.043543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7ec3a-67c4-4235-af7e-9e2cf5009619 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:10.046448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 674/1350] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 29 22:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:10.051623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf3fae-aad4-4670-974b-bfd846f5b960 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:10.052426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf3fae-aad4-4670-974b-bfd846f5b960 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:10.052840 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf3fae-aad4-4670-974b-bfd846f5b960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:10.166009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-27bf3fae-aad4-4670-974b-bfd846f5b960 None None] MFA Rules not processed for user `2991c613878e4993901199434f384f49`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:10.167566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-27bf3fae-aad4-4670-974b-bfd846f5b960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:10.191431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:10.322835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 677/1351] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 29 22:42:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:14.570354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef2895-000f-4f52-ba3e-ea4ca169d893 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:14.570942 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef2895-000f-4f52-ba3e-ea4ca169d893 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:14.570942 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef2895-000f-4f52-ba3e-ea4ca169d893 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:14.572884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 675/1352] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 29 22:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:14.577958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4f1a8-6b43-4e96-8a0a-04bcda4536ee None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:14.578399 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4f1a8-6b43-4e96-8a0a-04bcda4536ee None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:14.578511 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4f1a8-6b43-4e96-8a0a-04bcda4536ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:14.662872 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-90c4f1a8-6b43-4e96-8a0a-04bcda4536ee None None] MFA Rules not processed for user `2991c613878e4993901199434f384f49`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:14.664471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-90c4f1a8-6b43-4e96-8a0a-04bcda4536ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:14.747544 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:14.791050 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 678/1353] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 29 22:42:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:16.177369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4c527-1aa6-4341-8b3d-19821d72b9f6 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:16.177902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4c527-1aa6-4341-8b3d-19821d72b9f6 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:16.177902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4c527-1aa6-4341-8b3d-19821d72b9f6 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:16.179279 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 676/1354] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 29 22:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:16.184608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40814a8b-2041-4004-bbcd-d35a704d6036 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:16.185027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40814a8b-2041-4004-bbcd-d35a704d6036 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:16.185156 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40814a8b-2041-4004-bbcd-d35a704d6036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:16.261996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-40814a8b-2041-4004-bbcd-d35a704d6036 None None] MFA Rules not processed for user `2991c613878e4993901199434f384f49`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:16.263183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-40814a8b-2041-4004-bbcd-d35a704d6036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:16.373150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 679/1355] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 29 22:42:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:42:19.753040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78fd42-eaca-4c37-b029-144563c0c582 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:19.754151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78fd42-eaca-4c37-b029-144563c0c582 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:19.754532 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78fd42-eaca-4c37-b029-144563c0c582 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:19.755989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 677/1356] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:19.762400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ece028-4022-4472-936e-54b2a818e99e None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:19.762831 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ece028-4022-4472-936e-54b2a818e99e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:19.762996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ece028-4022-4472-936e-54b2a818e99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:19.800039 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:19.831843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-26ece028-4022-4472-936e-54b2a818e99e None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:19.836165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-26ece028-4022-4472-936e-54b2a818e99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:19.982159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 680/1357] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:20.291509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3d443-5d76-447d-a7b1-75277d347ca8 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:20.291788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3d443-5d76-447d-a7b1-75277d347ca8 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:20.292326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3d443-5d76-447d-a7b1-75277d347ca8 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:20.293903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 678/1358] 10.222.0.62 () {54 vars in 962 bytes} [Mon Aug 29 22:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:20.302063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa2552-6985-40d6-a248-50727611a997 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:20.302657 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa2552-6985-40d6-a248-50727611a997 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:20.303110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa2552-6985-40d6-a248-50727611a997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:20.400908 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-22aa2552-6985-40d6-a248-50727611a997 None None] MFA Rules not processed for user `f06d910badb84c6aa6b48f3b56b91f82`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:20.402306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-22aa2552-6985-40d6-a248-50727611a997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:20.461510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:20.537452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 681/1359] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Aug 29 22:42:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:20.547154 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3d443-5d76-447d-a7b1-75277d347ca8 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:20.548797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d7b3d443-5d76-447d-a7b1-75277d347ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:20.717173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3d443-5d76-447d-a7b1-75277d347ca8 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:20.798091 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:20.848461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12090c-f467-4fdc-a527-2326f8cb3905 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:20.849124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12090c-f467-4fdc-a527-2326f8cb3905 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:20.849590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12090c-f467-4fdc-a527-2326f8cb3905 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:20.849792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12090c-f467-4fdc-a527-2326f8cb3905 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:20.851475 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1f12090c-f467-4fdc-a527-2326f8cb3905 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:20.959065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12090c-f467-4fdc-a527-2326f8cb3905 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:20.960922 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12090c-f467-4fdc-a527-2326f8cb3905 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:20.981341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 679/1360] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:42:23.124796 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a2f4b-9a3e-403b-a06a-2968381a8e6e None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:23.125364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a2f4b-9a3e-403b-a06a-2968381a8e6e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:23.125364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a2f4b-9a3e-403b-a06a-2968381a8e6e None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:23.126806 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 682/1361] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:23.131780 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8be7b-250d-4f07-9a83-46fd551fcbd9 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:23.132284 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8be7b-250d-4f07-9a83-46fd551fcbd9 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:23.132367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8be7b-250d-4f07-9a83-46fd551fcbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:23.203865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-5be8be7b-250d-4f07-9a83-46fd551fcbd9 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:23.205121 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5be8be7b-250d-4f07-9a83-46fd551fcbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:23.247143 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:23.318351 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 680/1362] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:23.611740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a2f4b-9a3e-403b-a06a-2968381a8e6e None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:23.613623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-070a2f4b-9a3e-403b-a06a-2968381a8e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:23.782138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a2f4b-9a3e-403b-a06a-2968381a8e6e None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:23.792147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:23.900352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc6972-819e-4ab5-b7fd-b52fbaaae577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:23.900953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc6972-819e-4ab5-b7fd-b52fbaaae577 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:23.901227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc6972-819e-4ab5-b7fd-b52fbaaae577 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:23.901495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc6972-819e-4ab5-b7fd-b52fbaaae577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:23.903088 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8cbc6972-819e-4ab5-b7fd-b52fbaaae577 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:23.998978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc6972-819e-4ab5-b7fd-b52fbaaae577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:24.000704 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc6972-819e-4ab5-b7fd-b52fbaaae577 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:24.025644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 683/1363] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:42:26.379663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b7020-703f-4e84-aece-2b2f3c3e8d77 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:26.380263 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b7020-703f-4e84-aece-2b2f3c3e8d77 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:26.380493 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b7020-703f-4e84-aece-2b2f3c3e8d77 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:26.382979 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 681/1364] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:42:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:26.387671 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804e5c1-d38d-4cd8-ab01-2bfdd4d80de2 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:26.388552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804e5c1-d38d-4cd8-ab01-2bfdd4d80de2 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:26.388983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804e5c1-d38d-4cd8-ab01-2bfdd4d80de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:26.406325 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:26.463932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-8804e5c1-d38d-4cd8-ab01-2bfdd4d80de2 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:26.465195 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8804e5c1-d38d-4cd8-ab01-2bfdd4d80de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:26.570092 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 684/1365] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:26.862004 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8fe9f-e64c-4819-b407-49279bc4d08c None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:26.862526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8fe9f-e64c-4819-b407-49279bc4d08c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:26.863025 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8fe9f-e64c-4819-b407-49279bc4d08c None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:26.864751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 682/1366] 10.222.0.62 () {54 vars in 962 bytes} [Mon Aug 29 22:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:26.871503 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fbfb9-4fbe-4543-93dd-b016cf31955f None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:26.871797 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fbfb9-4fbe-4543-93dd-b016cf31955f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:26.872220 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fbfb9-4fbe-4543-93dd-b016cf31955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:26.956493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-e51fbfb9-4fbe-4543-93dd-b016cf31955f None None] MFA Rules not processed for user `f06d910badb84c6aa6b48f3b56b91f82`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:26.957772 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e51fbfb9-4fbe-4543-93dd-b016cf31955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:26.995502 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:27.084305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 685/1367] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Aug 29 22:42:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:27.092260 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8fe9f-e64c-4819-b407-49279bc4d08c None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:27.094140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-bfc8fe9f-e64c-4819-b407-49279bc4d08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:27.255961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8fe9f-e64c-4819-b407-49279bc4d08c None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:27.279049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:27.385138 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f163d8-5b7f-4f85-ab27-00de2d439077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:27.385837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f163d8-5b7f-4f85-ab27-00de2d439077 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:27.386084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f163d8-5b7f-4f85-ab27-00de2d439077 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:27.386409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f163d8-5b7f-4f85-ab27-00de2d439077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:27.388076 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-49f163d8-5b7f-4f85-ab27-00de2d439077 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:27.481984 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f163d8-5b7f-4f85-ab27-00de2d439077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:27.483681 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f163d8-5b7f-4f85-ab27-00de2d439077 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:27.503394 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 683/1368] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:42:28.154327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0ed2b-96ab-43bb-8b81-a5733bcd384e None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:28.154903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0ed2b-96ab-43bb-8b81-a5733bcd384e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:28.154903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0ed2b-96ab-43bb-8b81-a5733bcd384e None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:28.156494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 686/1369] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:28.162019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d345c4-4089-45d9-a9d8-f6b5aa1b1373 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:28.162400 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d345c4-4089-45d9-a9d8-f6b5aa1b1373 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:28.162736 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d345c4-4089-45d9-a9d8-f6b5aa1b1373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:28.198281 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:28.241097 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-36d345c4-4089-45d9-a9d8-f6b5aa1b1373 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:28.242522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-36d345c4-4089-45d9-a9d8-f6b5aa1b1373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:28.349785 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 684/1370] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:28.989585 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e93b0e-2b17-4c0a-a7b4-2f04c57885ad None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:28.989585 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e93b0e-2b17-4c0a-a7b4-2f04c57885ad None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:28.991487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e93b0e-2b17-4c0a-a7b4-2f04c57885ad None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:28.992470 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 687/1371] 10.222.0.62 () {54 vars in 964 bytes} [Mon Aug 29 22:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:28.997777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2d1de-c8c5-4a18-80a6-9314f513d141 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:28.998353 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2d1de-c8c5-4a18-80a6-9314f513d141 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:28.998353 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2d1de-c8c5-4a18-80a6-9314f513d141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:29.087788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-1de2d1de-c8c5-4a18-80a6-9314f513d141 None None] MFA Rules not processed for user `29b630aac21b405eb114f5f1fd1294ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:29.089085 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1de2d1de-c8c5-4a18-80a6-9314f513d141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:29.144847 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:29.179760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 685/1372] 10.222.0.62 () {58 vars in 1061 bytes} [Mon Aug 29 22:42:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:42:29.187502 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e93b0e-2b17-4c0a-a7b4-2f04c57885ad None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:29.189620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f7e93b0e-2b17-4c0a-a7b4-2f04c57885ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:29.304152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e93b0e-2b17-4c0a-a7b4-2f04c57885ad None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:29.353612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:29.390245 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87892886-2180-4376-b72b-31c3e8c72289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:29.390846 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87892886-2180-4376-b72b-31c3e8c72289 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:29.391121 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87892886-2180-4376-b72b-31c3e8c72289 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:29.391393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87892886-2180-4376-b72b-31c3e8c72289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:29.393007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-87892886-2180-4376-b72b-31c3e8c72289 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:29.516947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87892886-2180-4376-b72b-31c3e8c72289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:29.518408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87892886-2180-4376-b72b-31c3e8c72289 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:29.543685 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 688/1373] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:42:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:42:29.729613 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13943d-ec14-4b61-a81a-ca6a158c2af6 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:29.729913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13943d-ec14-4b61-a81a-ca6a158c2af6 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:29.730199 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13943d-ec14-4b61-a81a-ca6a158c2af6 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:29.732025 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 686/1374] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:29.741816 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a5bb7-e28a-4d5b-ab4b-fd19f0f4662a None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:29.741816 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a5bb7-e28a-4d5b-ab4b-fd19f0f4662a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:29.741816 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a5bb7-e28a-4d5b-ab4b-fd19f0f4662a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:29.816961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-bf2a5bb7-e28a-4d5b-ab4b-fd19f0f4662a None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:29.818164 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-bf2a5bb7-e28a-4d5b-ab4b-fd19f0f4662a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:29.844460 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:29.925581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 689/1375] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:30.218107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13943d-ec14-4b61-a81a-ca6a158c2af6 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:30.220060 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9d13943d-ec14-4b61-a81a-ca6a158c2af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:30.378052 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13943d-ec14-4b61-a81a-ca6a158c2af6 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:30.433102 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:30.496180 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506d136-2deb-4724-b2e7-7c19f269ae88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:30.496785 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d136-2deb-4724-b2e7-7c19f269ae88 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:30.497060 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d136-2deb-4724-b2e7-7c19f269ae88 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:30.497326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d136-2deb-4724-b2e7-7c19f269ae88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:30.498914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-2506d136-2deb-4724-b2e7-7c19f269ae88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:30.591654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506d136-2deb-4724-b2e7-7c19f269ae88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:30.593267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506d136-2deb-4724-b2e7-7c19f269ae88 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:30.611202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 687/1376] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:42:32.748665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7865e00-c532-41fd-b9f3-a7f4b9e885c7 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:32.749222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7865e00-c532-41fd-b9f3-a7f4b9e885c7 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:32.749222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7865e00-c532-41fd-b9f3-a7f4b9e885c7 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:32.750569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 690/1377] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:32.756378 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c021cfb-1eb6-44fc-9d0c-06e545f8d8b9 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:32.757256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c021cfb-1eb6-44fc-9d0c-06e545f8d8b9 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:32.757639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c021cfb-1eb6-44fc-9d0c-06e545f8d8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:32.844395 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-4c021cfb-1eb6-44fc-9d0c-06e545f8d8b9 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:32.845544 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-4c021cfb-1eb6-44fc-9d0c-06e545f8d8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:32.852846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:32.944525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 688/1378] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:33.239299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7865e00-c532-41fd-b9f3-a7f4b9e885c7 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:33.240668 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c7865e00-c532-41fd-b9f3-a7f4b9e885c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:33.426874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7865e00-c532-41fd-b9f3-a7f4b9e885c7 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:33.431279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:33.557910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f658c07-492a-43e5-ac73-db1e215c4641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:33.558956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f658c07-492a-43e5-ac73-db1e215c4641 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:33.560181 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f658c07-492a-43e5-ac73-db1e215c4641 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:33.560181 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f658c07-492a-43e5-ac73-db1e215c4641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:33.563577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8f658c07-492a-43e5-ac73-db1e215c4641 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:33.683392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f658c07-492a-43e5-ac73-db1e215c4641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:33.684929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f658c07-492a-43e5-ac73-db1e215c4641 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:33.705405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 691/1379] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:42:35.855183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae2ea4-09bb-465f-b327-8007d0ac56d2 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:35.855759 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae2ea4-09bb-465f-b327-8007d0ac56d2 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:35.855759 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae2ea4-09bb-465f-b327-8007d0ac56d2 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:35.858619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 689/1380] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:35.862340 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb21413-18ac-4ed6-974f-0c3b9f3507aa None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:35.862773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb21413-18ac-4ed6-974f-0c3b9f3507aa None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:35.862896 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb21413-18ac-4ed6-974f-0c3b9f3507aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:35.875143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:35.935584 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ebb21413-18ac-4ed6-974f-0c3b9f3507aa None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:35.936824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ebb21413-18ac-4ed6-974f-0c3b9f3507aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:36.060524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 692/1381] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:36.365625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae2ea4-09bb-465f-b327-8007d0ac56d2 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:36.367124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-f6ae2ea4-09bb-465f-b327-8007d0ac56d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:36.525410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:36.535897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae2ea4-09bb-465f-b327-8007d0ac56d2 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:36.653877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4be8a6-7524-4f7c-95d8-9b75227796dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:36.654491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4be8a6-7524-4f7c-95d8-9b75227796dc service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:36.654762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4be8a6-7524-4f7c-95d8-9b75227796dc service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:36.655040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4be8a6-7524-4f7c-95d8-9b75227796dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:36.656680 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5a4be8a6-7524-4f7c-95d8-9b75227796dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:36.760971 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4be8a6-7524-4f7c-95d8-9b75227796dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:36.764001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4be8a6-7524-4f7c-95d8-9b75227796dc service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:36.783655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:36.793389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 690/1382] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:42:38.962338 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b52a03-3d9d-4bca-9f85-43f5815c12c6 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:38.962877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b52a03-3d9d-4bca-9f85-43f5815c12c6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:38.962976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b52a03-3d9d-4bca-9f85-43f5815c12c6 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:38.964807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 693/1383] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:42:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:38.970953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3894c-5555-4584-9278-637baeeb20a1 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:38.971415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3894c-5555-4584-9278-637baeeb20a1 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:38.972407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3894c-5555-4584-9278-637baeeb20a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:39.043331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-1ff3894c-5555-4584-9278-637baeeb20a1 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:39.044596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1ff3894c-5555-4584-9278-637baeeb20a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:39.162841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 691/1384] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:39.449198 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b52a03-3d9d-4bca-9f85-43f5815c12c6 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:39.450827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-24b52a03-3d9d-4bca-9f85-43f5815c12c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:39.544466 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:39.613607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b52a03-3d9d-4bca-9f85-43f5815c12c6 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:39.755352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490d961-3ac8-4a60-9bd8-b9e8e47edf7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:39.756149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490d961-3ac8-4a60-9bd8-b9e8e47edf7a service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:39.756258 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490d961-3ac8-4a60-9bd8-b9e8e47edf7a service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:39.756530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490d961-3ac8-4a60-9bd8-b9e8e47edf7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:39.758747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d490d961-3ac8-4a60-9bd8-b9e8e47edf7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:39.811639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:39.855859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490d961-3ac8-4a60-9bd8-b9e8e47edf7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:39.857502 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490d961-3ac8-4a60-9bd8-b9e8e47edf7a service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:39.878626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 694/1385] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:42:41.794659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95c835-002d-40c6-85eb-1dc124b4c17c None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:41.795264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95c835-002d-40c6-85eb-1dc124b4c17c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:41.795264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95c835-002d-40c6-85eb-1dc124b4c17c None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:41.796588 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 692/1386] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:41.804601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5f518-9918-49bf-a906-dc96ad0d63d6 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:41.806340 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5f518-9918-49bf-a906-dc96ad0d63d6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:41.806340 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5f518-9918-49bf-a906-dc96ad0d63d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:41.891956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-a0b5f518-9918-49bf-a906-dc96ad0d63d6 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:41.893166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a0b5f518-9918-49bf-a906-dc96ad0d63d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:42.004654 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 695/1387] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:42.383910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95c835-002d-40c6-85eb-1dc124b4c17c None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:42.385452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5b95c835-002d-40c6-85eb-1dc124b4c17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:42.465782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:42.543785 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95c835-002d-40c6-85eb-1dc124b4c17c None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:42.661860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dc2ea-a9d9-472c-bf8f-587114032148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:42.662463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dc2ea-a9d9-472c-bf8f-587114032148 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:42.662736 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dc2ea-a9d9-472c-bf8f-587114032148 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:42.663015 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dc2ea-a9d9-472c-bf8f-587114032148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:42.664678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-872dc2ea-a9d9-472c-bf8f-587114032148 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:42.704292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:42.756710 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dc2ea-a9d9-472c-bf8f-587114032148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:42.758972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dc2ea-a9d9-472c-bf8f-587114032148 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:42.777366 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 693/1388] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:42:44.857605 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349917c3-9bf1-416d-86c1-01fc7bfc35cf None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:44.858146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349917c3-9bf1-416d-86c1-01fc7bfc35cf None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:44.858146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349917c3-9bf1-416d-86c1-01fc7bfc35cf None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:44.859472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 696/1389] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:44.864961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75056e36-f510-4ead-9b9f-b07af40171b7 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:44.865491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75056e36-f510-4ead-9b9f-b07af40171b7 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:44.865606 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75056e36-f510-4ead-9b9f-b07af40171b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:44.935677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-75056e36-f510-4ead-9b9f-b07af40171b7 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:44.942311 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-75056e36-f510-4ead-9b9f-b07af40171b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:44.980639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c39417-9408-4b9b-8fab-11d73d00a872 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:44.980927 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c39417-9408-4b9b-8fab-11d73d00a872 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:44.981207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c39417-9408-4b9b-8fab-11d73d00a872 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:44.982593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 697/1390] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:44.988082 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd06cd-d0ee-4b69-ac02-ffbcb7a3d77e None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:44.988401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd06cd-d0ee-4b69-ac02-ffbcb7a3d77e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:44.989043 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd06cd-d0ee-4b69-ac02-ffbcb7a3d77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:45.027526 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:45.045024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 694/1391] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:45.061857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-eafd06cd-d0ee-4b69-ac02-ffbcb7a3d77e None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:45.063307 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-eafd06cd-d0ee-4b69-ac02-ffbcb7a3d77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:45.165114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 698/1392] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:42:45.338081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75056e36-f510-4ead-9b9f-b07af40171b7 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:45.339322 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-75056e36-f510-4ead-9b9f-b07af40171b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:45.353784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:45.456994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75056e36-f510-4ead-9b9f-b07af40171b7 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:45.470823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36feefb-b472-42ac-9d27-1b7f8b9e9ef7 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:45.471114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36feefb-b472-42ac-9d27-1b7f8b9e9ef7 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:45.471394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36feefb-b472-42ac-9d27-1b7f8b9e9ef7 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:45.472940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 699/1393] 10.222.0.62 () {54 vars in 967 bytes} [Mon Aug 29 22:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:45.479089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef929d-5819-4026-aebc-bfdce9cdf101 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:45.479370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef929d-5819-4026-aebc-bfdce9cdf101 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:45.479639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef929d-5819-4026-aebc-bfdce9cdf101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:45.560808 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-57ef929d-5819-4026-aebc-bfdce9cdf101 None None] MFA Rules not processed for user `3f7d8a79945a4e73839cd2ad995e016b`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:45.562223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-57ef929d-5819-4026-aebc-bfdce9cdf101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:45.576440 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead6b5b-bfb8-404f-9ac1-bd551196d433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:45.577067 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead6b5b-bfb8-404f-9ac1-bd551196d433 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:45.577339 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead6b5b-bfb8-404f-9ac1-bd551196d433 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:45.577605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead6b5b-bfb8-404f-9ac1-bd551196d433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:45.579248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-4ead6b5b-bfb8-404f-9ac1-bd551196d433 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:45.589427 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:45.612328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:45.643694 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 700/1394] 10.222.0.62 () {58 vars in 1064 bytes} [Mon Aug 29 22:42:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:42:45.652116 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef929d-5819-4026-aebc-bfdce9cdf101 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:45.660223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef929d-5819-4026-aebc-bfdce9cdf101 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:45.675667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead6b5b-bfb8-404f-9ac1-bd551196d433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:45.677344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead6b5b-bfb8-404f-9ac1-bd551196d433 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:45.695466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 695/1395] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:42:45.736919 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53344810-681a-4603-b854-85236865cac0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7d8a79945a4e73839cd2ad995e016b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:45.737534 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53344810-681a-4603-b854-85236865cac0 service glance] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:45.737815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53344810-681a-4603-b854-85236865cac0 service glance] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:45.738085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53344810-681a-4603-b854-85236865cac0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:45.739725 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-53344810-681a-4603-b854-85236865cac0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:45.853252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53344810-681a-4603-b854-85236865cac0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:45.854877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53344810-681a-4603-b854-85236865cac0 service glance] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:45.868701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:45.873303 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 701/1396] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:42:46.742484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527b12c-a794-440c-9ff3-882afebd078f None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:46.742484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527b12c-a794-440c-9ff3-882afebd078f None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:46.742484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527b12c-a794-440c-9ff3-882afebd078f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:46.819458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-8527b12c-a794-440c-9ff3-882afebd078f None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:46.820728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8527b12c-a794-440c-9ff3-882afebd078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:46.906662 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:46.910051 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 696/1397] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 29 22:42:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:46.956403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b3d7d-d7f6-48b3-83a3-0d626541c83d None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:46.957038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b3d7d-d7f6-48b3-83a3-0d626541c83d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:46.957038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b3d7d-d7f6-48b3-83a3-0d626541c83d None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:46.958489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 702/1398] 10.222.0.62 () {54 vars in 943 bytes} [Mon Aug 29 22:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:46.965524 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb929c52-1ccb-4262-a10a-795061d0c01e None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:46.965904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb929c52-1ccb-4262-a10a-795061d0c01e None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:46.966246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb929c52-1ccb-4262-a10a-795061d0c01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:47.044505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-cb929c52-1ccb-4262-a10a-795061d0c01e None None] MFA Rules not processed for user `a8cccf561d484373a7cb24c5f111900c`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:47.045736 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-cb929c52-1ccb-4262-a10a-795061d0c01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:47.172640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 697/1399] 10.222.0.62 () {58 vars in 1040 bytes} [Mon Aug 29 22:42:46 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:47.183070 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b3d7d-d7f6-48b3-83a3-0d626541c83d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:47.185684 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-cb3b3d7d-d7f6-48b3-83a3-0d626541c83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:47.350343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b3d7d-d7f6-48b3-83a3-0d626541c83d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:47.437625 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:47.457820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f1dec-3538-4a74-b03b-a0d05455b12b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:47.458426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f1dec-3538-4a74-b03b-a0d05455b12b service swift] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:47.458710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f1dec-3538-4a74-b03b-a0d05455b12b service swift] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:47.458987 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f1dec-3538-4a74-b03b-a0d05455b12b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:47.461156 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-899f1dec-3538-4a74-b03b-a0d05455b12b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:47.552245 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f1dec-3538-4a74-b03b-a0d05455b12b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:47.553975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f1dec-3538-4a74-b03b-a0d05455b12b service swift] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:47.563448 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 703/1400] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:42:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:42:47.868408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622526b-6adf-489d-8d37-83066d734103 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:47.868988 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622526b-6adf-489d-8d37-83066d734103 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:47.868988 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622526b-6adf-489d-8d37-83066d734103 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:47.870329 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 698/1401] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:47.875809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0efa3-d919-41d5-8746-a27937d5b0c2 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:47.876131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0efa3-d919-41d5-8746-a27937d5b0c2 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:47.876406 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0efa3-d919-41d5-8746-a27937d5b0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:47.947118 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-6fe0efa3-d919-41d5-8746-a27937d5b0c2 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:47.948598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-6fe0efa3-d919-41d5-8746-a27937d5b0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:48.027937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:48.064267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 704/1402] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:48.379546 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622526b-6adf-489d-8d37-83066d734103 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:48.381110 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-4622526b-6adf-489d-8d37-83066d734103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:48.468156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:48.575724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622526b-6adf-489d-8d37-83066d734103 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:48.715273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbc01e-729c-4b6b-94f3-7c42a79bf9e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:48.715807 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbc01e-729c-4b6b-94f3-7c42a79bf9e8 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:48.716102 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbc01e-729c-4b6b-94f3-7c42a79bf9e8 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:48.716389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbc01e-729c-4b6b-94f3-7c42a79bf9e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:48.718301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-bfcbc01e-729c-4b6b-94f3-7c42a79bf9e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:48.739009 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:48.838916 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbc01e-729c-4b6b-94f3-7c42a79bf9e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:48.841580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbc01e-729c-4b6b-94f3-7c42a79bf9e8 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:48.868165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 699/1403] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:42:51.173718 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef286a7-9737-4d91-a90b-41a0c27a8a39 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:51.175118 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef286a7-9737-4d91-a90b-41a0c27a8a39 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:51.175400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef286a7-9737-4d91-a90b-41a0c27a8a39 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:51.177309 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 705/1404] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:42:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:51.182280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecc988-fd99-4b82-a68e-d1ad686ac8d0 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:51.182726 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecc988-fd99-4b82-a68e-d1ad686ac8d0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:51.182932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecc988-fd99-4b82-a68e-d1ad686ac8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:51.255626 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-6cecc988-fd99-4b82-a68e-d1ad686ac8d0 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:51.256884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6cecc988-fd99-4b82-a68e-d1ad686ac8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:51.374722 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:51.380920 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 700/1405] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:42:51.683784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef286a7-9737-4d91-a90b-41a0c27a8a39 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:51.685431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9ef286a7-9737-4d91-a90b-41a0c27a8a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:51.846201 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef286a7-9737-4d91-a90b-41a0c27a8a39 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:51.908048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:51.978797 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5ab12-ff3f-4d5d-99f8-bc722b19f29b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:51.979410 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5ab12-ff3f-4d5d-99f8-bc722b19f29b service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:51.979690 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5ab12-ff3f-4d5d-99f8-bc722b19f29b service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:51.979966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5ab12-ff3f-4d5d-99f8-bc722b19f29b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:51.982933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c0e5ab12-ff3f-4d5d-99f8-bc722b19f29b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:52.102543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5ab12-ff3f-4d5d-99f8-bc722b19f29b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:52.104148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5ab12-ff3f-4d5d-99f8-bc722b19f29b service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:52.125247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 706/1406] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:42:54.309042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ca409-9468-40f9-a11d-16dfb837f3e7 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:54.309042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ca409-9468-40f9-a11d-16dfb837f3e7 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:54.309042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ca409-9468-40f9-a11d-16dfb837f3e7 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:54.312824 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 701/1407] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:42:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:42:54.314299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defb3f8-ede8-4c0a-851d-4a624fb5b9bd None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:54.315237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defb3f8-ede8-4c0a-851d-4a624fb5b9bd None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:54.316030 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defb3f8-ede8-4c0a-851d-4a624fb5b9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:54.392658 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-9defb3f8-ede8-4c0a-851d-4a624fb5b9bd None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:42:54.394147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9defb3f8-ede8-4c0a-851d-4a624fb5b9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:54.408505 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:54.507119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 707/1408] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:42:54.802468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ca409-9468-40f9-a11d-16dfb837f3e7 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:42:54.804079 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9c0ca409-9468-40f9-a11d-16dfb837f3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:54.997409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ca409-9468-40f9-a11d-16dfb837f3e7 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:42:55.090664 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:42:55.154281 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffda812-5c6b-4504-9308-d45fe9124bad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:42:55.155220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffda812-5c6b-4504-9308-d45fe9124bad service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:42:55.155661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffda812-5c6b-4504-9308-d45fe9124bad service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:42:55.156135 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffda812-5c6b-4504-9308-d45fe9124bad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:42:55.158014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-cffda812-5c6b-4504-9308-d45fe9124bad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:42:55.272596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffda812-5c6b-4504-9308-d45fe9124bad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:42:55.274752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffda812-5c6b-4504-9308-d45fe9124bad service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:42:55.297920 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 702/1409] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:04.506124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=38 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:05.578029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=64 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:11.622469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406edba-a951-411f-b223-4436f1d0f15f None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:11.623019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406edba-a951-411f-b223-4436f1d0f15f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:11.623019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406edba-a951-411f-b223-4436f1d0f15f None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:11.624389 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 708/1410] 10.222.0.62 () {54 vars in 918 bytes} [Mon Aug 29 22:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:11.629525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a69762-4e06-4cba-8fa5-8383fd0217d6 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:11.630100 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a69762-4e06-4cba-8fa5-8383fd0217d6 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:11.630100 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a69762-4e06-4cba-8fa5-8383fd0217d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:11.706947 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-51a69762-4e06-4cba-8fa5-8383fd0217d6 None None] MFA Rules not processed for user `2991c613878e4993901199434f384f49`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:11.708222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-51a69762-4e06-4cba-8fa5-8383fd0217d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:11.818545 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 703/1411] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Aug 29 22:43:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:11.832612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65399d02-7018-4921-ae6d-1b8974055bb3 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:11.832898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65399d02-7018-4921-ae6d-1b8974055bb3 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:11.833175 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65399d02-7018-4921-ae6d-1b8974055bb3 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:11.834532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 709/1412] 10.222.0.62 () {54 vars in 918 bytes} [Mon Aug 29 22:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:11.839822 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f33787-d454-4b38-a934-aae18f383fd0 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:11.840058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f33787-d454-4b38-a934-aae18f383fd0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:11.840370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f33787-d454-4b38-a934-aae18f383fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:11.917967 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:11.921218 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d9f33787-d454-4b38-a934-aae18f383fd0 None None] MFA Rules not processed for user `f06d910badb84c6aa6b48f3b56b91f82`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:11.922803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d9f33787-d454-4b38-a934-aae18f383fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:12.040463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 704/1413] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Aug 29 22:43:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:14.443105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ae3e1-2458-4b00-940d-800351298e7f None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:14.443621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ae3e1-2458-4b00-940d-800351298e7f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:14.443621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ae3e1-2458-4b00-940d-800351298e7f None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:14.444931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:14.450190 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9172d-e388-41bf-912c-524cb7a377ee None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:14.450645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9172d-e388-41bf-912c-524cb7a377ee None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:14.450749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9172d-e388-41bf-912c-524cb7a377ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:14.517288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-72a9172d-e388-41bf-912c-524cb7a377ee None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:14.518505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-72a9172d-e388-41bf-912c-524cb7a377ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:14.579008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:14.630040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:14.919273 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ae3e1-2458-4b00-940d-800351298e7f None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:14.920938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ab3ae3e1-2458-4b00-940d-800351298e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:15.072779 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ae3e1-2458-4b00-940d-800351298e7f None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:15.146343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:15.187277 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e96733-fee2-4df9-b16f-45ea907621e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:15.187808 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e96733-fee2-4df9-b16f-45ea907621e2 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:15.188119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e96733-fee2-4df9-b16f-45ea907621e2 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:15.188388 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e96733-fee2-4df9-b16f-45ea907621e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:15.189982 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-05e96733-fee2-4df9-b16f-45ea907621e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:15.283273 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e96733-fee2-4df9-b16f-45ea907621e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:15.284893 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e96733-fee2-4df9-b16f-45ea907621e2 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:15.303391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 711/1416] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:16.198614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427e66-3fed-4f7d-b4f4-30e27af4a564 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:16.199235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427e66-3fed-4f7d-b4f4-30e27af4a564 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:16.199235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427e66-3fed-4f7d-b4f4-30e27af4a564 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:16.200563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:16.205477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bce834-1824-4788-b23c-1592658ddf5a None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:16.205903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bce834-1824-4788-b23c-1592658ddf5a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:16.206010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bce834-1824-4788-b23c-1592658ddf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:16.281751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-60bce834-1824-4788-b23c-1592658ddf5a None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:16.282963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-60bce834-1824-4788-b23c-1592658ddf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:16.309703 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:16.383443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:16.535116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427e66-3fed-4f7d-b4f4-30e27af4a564 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:16.536581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ef427e66-3fed-4f7d-b4f4-30e27af4a564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:16.687305 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427e66-3fed-4f7d-b4f4-30e27af4a564 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:16.729209 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:16.806955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2703ba-20db-4792-99f9-1a4c45bb9933 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:16.807479 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2703ba-20db-4792-99f9-1a4c45bb9933 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:16.807755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2703ba-20db-4792-99f9-1a4c45bb9933 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:16.808065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2703ba-20db-4792-99f9-1a4c45bb9933 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:16.809731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6b2703ba-20db-4792-99f9-1a4c45bb9933 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:16.899749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2703ba-20db-4792-99f9-1a4c45bb9933 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:16.901410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2703ba-20db-4792-99f9-1a4c45bb9933 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:16.920361 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 707/1419] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:17.805963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae0747-754f-4fbb-bd5d-fb11d1731b1d None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:17.806541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae0747-754f-4fbb-bd5d-fb11d1731b1d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:17.806541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae0747-754f-4fbb-bd5d-fb11d1731b1d None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:17.807969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:17.813374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159007fe-e6e6-4086-a8e9-09c8619b31f8 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:17.813830 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159007fe-e6e6-4086-a8e9-09c8619b31f8 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:17.813946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159007fe-e6e6-4086-a8e9-09c8619b31f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:17.872661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:17.894535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-159007fe-e6e6-4086-a8e9-09c8619b31f8 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:17.895761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-159007fe-e6e6-4086-a8e9-09c8619b31f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:17.992553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:18.143881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae0747-754f-4fbb-bd5d-fb11d1731b1d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:18.145132 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-92ae0747-754f-4fbb-bd5d-fb11d1731b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:18.293631 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae0747-754f-4fbb-bd5d-fb11d1731b1d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:18.306792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:18.409833 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100f1e4-e3ae-4a30-9cd6-8b8a7af1ca62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:18.410346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100f1e4-e3ae-4a30-9cd6-8b8a7af1ca62 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:18.410626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100f1e4-e3ae-4a30-9cd6-8b8a7af1ca62 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:18.410898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100f1e4-e3ae-4a30-9cd6-8b8a7af1ca62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:18.412541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9100f1e4-e3ae-4a30-9cd6-8b8a7af1ca62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:18.502918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100f1e4-e3ae-4a30-9cd6-8b8a7af1ca62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:18.504573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100f1e4-e3ae-4a30-9cd6-8b8a7af1ca62 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:18.523003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 714/1422] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:19.389604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32852f-7de6-48a6-83d5-f3f96a4ece07 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:19.390126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32852f-7de6-48a6-83d5-f3f96a4ece07 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:19.390126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32852f-7de6-48a6-83d5-f3f96a4ece07 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:19.391532 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:19.396708 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ce5ac-d330-489e-8397-d90e62f7fabb None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:19.397212 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ce5ac-d330-489e-8397-d90e62f7fabb None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:19.397324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ce5ac-d330-489e-8397-d90e62f7fabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:19.417667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:19.476724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-887ce5ac-d330-489e-8397-d90e62f7fabb None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:19.477976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-887ce5ac-d330-489e-8397-d90e62f7fabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:19.573900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:19.726564 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32852f-7de6-48a6-83d5-f3f96a4ece07 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:19.728116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9f32852f-7de6-48a6-83d5-f3f96a4ece07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:19.840209 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:19.880438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32852f-7de6-48a6-83d5-f3f96a4ece07 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:19.995773 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9bb452-f9c1-44f2-bf84-08d152cacdee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:19.996408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bb452-f9c1-44f2-bf84-08d152cacdee service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:19.996691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bb452-f9c1-44f2-bf84-08d152cacdee service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:19.996962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bb452-f9c1-44f2-bf84-08d152cacdee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:19.998571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-4e9bb452-f9c1-44f2-bf84-08d152cacdee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:20.076202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:20.089726 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9bb452-f9c1-44f2-bf84-08d152cacdee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:20.091474 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9bb452-f9c1-44f2-bf84-08d152cacdee service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:20.110862 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 710/1425] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:20.984789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a4ffa-50d7-4094-ad40-e9d852ad35e6 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:20.985357 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a4ffa-50d7-4094-ad40-e9d852ad35e6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:20.985357 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a4ffa-50d7-4094-ad40-e9d852ad35e6 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:20.986594 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:20.991611 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb632ad3-55be-40c1-b267-8c24f3d04687 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:20.992007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb632ad3-55be-40c1-b267-8c24f3d04687 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:20.992175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb632ad3-55be-40c1-b267-8c24f3d04687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:21.067071 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-eb632ad3-55be-40c1-b267-8c24f3d04687 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:21.068295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-eb632ad3-55be-40c1-b267-8c24f3d04687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:21.167760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:21.318989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a4ffa-50d7-4094-ad40-e9d852ad35e6 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:21.321200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-912a4ffa-50d7-4094-ad40-e9d852ad35e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:21.405237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:21.469583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a4ffa-50d7-4094-ad40-e9d852ad35e6 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:21.588552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da109215-ab3f-43e5-a5f6-1584d911b13a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:21.588882 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da109215-ab3f-43e5-a5f6-1584d911b13a service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:21.589164 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da109215-ab3f-43e5-a5f6-1584d911b13a service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:21.589438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da109215-ab3f-43e5-a5f6-1584d911b13a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:21.591092 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-da109215-ab3f-43e5-a5f6-1584d911b13a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:21.640557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:21.683409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da109215-ab3f-43e5-a5f6-1584d911b13a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:21.685066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da109215-ab3f-43e5-a5f6-1584d911b13a service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:21.703174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 717/1428] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:22.595757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c30228-fd9d-4bc3-8b76-bd21daf1d80b None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:22.596362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c30228-fd9d-4bc3-8b76-bd21daf1d80b None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:22.596362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c30228-fd9d-4bc3-8b76-bd21daf1d80b None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:22.597695 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:22.602673 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b2aba-db40-4812-92de-84f20508092b None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:22.603086 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b2aba-db40-4812-92de-84f20508092b None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:22.603360 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b2aba-db40-4812-92de-84f20508092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:22.679561 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-891b2aba-db40-4812-92de-84f20508092b None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:22.680790 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-891b2aba-db40-4812-92de-84f20508092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:22.776536 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:22.935257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c30228-fd9d-4bc3-8b76-bd21daf1d80b None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:22.936715 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b5c30228-fd9d-4bc3-8b76-bd21daf1d80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:22.986371 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:23.082650 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c30228-fd9d-4bc3-8b76-bd21daf1d80b None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:23.196162 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d60b7-f62a-4a05-ac5b-834bd5c6b635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:23.196719 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d60b7-f62a-4a05-ac5b-834bd5c6b635 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:23.196997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d60b7-f62a-4a05-ac5b-834bd5c6b635 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:23.197271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d60b7-f62a-4a05-ac5b-834bd5c6b635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:23.198913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ed6d60b7-f62a-4a05-ac5b-834bd5c6b635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:23.210236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:23.295292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d60b7-f62a-4a05-ac5b-834bd5c6b635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:23.296918 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d60b7-f62a-4a05-ac5b-834bd5c6b635 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:23.316155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 713/1431] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:24.193486 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081c005-b2d5-460c-9e11-e1ab4ec4e481 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:24.194067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081c005-b2d5-460c-9e11-e1ab4ec4e481 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:24.194067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081c005-b2d5-460c-9e11-e1ab4ec4e481 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:24.195933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:24.200890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ceffa1-d4ea-4eec-9f9d-a4198a619ce6 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:24.201336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ceffa1-d4ea-4eec-9f9d-a4198a619ce6 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:24.201450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ceffa1-d4ea-4eec-9f9d-a4198a619ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:24.277307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-e9ceffa1-d4ea-4eec-9f9d-a4198a619ce6 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:24.278518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e9ceffa1-d4ea-4eec-9f9d-a4198a619ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:24.346699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:24.375059 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:43:24.526571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081c005-b2d5-460c-9e11-e1ab4ec4e481 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:24.528034 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4081c005-b2d5-460c-9e11-e1ab4ec4e481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:24.545700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:24.678229 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081c005-b2d5-460c-9e11-e1ab4ec4e481 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:24.768527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:24.794896 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb63322-994f-480c-b0c9-379b0b630d25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:24.795427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb63322-994f-480c-b0c9-379b0b630d25 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:24.795705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb63322-994f-480c-b0c9-379b0b630d25 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:24.795971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb63322-994f-480c-b0c9-379b0b630d25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:24.797614 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-5fb63322-994f-480c-b0c9-379b0b630d25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:24.887591 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb63322-994f-480c-b0c9-379b0b630d25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:24.889226 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb63322-994f-480c-b0c9-379b0b630d25 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:24.908686 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 720/1434] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:25.772004 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280a182-1f11-4d82-970b-732db5c47048 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:25.772556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280a182-1f11-4d82-970b-732db5c47048 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:25.772556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280a182-1f11-4d82-970b-732db5c47048 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:25.773970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:25.778945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317df69a-391e-4fd7-a137-110b99200609 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:25.779368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317df69a-391e-4fd7-a137-110b99200609 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:25.779529 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317df69a-391e-4fd7-a137-110b99200609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:25.854933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-317df69a-391e-4fd7-a137-110b99200609 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:25.856059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-317df69a-391e-4fd7-a137-110b99200609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:25.897550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:25.952377 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:26.104687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280a182-1f11-4d82-970b-732db5c47048 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:26.108343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-0280a182-1f11-4d82-970b-732db5c47048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:26.253997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280a182-1f11-4d82-970b-732db5c47048 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:26.308427 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:26.369356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ee077-deb9-430b-b9cc-ad00a5c2b88b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:26.369876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ee077-deb9-430b-b9cc-ad00a5c2b88b service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:26.370158 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ee077-deb9-430b-b9cc-ad00a5c2b88b service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:26.370436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ee077-deb9-430b-b9cc-ad00a5c2b88b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:26.372031 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-070ee077-deb9-430b-b9cc-ad00a5c2b88b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:26.460661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ee077-deb9-430b-b9cc-ad00a5c2b88b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:26.462241 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ee077-deb9-430b-b9cc-ad00a5c2b88b service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:26.480289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 716/1437] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:27.352756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834435f-0346-45a4-9f6e-31bff387ff6e None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:27.353282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834435f-0346-45a4-9f6e-31bff387ff6e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:27.353391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834435f-0346-45a4-9f6e-31bff387ff6e None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:27.354713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:27.359698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d661a42-6e8c-4e93-887e-5ce9a1408287 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:27.360144 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d661a42-6e8c-4e93-887e-5ce9a1408287 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:27.360271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d661a42-6e8c-4e93-887e-5ce9a1408287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:27.437644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-1d661a42-6e8c-4e93-887e-5ce9a1408287 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:27.438862 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1d661a42-6e8c-4e93-887e-5ce9a1408287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:27.440935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:27.538086 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:27.688898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834435f-0346-45a4-9f6e-31bff387ff6e None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:27.690454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c834435f-0346-45a4-9f6e-31bff387ff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:27.841865 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834435f-0346-45a4-9f6e-31bff387ff6e None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:27.869711 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:27.955574 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e878aa-1924-4b8e-b36a-2ddb91c49180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:27.956201 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e878aa-1924-4b8e-b36a-2ddb91c49180 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:27.956482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e878aa-1924-4b8e-b36a-2ddb91c49180 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:27.956754 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e878aa-1924-4b8e-b36a-2ddb91c49180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:27.958375 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-07e878aa-1924-4b8e-b36a-2ddb91c49180 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:28.048745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e878aa-1924-4b8e-b36a-2ddb91c49180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:28.051204 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e878aa-1924-4b8e-b36a-2ddb91c49180 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:28.069461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 723/1440] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:29.957008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ac5b6-a6ba-4314-9475-a2ac8bab3070 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:29.957522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ac5b6-a6ba-4314-9475-a2ac8bab3070 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:29.957522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ac5b6-a6ba-4314-9475-a2ac8bab3070 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:29.958826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:29.964861 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947d752-4c6f-41ca-91d8-0c69042cf7b4 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:29.965332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947d752-4c6f-41ca-91d8-0c69042cf7b4 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:29.965429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947d752-4c6f-41ca-91d8-0c69042cf7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:30.012198 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:30.040316 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-e947d752-4c6f-41ca-91d8-0c69042cf7b4 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:30.041645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e947d752-4c6f-41ca-91d8-0c69042cf7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:30.153338 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:30.456935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ac5b6-a6ba-4314-9475-a2ac8bab3070 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:30.458508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-c00ac5b6-a6ba-4314-9475-a2ac8bab3070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:30.566495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ac5b6-a6ba-4314-9475-a2ac8bab3070 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:30.601128 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:30.643139 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0d1a9-cd5c-4fc2-b009-6f60d910ad8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:30.643757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0d1a9-cd5c-4fc2-b009-6f60d910ad8f service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:30.643960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0d1a9-cd5c-4fc2-b009-6f60d910ad8f service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:30.644268 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0d1a9-cd5c-4fc2-b009-6f60d910ad8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:30.645867 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b3c0d1a9-cd5c-4fc2-b009-6f60d910ad8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:30.756970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0d1a9-cd5c-4fc2-b009-6f60d910ad8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:30.758902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0d1a9-cd5c-4fc2-b009-6f60d910ad8f service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:30.777358 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 719/1443] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:32.870527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46094788-6ef5-4fbe-a013-111bb812b101 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:32.871111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46094788-6ef5-4fbe-a013-111bb812b101 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:32.871111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46094788-6ef5-4fbe-a013-111bb812b101 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:32.872343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:32.877558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75df5b0-46f5-4046-9b60-3d725dd2c1ec None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:32.878018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75df5b0-46f5-4046-9b60-3d725dd2c1ec None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:32.878125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75df5b0-46f5-4046-9b60-3d725dd2c1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:32.944336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d75df5b0-46f5-4046-9b60-3d725dd2c1ec None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:32.946046 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d75df5b0-46f5-4046-9b60-3d725dd2c1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:32.959129 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:33.046069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:33.333173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46094788-6ef5-4fbe-a013-111bb812b101 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:33.334710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-46094788-6ef5-4fbe-a013-111bb812b101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:33.438488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46094788-6ef5-4fbe-a013-111bb812b101 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:33.451346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:33.514010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be647b77-b908-4f47-b6ed-603e1d9dc4bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:33.514618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be647b77-b908-4f47-b6ed-603e1d9dc4bc service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:33.514899 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be647b77-b908-4f47-b6ed-603e1d9dc4bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:33.515171 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be647b77-b908-4f47-b6ed-603e1d9dc4bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:33.516815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-be647b77-b908-4f47-b6ed-603e1d9dc4bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:33.630875 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be647b77-b908-4f47-b6ed-603e1d9dc4bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:33.632360 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be647b77-b908-4f47-b6ed-603e1d9dc4bc service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:33.650355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 726/1446] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:35.927026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152556c6-44a0-44ae-a274-e37032ee6401 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:35.927642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152556c6-44a0-44ae-a274-e37032ee6401 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:35.927642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152556c6-44a0-44ae-a274-e37032ee6401 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:35.928880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:35.934223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edd4cd-d2e8-4b6e-b163-59bdc3199d3e None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:35.934674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edd4cd-d2e8-4b6e-b163-59bdc3199d3e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:35.934800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edd4cd-d2e8-4b6e-b163-59bdc3199d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:35.984740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:36.003125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-94edd4cd-d2e8-4b6e-b163-59bdc3199d3e None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:36.004392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-94edd4cd-d2e8-4b6e-b163-59bdc3199d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:36.104320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:36.390208 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152556c6-44a0-44ae-a274-e37032ee6401 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:36.391734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-152556c6-44a0-44ae-a274-e37032ee6401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:36.495967 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152556c6-44a0-44ae-a274-e37032ee6401 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:36.535349 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:36.570428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd694aa-f499-4961-b673-2bf4e46433b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:36.571041 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd694aa-f499-4961-b673-2bf4e46433b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:36.571320 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd694aa-f499-4961-b673-2bf4e46433b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:36.571592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd694aa-f499-4961-b673-2bf4e46433b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:36.573322 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-cbd694aa-f499-4961-b673-2bf4e46433b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:36.685223 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd694aa-f499-4961-b673-2bf4e46433b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:36.686583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd694aa-f499-4961-b673-2bf4e46433b9 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:36.706575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 722/1449] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:43:38.779140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159884df-1a16-4111-95a3-e269195b29b1 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:38.779709 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159884df-1a16-4111-95a3-e269195b29b1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:38.779808 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159884df-1a16-4111-95a3-e269195b29b1 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:38.781141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:43:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:38.786678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ae9b5-860a-4ca5-894d-4478692f7b02 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:38.787123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ae9b5-860a-4ca5-894d-4478692f7b02 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:38.787254 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ae9b5-860a-4ca5-894d-4478692f7b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:38.854727 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-a21ae9b5-860a-4ca5-894d-4478692f7b02 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:38.855884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a21ae9b5-860a-4ca5-894d-4478692f7b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:38.876525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:38.957761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:39.244902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159884df-1a16-4111-95a3-e269195b29b1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:39.246483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-159884df-1a16-4111-95a3-e269195b29b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:39.362178 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159884df-1a16-4111-95a3-e269195b29b1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:39.382782 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:39.437516 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efdcc1-7b6f-4aaa-8bf1-b7f15189d781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:39.438157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efdcc1-7b6f-4aaa-8bf1-b7f15189d781 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:39.438434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efdcc1-7b6f-4aaa-8bf1-b7f15189d781 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:39.438703 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efdcc1-7b6f-4aaa-8bf1-b7f15189d781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:39.440358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-94efdcc1-7b6f-4aaa-8bf1-b7f15189d781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:39.557250 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efdcc1-7b6f-4aaa-8bf1-b7f15189d781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:39.558598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efdcc1-7b6f-4aaa-8bf1-b7f15189d781 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:39.576580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 729/1452] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:41.569497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b1e7d-43d7-40f2-a76b-321be1481df9 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:41.570048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b1e7d-43d7-40f2-a76b-321be1481df9 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:41.570048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b1e7d-43d7-40f2-a76b-321be1481df9 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:41.571406 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:41.576790 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b7c26-3971-4202-a0d9-28c46dd585e6 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:41.577222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b7c26-3971-4202-a0d9-28c46dd585e6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:41.577355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b7c26-3971-4202-a0d9-28c46dd585e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:41.641585 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:41.644524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-c16b7c26-3971-4202-a0d9-28c46dd585e6 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:41.645750 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c16b7c26-3971-4202-a0d9-28c46dd585e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:41.744886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:42.038744 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b1e7d-43d7-40f2-a76b-321be1481df9 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:42.040365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b63b1e7d-43d7-40f2-a76b-321be1481df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:42.144917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b1e7d-43d7-40f2-a76b-321be1481df9 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:42.194048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:42.219197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34958476-e881-43c1-8dc8-c184f0c301aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:42.219804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34958476-e881-43c1-8dc8-c184f0c301aa service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:42.220141 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34958476-e881-43c1-8dc8-c184f0c301aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:42.220416 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34958476-e881-43c1-8dc8-c184f0c301aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:42.222701 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-34958476-e881-43c1-8dc8-c184f0c301aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:42.330535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34958476-e881-43c1-8dc8-c184f0c301aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:42.331960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34958476-e881-43c1-8dc8-c184f0c301aa service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:42.350427 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 725/1455] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:44.320459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7201907-25de-492a-9c0d-de4991845e7a None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:44.321035 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7201907-25de-492a-9c0d-de4991845e7a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:44.321035 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7201907-25de-492a-9c0d-de4991845e7a None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:44.322387 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:44.327758 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11625-3a69-4d3e-920f-785e2c23f925 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:44.328276 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11625-3a69-4d3e-920f-785e2c23f925 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:44.328382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11625-3a69-4d3e-920f-785e2c23f925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:44.395573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-ebe11625-3a69-4d3e-920f-785e2c23f925 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:44.396743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ebe11625-3a69-4d3e-920f-785e2c23f925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:44.426354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:44.494549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:43:44.780926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7201907-25de-492a-9c0d-de4991845e7a None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:44.782500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d7201907-25de-492a-9c0d-de4991845e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:44.889346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7201907-25de-492a-9c0d-de4991845e7a None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:44.919787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:44.966822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec330ae-57be-4ae6-9615-da02966350e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:44.967424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec330ae-57be-4ae6-9615-da02966350e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:44.967707 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec330ae-57be-4ae6-9615-da02966350e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:44.967985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec330ae-57be-4ae6-9615-da02966350e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:44.969657 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4ec330ae-57be-4ae6-9615-da02966350e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:45.079314 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec330ae-57be-4ae6-9615-da02966350e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:45.080787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec330ae-57be-4ae6-9615-da02966350e7 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:45.100946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 732/1458] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:47.075188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10079cd6-0f2c-4ec5-b5a4-23c5e7de8f0d None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:47.075740 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10079cd6-0f2c-4ec5-b5a4-23c5e7de8f0d None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:47.075740 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10079cd6-0f2c-4ec5-b5a4-23c5e7de8f0d None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:47.077127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:47.082440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb9c79-e74f-4b44-a112-6c573acc1dd2 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:47.086836 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb9c79-e74f-4b44-a112-6c573acc1dd2 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:47.086836 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb9c79-e74f-4b44-a112-6c573acc1dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:47.271550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-d5fb9c79-e74f-4b44-a112-6c573acc1dd2 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:47.272842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d5fb9c79-e74f-4b44-a112-6c573acc1dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:47.281542 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:47.376026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:47.657736 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10079cd6-0f2c-4ec5-b5a4-23c5e7de8f0d None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:47.659309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-10079cd6-0f2c-4ec5-b5a4-23c5e7de8f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:47.762265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10079cd6-0f2c-4ec5-b5a4-23c5e7de8f0d None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:47.817702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:47.836351 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252a4e6-bd3f-487f-9e41-61a6096c1cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:47.836957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252a4e6-bd3f-487f-9e41-61a6096c1cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:47.837238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252a4e6-bd3f-487f-9e41-61a6096c1cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:47.837510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252a4e6-bd3f-487f-9e41-61a6096c1cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:47.839111 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8252a4e6-bd3f-487f-9e41-61a6096c1cd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:47.947005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252a4e6-bd3f-487f-9e41-61a6096c1cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:47.948374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252a4e6-bd3f-487f-9e41-61a6096c1cd4 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:47.967465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 728/1461] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:49.953457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97735604-0fa4-4007-ab19-ca10d8a05252 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:49.954017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97735604-0fa4-4007-ab19-ca10d8a05252 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:49.954017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97735604-0fa4-4007-ab19-ca10d8a05252 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:49.955339 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:49.961616 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adfc26-71b1-4185-a2ea-f4687c0d32f9 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:49.962232 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adfc26-71b1-4185-a2ea-f4687c0d32f9 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:49.962232 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adfc26-71b1-4185-a2ea-f4687c0d32f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:50.029679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-99adfc26-71b1-4185-a2ea-f4687c0d32f9 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:50.030896 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-99adfc26-71b1-4185-a2ea-f4687c0d32f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:50.069501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:50.127941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:50.408597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97735604-0fa4-4007-ab19-ca10d8a05252 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:50.410189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-97735604-0fa4-4007-ab19-ca10d8a05252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:50.514933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97735604-0fa4-4007-ab19-ca10d8a05252 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:50.552726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:50.590626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b4680-673b-4a93-80f1-b17517db944e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:50.591234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b4680-673b-4a93-80f1-b17517db944e service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:50.591513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b4680-673b-4a93-80f1-b17517db944e service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:50.591785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b4680-673b-4a93-80f1-b17517db944e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:50.593487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-df3b4680-673b-4a93-80f1-b17517db944e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:50.707241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b4680-673b-4a93-80f1-b17517db944e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:50.708677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b4680-673b-4a93-80f1-b17517db944e service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:50.729866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 735/1464] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:52.672821 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5f356-d73b-45b8-af34-01bed4835d56 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:52.673492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5f356-d73b-45b8-af34-01bed4835d56 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:52.673492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5f356-d73b-45b8-af34-01bed4835d56 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:52.677372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:43:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:52.683470 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d240868-5dad-467d-93d0-6db88eb82f98 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:52.684013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d240868-5dad-467d-93d0-6db88eb82f98 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:52.684013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d240868-5dad-467d-93d0-6db88eb82f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:52.750655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-8d240868-5dad-467d-93d0-6db88eb82f98 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:52.751871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8d240868-5dad-467d-93d0-6db88eb82f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:52.769449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:52.848620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:53.136451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5f356-d73b-45b8-af34-01bed4835d56 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:53.138048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b6e5f356-d73b-45b8-af34-01bed4835d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:53.241745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5f356-d73b-45b8-af34-01bed4835d56 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:53.307701 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:53.314060 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a4c56-2dca-4252-80e8-fc1e8907568e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:53.314668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a4c56-2dca-4252-80e8-fc1e8907568e service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:53.314951 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a4c56-2dca-4252-80e8-fc1e8907568e service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:53.315221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a4c56-2dca-4252-80e8-fc1e8907568e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:53.316843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-df2a4c56-2dca-4252-80e8-fc1e8907568e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:53.436556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a4c56-2dca-4252-80e8-fc1e8907568e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:53.437908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a4c56-2dca-4252-80e8-fc1e8907568e service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:53.456613 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 731/1467] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:55.400995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366cfc5-11d6-4ffb-9a90-0d51b7e4c0a7 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:55.401518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366cfc5-11d6-4ffb-9a90-0d51b7e4c0a7 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:55.401518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366cfc5-11d6-4ffb-9a90-0d51b7e4c0a7 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:55.402820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:55.407977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c0886-1523-4097-b85b-6e707f92b855 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:55.408471 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c0886-1523-4097-b85b-6e707f92b855 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:55.408569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c0886-1523-4097-b85b-6e707f92b855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:55.476484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-e02c0886-1523-4097-b85b-6e707f92b855 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:55.477590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e02c0886-1523-4097-b85b-6e707f92b855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:55.526180 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:55.575952 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:55.864776 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366cfc5-11d6-4ffb-9a90-0d51b7e4c0a7 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:55.866371 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9366cfc5-11d6-4ffb-9a90-0d51b7e4c0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:55.971128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366cfc5-11d6-4ffb-9a90-0d51b7e4c0a7 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:56.021414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:56.048886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65e390-910f-4c50-8ebf-8b46ae13d908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:56.049736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65e390-910f-4c50-8ebf-8b46ae13d908 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:56.050024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65e390-910f-4c50-8ebf-8b46ae13d908 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:56.050301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65e390-910f-4c50-8ebf-8b46ae13d908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:56.051905 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8a65e390-910f-4c50-8ebf-8b46ae13d908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:56.162958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65e390-910f-4c50-8ebf-8b46ae13d908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:56.164355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65e390-910f-4c50-8ebf-8b46ae13d908 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:56.182802 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 738/1470] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:44:05.574095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=22 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:06.180553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=66 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:15.840386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4857a8-a1e6-4fb6-86f2-caa92440756f None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:15.840927 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4857a8-a1e6-4fb6-86f2-caa92440756f None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:15.840927 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4857a8-a1e6-4fb6-86f2-caa92440756f None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:15.842244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 733/1471] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:44:15.847457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5727d-e4ff-41b5-a769-c4fbf3893ce9 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:15.847858 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5727d-e4ff-41b5-a769-c4fbf3893ce9 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:15.848041 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5727d-e4ff-41b5-a769-c4fbf3893ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:15.914879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-83b5727d-e4ff-41b5-a769-c4fbf3893ce9 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:44:15.916128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-83b5727d-e4ff-41b5-a769-c4fbf3893ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:16.014955 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 739/1472] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:44:16.310890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43936111-b53c-44c1-a269-9180e1f2df16 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:16.311173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43936111-b53c-44c1-a269-9180e1f2df16 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:16.311455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43936111-b53c-44c1-a269-9180e1f2df16 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:16.312885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 734/1473] 10.222.0.62 () {54 vars in 967 bytes} [Mon Aug 29 22:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:44:16.317561 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263430f-ca49-4890-8523-3f6a2f823403 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:16.317840 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263430f-ca49-4890-8523-3f6a2f823403 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:16.318727 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263430f-ca49-4890-8523-3f6a2f823403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:16.393225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-7263430f-ca49-4890-8523-3f6a2f823403 None None] MFA Rules not processed for user `3f7d8a79945a4e73839cd2ad995e016b`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:44:16.394428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-7263430f-ca49-4890-8523-3f6a2f823403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:16.414938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:16.470393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 740/1474] 10.222.0.62 () {58 vars in 1064 bytes} [Mon Aug 29 22:44:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:44:16.478370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43936111-b53c-44c1-a269-9180e1f2df16 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:44:16.479914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-43936111-b53c-44c1-a269-9180e1f2df16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:16.704608 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43936111-b53c-44c1-a269-9180e1f2df16 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:44:16.780436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84b688-7841-4daa-b8d5-147678f0cd6e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7d8a79945a4e73839cd2ad995e016b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:44:16.781039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84b688-7841-4daa-b8d5-147678f0cd6e service glance] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:16.781314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84b688-7841-4daa-b8d5-147678f0cd6e service glance] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:16.781583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84b688-7841-4daa-b8d5-147678f0cd6e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:16.783173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ff84b688-7841-4daa-b8d5-147678f0cd6e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:16.838940 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:16.897425 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84b688-7841-4daa-b8d5-147678f0cd6e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:44:16.898908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84b688-7841-4daa-b8d5-147678f0cd6e service glance] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:44:16.917492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 735/1475] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:44:18.919146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd893a4-c639-4e55-b0f2-a8ff146f76b1 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:18.919723 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd893a4-c639-4e55-b0f2-a8ff146f76b1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:18.919723 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd893a4-c639-4e55-b0f2-a8ff146f76b1 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:18.921135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 741/1476] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:44:18.926847 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb9c4a-080b-49a0-a335-e1a7348912e3 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:18.927278 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb9c4a-080b-49a0-a335-e1a7348912e3 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:18.927385 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb9c4a-080b-49a0-a335-e1a7348912e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:18.994016 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-34eb9c4a-080b-49a0-a335-e1a7348912e3 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:44:18.995218 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-34eb9c4a-080b-49a0-a335-e1a7348912e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:19.093302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 736/1477] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:44:19.369121 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd893a4-c639-4e55-b0f2-a8ff146f76b1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:44:19.369992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4dd893a4-c639-4e55-b0f2-a8ff146f76b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:19.500558 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd893a4-c639-4e55-b0f2-a8ff146f76b1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:44:19.548877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:19.595005 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66640da-14e4-4570-8247-e2d0a67d47ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:44:19.595617 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66640da-14e4-4570-8247-e2d0a67d47ee admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:19.595893 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66640da-14e4-4570-8247-e2d0a67d47ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:19.596193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66640da-14e4-4570-8247-e2d0a67d47ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:19.596831 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66640da-14e4-4570-8247-e2d0a67d47ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:44:19.598551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: WARNING py.warnings [None req-d66640da-14e4-4570-8247-e2d0a67d47ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:44:19.598551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: warnings.warn(msg) Aug 29 22:44:19.598551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: Aug 29 22:44:19.600213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66640da-14e4-4570-8247-e2d0a67d47ee admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:44:19.619842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 742/1478] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 29 22:44:19 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:44:21.600014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee68145-f6b3-46a7-af6d-26126d57887b None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:21.600476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee68145-f6b3-46a7-af6d-26126d57887b None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:21.600579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee68145-f6b3-46a7-af6d-26126d57887b None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:21.602005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 737/1479] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:44:21.607477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe645dad-d4ff-44f7-9964-b8b30eb5cc1d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:21.607928 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe645dad-d4ff-44f7-9964-b8b30eb5cc1d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:21.608025 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe645dad-d4ff-44f7-9964-b8b30eb5cc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:21.676065 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-fe645dad-d4ff-44f7-9964-b8b30eb5cc1d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:44:21.677294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-fe645dad-d4ff-44f7-9964-b8b30eb5cc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:21.774225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 743/1480] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:44:22.069271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee68145-f6b3-46a7-af6d-26126d57887b None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:44:22.070821 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-eee68145-f6b3-46a7-af6d-26126d57887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:22.080706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:22.220042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee68145-f6b3-46a7-af6d-26126d57887b None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:44:22.298933 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:22.332492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbea784-c60d-4a8c-be86-215a6e56868c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:44:22.333105 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbea784-c60d-4a8c-be86-215a6e56868c service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:22.333385 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbea784-c60d-4a8c-be86-215a6e56868c service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:22.333691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbea784-c60d-4a8c-be86-215a6e56868c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:22.335288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-fcbea784-c60d-4a8c-be86-215a6e56868c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:22.423695 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbea784-c60d-4a8c-be86-215a6e56868c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:44:22.425559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbea784-c60d-4a8c-be86-215a6e56868c service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:44:22.444160 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 738/1481] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:44:24.553401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fc69a-b182-458e-99a8-89d0a2096344 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:24.553988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fc69a-b182-458e-99a8-89d0a2096344 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:24.553988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fc69a-b182-458e-99a8-89d0a2096344 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:24.555277 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 744/1482] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:44:24.560596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ddf06-9875-4260-b0c3-4cf88a563486 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:24.560988 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ddf06-9875-4260-b0c3-4cf88a563486 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:24.561168 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ddf06-9875-4260-b0c3-4cf88a563486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:24.628513 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-794ddf06-9875-4260-b0c3-4cf88a563486 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:44:24.629727 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-794ddf06-9875-4260-b0c3-4cf88a563486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:24.675204 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:24.725046 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 739/1483] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:44:25.027236 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fc69a-b182-458e-99a8-89d0a2096344 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:44:25.028835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-720fc69a-b182-458e-99a8-89d0a2096344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:25.053270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:25.142249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fc69a-b182-458e-99a8-89d0a2096344 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:44:25.223079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4c8f0-18db-42aa-b943-41d4ffa810b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:44:25.223688 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4c8f0-18db-42aa-b943-41d4ffa810b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:25.224696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4c8f0-18db-42aa-b943-41d4ffa810b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:25.224903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4c8f0-18db-42aa-b943-41d4ffa810b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:25.226572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c3f4c8f0-18db-42aa-b943-41d4ffa810b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:25.307925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:25.339808 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4c8f0-18db-42aa-b943-41d4ffa810b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:44:25.344194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4c8f0-18db-42aa-b943-41d4ffa810b2 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:44:25.360341 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 745/1484] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:44:27.330575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0850c-d59b-49f8-965d-badaf5a9c755 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:27.331137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0850c-d59b-49f8-965d-badaf5a9c755 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:27.331137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0850c-d59b-49f8-965d-badaf5a9c755 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:27.332533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 740/1485] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:44:27.337810 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f84167-5ef0-44ea-b5b0-4adda6e46db5 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:27.338265 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f84167-5ef0-44ea-b5b0-4adda6e46db5 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:27.338374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f84167-5ef0-44ea-b5b0-4adda6e46db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:27.403477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-71f84167-5ef0-44ea-b5b0-4adda6e46db5 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:44:27.404722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-71f84167-5ef0-44ea-b5b0-4adda6e46db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:27.499223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 746/1486] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:44:27.789096 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0850c-d59b-49f8-965d-badaf5a9c755 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:44:27.790617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-fdb0850c-d59b-49f8-965d-badaf5a9c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:27.893504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0850c-d59b-49f8-965d-badaf5a9c755 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:44:27.967132 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:27.968931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5a09b-a54c-4321-83cc-484172bab414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:44:27.969538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5a09b-a54c-4321-83cc-484172bab414 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:27.969819 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5a09b-a54c-4321-83cc-484172bab414 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:27.970089 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5a09b-a54c-4321-83cc-484172bab414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:27.971697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9dc5a09b-a54c-4321-83cc-484172bab414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:28.080760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5a09b-a54c-4321-83cc-484172bab414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:44:28.082230 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5a09b-a54c-4321-83cc-484172bab414 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:44:28.101899 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 741/1487] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:44:30.116861 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740cb4d-be0b-4b0d-a893-2850a13092f3 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:30.117464 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740cb4d-be0b-4b0d-a893-2850a13092f3 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:30.117464 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740cb4d-be0b-4b0d-a893-2850a13092f3 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:30.118784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 747/1488] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:44:30.124146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25705ad-52b6-4993-94e7-57fc50179d55 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:30.124628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25705ad-52b6-4993-94e7-57fc50179d55 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:30.124729 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25705ad-52b6-4993-94e7-57fc50179d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:30.190838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d25705ad-52b6-4993-94e7-57fc50179d55 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:44:30.192053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d25705ad-52b6-4993-94e7-57fc50179d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:30.247063 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:30.291887 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 742/1489] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:44:30.592911 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740cb4d-be0b-4b0d-a893-2850a13092f3 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:44:30.594488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-5740cb4d-be0b-4b0d-a893-2850a13092f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:30.643909 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:30.717725 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740cb4d-be0b-4b0d-a893-2850a13092f3 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:44:30.795802 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538d0da-161d-4fe1-a497-4e5c3a94fa20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:44:30.796430 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538d0da-161d-4fe1-a497-4e5c3a94fa20 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:30.796704 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538d0da-161d-4fe1-a497-4e5c3a94fa20 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:30.796975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538d0da-161d-4fe1-a497-4e5c3a94fa20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:30.798571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f538d0da-161d-4fe1-a497-4e5c3a94fa20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:30.887084 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:30.916855 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538d0da-161d-4fe1-a497-4e5c3a94fa20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:44:30.918297 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538d0da-161d-4fe1-a497-4e5c3a94fa20 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:44:30.937673 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 748/1490] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:44:33.337961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fc11d-72f2-4166-9609-0184c55db5aa None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:33.338630 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fc11d-72f2-4166-9609-0184c55db5aa None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:33.338630 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fc11d-72f2-4166-9609-0184c55db5aa None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:33.340040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 743/1491] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 29 22:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:44:33.345552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5146f-372b-4a3e-8f5c-be91de3fea05 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:33.345937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5146f-372b-4a3e-8f5c-be91de3fea05 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:33.346120 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5146f-372b-4a3e-8f5c-be91de3fea05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:33.415014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-2bf5146f-372b-4a3e-8f5c-be91de3fea05 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:44:33.416298 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2bf5146f-372b-4a3e-8f5c-be91de3fea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:33.516614 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 749/1492] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 29 22:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:44:33.809898 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fc11d-72f2-4166-9609-0184c55db5aa None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:44:33.811426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a76fc11d-72f2-4166-9609-0184c55db5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:33.914961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fc11d-72f2-4166-9609-0184c55db5aa None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:44:33.988736 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db3925-10f2-40b9-9154-d55383b1f08d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:44:33.989957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db3925-10f2-40b9-9154-d55383b1f08d service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:44:33.990239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db3925-10f2-40b9-9154-d55383b1f08d service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:44:33.990507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db3925-10f2-40b9-9154-d55383b1f08d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:44:33.992151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-12db3925-10f2-40b9-9154-d55383b1f08d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:44:34.001376 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:34.106529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db3925-10f2-40b9-9154-d55383b1f08d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:44:34.107968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db3925-10f2-40b9-9154-d55383b1f08d service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:44:34.126093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 744/1493] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:44:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:44:43.514809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=82 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:44.123781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=50 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:55.972493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cd87f-a427-484a-9ff8-bf33e8a50713 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:55.973119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cd87f-a427-484a-9ff8-bf33e8a50713 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:55.973119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cd87f-a427-484a-9ff8-bf33e8a50713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:56.050141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-cc9cd87f-a427-484a-9ff8-bf33e8a50713 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:56.051353 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-cc9cd87f-a427-484a-9ff8-bf33e8a50713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:56.147517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 750/1494] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:56.155682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41a7ae-2c0f-4c54-839f-5b7fd81affde None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:56.156214 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41a7ae-2c0f-4c54-839f-5b7fd81affde None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:56.156312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41a7ae-2c0f-4c54-839f-5b7fd81affde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:56.231241 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-8c41a7ae-2c0f-4c54-839f-5b7fd81affde None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:56.232398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8c41a7ae-2c0f-4c54-839f-5b7fd81affde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:56.335887 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 745/1495] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:56.340569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cd87f-a427-484a-9ff8-bf33e8a50713 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:56.341839 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-cc9cd87f-a427-484a-9ff8-bf33e8a50713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:56.353412 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cd87f-a427-484a-9ff8-bf33e8a50713 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:56.415222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:56.449748 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c2e13-47cc-4250-9fd6-f0a11da93d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:56.450356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c2e13-47cc-4250-9fd6-f0a11da93d40 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:56.450631 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c2e13-47cc-4250-9fd6-f0a11da93d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:56.450904 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c2e13-47cc-4250-9fd6-f0a11da93d40 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:56.451547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c2e13-47cc-4250-9fd6-f0a11da93d40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:56.451847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c2e13-47cc-4250-9fd6-f0a11da93d40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:56.452902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: WARNING py.warnings [None req-302c2e13-47cc-4250-9fd6-f0a11da93d40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:45:56.452902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: warnings.warn(msg) Aug 29 22:45:56.452902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: Aug 29 22:45:56.453797 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c2e13-47cc-4250-9fd6-f0a11da93d40 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:56.465649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 751/1496] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:56.474338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41a7ae-2c0f-4c54-839f-5b7fd81affde None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:56.483795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41a7ae-2c0f-4c54-839f-5b7fd81affde None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:56.544473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:56.580187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e130562-bbd4-4d9d-998c-4a303e051938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:56.580187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e130562-bbd4-4d9d-998c-4a303e051938 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:56.580187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e130562-bbd4-4d9d-998c-4a303e051938 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:56.581618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e130562-bbd4-4d9d-998c-4a303e051938 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:56.581940 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e130562-bbd4-4d9d-998c-4a303e051938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:56.583697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: WARNING py.warnings [None req-2e130562-bbd4-4d9d-998c-4a303e051938 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:45:56.583697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: warnings.warn(msg) Aug 29 22:45:56.583697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: Aug 29 22:45:56.584931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e130562-bbd4-4d9d-998c-4a303e051938 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:56.707805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 746/1497] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:56 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:56.712238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c2e13-47cc-4250-9fd6-f0a11da93d40 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:56.713776 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-302c2e13-47cc-4250-9fd6-f0a11da93d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:56.749522 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c2e13-47cc-4250-9fd6-f0a11da93d40 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:56.844249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca1dea-b3f7-4e53-8446-17a3e1e0dc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:56.844853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca1dea-b3f7-4e53-8446-17a3e1e0dc95 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:56.845126 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca1dea-b3f7-4e53-8446-17a3e1e0dc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:56.845396 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca1dea-b3f7-4e53-8446-17a3e1e0dc95 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:56.846534 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca1dea-b3f7-4e53-8446-17a3e1e0dc95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:56.847556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: WARNING py.warnings [None req-92ca1dea-b3f7-4e53-8446-17a3e1e0dc95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:45:56.847556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: warnings.warn(msg) Aug 29 22:45:56.847556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: Aug 29 22:45:56.848780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca1dea-b3f7-4e53-8446-17a3e1e0dc95 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:56.973675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 752/1498] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:56 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:56.978277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e130562-bbd4-4d9d-998c-4a303e051938 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:56.980010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-2e130562-bbd4-4d9d-998c-4a303e051938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:57.045672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e130562-bbd4-4d9d-998c-4a303e051938 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:57.130317 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:57.140538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d026a-13e8-4942-9fd8-d568654dfeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:57.141182 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d026a-13e8-4942-9fd8-d568654dfeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:57.141452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d026a-13e8-4942-9fd8-d568654dfeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:57.141720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d026a-13e8-4942-9fd8-d568654dfeb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:57.142356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d026a-13e8-4942-9fd8-d568654dfeb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:57.143355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: WARNING py.warnings [None req-2f6d026a-13e8-4942-9fd8-d568654dfeb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:45:57.143355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: warnings.warn(msg) Aug 29 22:45:57.143355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: Aug 29 22:45:57.144255 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d026a-13e8-4942-9fd8-d568654dfeb0 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:57.156601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 747/1499] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:57.160970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca1dea-b3f7-4e53-8446-17a3e1e0dc95 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:57.162484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-92ca1dea-b3f7-4e53-8446-17a3e1e0dc95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:57.175230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca1dea-b3f7-4e53-8446-17a3e1e0dc95 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:57.200528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:57.272863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60eaed8-65a1-468a-a11b-93caabf78863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:57.273469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eaed8-65a1-468a-a11b-93caabf78863 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:57.273743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eaed8-65a1-468a-a11b-93caabf78863 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:57.274010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eaed8-65a1-468a-a11b-93caabf78863 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:57.274659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60eaed8-65a1-468a-a11b-93caabf78863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:57.278257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: WARNING py.warnings [None req-f60eaed8-65a1-468a-a11b-93caabf78863 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:45:57.278257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: warnings.warn(msg) Aug 29 22:45:57.278257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: Aug 29 22:45:57.279176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60eaed8-65a1-468a-a11b-93caabf78863 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:57.294154 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 753/1500] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:57.299741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d026a-13e8-4942-9fd8-d568654dfeb0 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:57.301358 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-2f6d026a-13e8-4942-9fd8-d568654dfeb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:57.336758 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d026a-13e8-4942-9fd8-d568654dfeb0 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:57.429598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7d93b-1d9c-477b-85b4-982ec731682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:57.430250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d93b-1d9c-477b-85b4-982ec731682c admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:57.430552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d93b-1d9c-477b-85b4-982ec731682c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:57.430820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d93b-1d9c-477b-85b4-982ec731682c admin admin] PATH_INFO: `/v3/projects/54d7bd442aaf4ddeaa4007dd9e6ccffc/users/a20297d147c14d4c992eadaf2d4fa07c/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:57.452330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7d93b-1d9c-477b-85b4-982ec731682c admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d7bd442aaf4ddeaa4007dd9e6ccffc, user_id=a20297d147c14d4c992eadaf2d4fa07c, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:57.453340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: WARNING py.warnings [None req-f8f7d93b-1d9c-477b-85b4-982ec731682c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:45:57.453340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: warnings.warn(msg) Aug 29 22:45:57.453340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: Aug 29 22:45:57.455760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7d93b-1d9c-477b-85b4-982ec731682c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:57.539229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 748/1501] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:57 2022] PUT /identity/v3/projects/54d7bd442aaf4ddeaa4007dd9e6ccffc/users/a20297d147c14d4c992eadaf2d4fa07c/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:57.552539 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b952f-dd10-4cb5-b70a-db1519615cf2 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:57.552764 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b952f-dd10-4cb5-b70a-db1519615cf2 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:57.553040 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b952f-dd10-4cb5-b70a-db1519615cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:57.616554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-b77b952f-dd10-4cb5-b70a-db1519615cf2 None None] MFA Rules not processed for user `a20297d147c14d4c992eadaf2d4fa07c`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:57.617777 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b77b952f-dd10-4cb5-b70a-db1519615cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:57.698570 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 754/1502] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:45:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:57.711859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35834795-e344-47ff-bc31-52ee7ad1a4d7 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:57.712204 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35834795-e344-47ff-bc31-52ee7ad1a4d7 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:57.712485 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35834795-e344-47ff-bc31-52ee7ad1a4d7 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:57.713871 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 749/1503] 10.222.0.62 () {54 vars in 964 bytes} [Mon Aug 29 22:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:45:57.718736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91df27-b10e-4bae-a871-990392b59ff5 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:57.719027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91df27-b10e-4bae-a871-990392b59ff5 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:57.719302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91df27-b10e-4bae-a871-990392b59ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:57.751604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:57.796017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-0d91df27-b10e-4bae-a871-990392b59ff5 None None] MFA Rules not processed for user `29b630aac21b405eb114f5f1fd1294ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:57.797265 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0d91df27-b10e-4bae-a871-990392b59ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:57.873377 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 755/1504] 10.222.0.62 () {58 vars in 1061 bytes} [Mon Aug 29 22:45:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:57.881314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35834795-e344-47ff-bc31-52ee7ad1a4d7 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:57.882809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-35834795-e344-47ff-bc31-52ee7ad1a4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:57.939654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:57.997258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35834795-e344-47ff-bc31-52ee7ad1a4d7 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:58.072805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b58f2-e281-47fb-9ad6-8f6bed020404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:58.073419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b58f2-e281-47fb-9ad6-8f6bed020404 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:58.073702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b58f2-e281-47fb-9ad6-8f6bed020404 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:58.073976 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b58f2-e281-47fb-9ad6-8f6bed020404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:58.075718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b71b58f2-e281-47fb-9ad6-8f6bed020404 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:58.174102 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b58f2-e281-47fb-9ad6-8f6bed020404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:58.175922 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b58f2-e281-47fb-9ad6-8f6bed020404 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:58.179345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:58.193123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 750/1505] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:58.240829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90f806-3162-450d-a868-382c8054bd39 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:58.241260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90f806-3162-450d-a868-382c8054bd39 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:58.241363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90f806-3162-450d-a868-382c8054bd39 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:58.242601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 756/1506] 10.222.0.62 () {52 vars in 830 bytes} [Mon Aug 29 22:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:45:58.246256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b58f2-e281-47fb-9ad6-8f6bed020404 service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:58.247465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b71b58f2-e281-47fb-9ad6-8f6bed020404 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:58.345798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b58f2-e281-47fb-9ad6-8f6bed020404 service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:58.438885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759f639-c20f-40fb-bbf3-e38e1057946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:58.439435 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759f639-c20f-40fb-bbf3-e38e1057946c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:58.440264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759f639-c20f-40fb-bbf3-e38e1057946c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:58.440541 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759f639-c20f-40fb-bbf3-e38e1057946c admin admin] PATH_INFO: `/v3/users/a20297d147c14d4c992eadaf2d4fa07c` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:58.452588 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759f639-c20f-40fb-bbf3-e38e1057946c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20297d147c14d4c992eadaf2d4fa07c)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:58.453598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: WARNING py.warnings [None req-6759f639-c20f-40fb-bbf3-e38e1057946c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:45:58.453598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: warnings.warn(msg) Aug 29 22:45:58.453598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: Aug 29 22:45:58.454812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759f639-c20f-40fb-bbf3-e38e1057946c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:58.464983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:58.634776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6759f639-c20f-40fb-bbf3-e38e1057946c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20297d147c14d4c992eadaf2d4fa07c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.658022 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6759f639-c20f-40fb-bbf3-e38e1057946c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20297d147c14d4c992eadaf2d4fa07c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.710559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6759f639-c20f-40fb-bbf3-e38e1057946c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20297d147c14d4c992eadaf2d4fa07c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.710923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6759f639-c20f-40fb-bbf3-e38e1057946c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20297d147c14d4c992eadaf2d4fa07c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.711470 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6759f639-c20f-40fb-bbf3-e38e1057946c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20297d147c14d4c992eadaf2d4fa07c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.731962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 751/1507] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:58 2022] DELETE /identity/v3/users/a20297d147c14d4c992eadaf2d4fa07c => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:58.737223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da690e-1076-4ba1-8354-bebd6672482f None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:58.737525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da690e-1076-4ba1-8354-bebd6672482f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:58.737796 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da690e-1076-4ba1-8354-bebd6672482f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:58.795541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-42da690e-1076-4ba1-8354-bebd6672482f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:58.796764 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-42da690e-1076-4ba1-8354-bebd6672482f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:58.872344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:58.885402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 757/1508] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:58.896884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759f639-c20f-40fb-bbf3-e38e1057946c admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:58.898125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6759f639-c20f-40fb-bbf3-e38e1057946c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:59.001611 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759f639-c20f-40fb-bbf3-e38e1057946c admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:59.057531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:59.077005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a155b-d35e-4163-97a3-dc1882c22de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:59.081689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a155b-d35e-4163-97a3-dc1882c22de3 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:59.081689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a155b-d35e-4163-97a3-dc1882c22de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:59.081689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a155b-d35e-4163-97a3-dc1882c22de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:59.081689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-4c8a155b-d35e-4163-97a3-dc1882c22de3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:59.192565 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a155b-d35e-4163-97a3-dc1882c22de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:59.194028 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a155b-d35e-4163-97a3-dc1882c22de3 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:59.212232 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 752/1509] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:59.679087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da690e-1076-4ba1-8354-bebd6672482f None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:59.684013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-42da690e-1076-4ba1-8354-bebd6672482f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:59.692202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da690e-1076-4ba1-8354-bebd6672482f None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:59.791374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:59.792007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:59.792387 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:59.792662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01 admin admin] PATH_INFO: `/v3/projects/54d7bd442aaf4ddeaa4007dd9e6ccffc` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:59.802937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d7bd442aaf4ddeaa4007dd9e6ccffc)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:59.803976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: WARNING py.warnings [None req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:45:59.803976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: warnings.warn(msg) Aug 29 22:45:59.803976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: Aug 29 22:45:59.805210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:59.911193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d7bd442aaf4ddeaa4007dd9e6ccffc', 'request_id': 'req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:59.924972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d7bd442aaf4ddeaa4007dd9e6ccffc', 'request_id': 'req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:00.042048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d7bd442aaf4ddeaa4007dd9e6ccffc', 'request_id': 'req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:00.066745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01 admin admin] The token cache is being invalidate because project 54d7bd442aaf4ddeaa4007dd9e6ccffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:00.067066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:00.067500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-0d0d7c7b-9dc0-4466-ba55-9e3d77b3fc01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:00.068931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 758/1510] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:59 2022] DELETE /identity/v3/projects/54d7bd442aaf4ddeaa4007dd9e6ccffc => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:09.209994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=62 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:10.064167 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:41.396973 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff02342-22d8-4473-8383-f929feb39f2e None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:41.397590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff02342-22d8-4473-8383-f929feb39f2e None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:41.397590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff02342-22d8-4473-8383-f929feb39f2e None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:41.398868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:47:41.404054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c34ae-cb23-4aa3-af00-0c46d733e1b9 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:41.404532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c34ae-cb23-4aa3-af00-0c46d733e1b9 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:41.404635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c34ae-cb23-4aa3-af00-0c46d733e1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:41.488839 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-7c6c34ae-cb23-4aa3-af00-0c46d733e1b9 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:41.490045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-7c6c34ae-cb23-4aa3-af00-0c46d733e1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:41.593696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:41.749256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff02342-22d8-4473-8383-f929feb39f2e None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:41.751333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3ff02342-22d8-4473-8383-f929feb39f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:41.876510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff02342-22d8-4473-8383-f929feb39f2e None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:41.881995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047907c-0542-4082-886d-3890a3de6d3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:41.882603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047907c-0542-4082-886d-3890a3de6d3b service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:41.882891 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047907c-0542-4082-886d-3890a3de6d3b service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:41.883227 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047907c-0542-4082-886d-3890a3de6d3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:41.891227 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047907c-0542-4082-886d-3890a3de6d3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:41.892837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047907c-0542-4082-886d-3890a3de6d3b service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:41.902240 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 754/1513] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:47:42.737193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a221af-1708-419e-9bd0-ff95de4e7cce None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:42.737722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a221af-1708-419e-9bd0-ff95de4e7cce None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:42.737722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a221af-1708-419e-9bd0-ff95de4e7cce None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:42.739093 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:47:42.744174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0c197-b880-4e68-88e8-4298c650d5ce None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:42.744601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0c197-b880-4e68-88e8-4298c650d5ce None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:42.744717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0c197-b880-4e68-88e8-4298c650d5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:42.764523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-1be0c197-b880-4e68-88e8-4298c650d5ce None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:42.765715 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1be0c197-b880-4e68-88e8-4298c650d5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:42.774188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:42.926835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a221af-1708-419e-9bd0-ff95de4e7cce None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:42.941249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a221af-1708-419e-9bd0-ff95de4e7cce None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:42.947622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6ea4b-ab83-4b65-a5c8-7420d0330473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:42.948268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6ea4b-ab83-4b65-a5c8-7420d0330473 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:42.948577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6ea4b-ab83-4b65-a5c8-7420d0330473 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:42.948848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6ea4b-ab83-4b65-a5c8-7420d0330473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:42.957549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6ea4b-ab83-4b65-a5c8-7420d0330473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:42.959148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6ea4b-ab83-4b65-a5c8-7420d0330473 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:42.969074 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 761/1516] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:47:43.645967 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbf8cd-caa9-45c1-961e-479475c47bec None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:43.646245 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbf8cd-caa9-45c1-961e-479475c47bec None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:43.646520 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbf8cd-caa9-45c1-961e-479475c47bec None None] PATH_INFO: `/v3` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:43.647814 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 756/1517] 10.222.0.15 () {54 vars in 925 bytes} [Mon Aug 29 22:47:43 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:47:43.659553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45445b07-6cae-498c-8f96-b53acd909e8d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:43.659866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45445b07-6cae-498c-8f96-b53acd909e8d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:43.660761 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45445b07-6cae-498c-8f96-b53acd909e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:43.725306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-45445b07-6cae-498c-8f96-b53acd909e8d None None] MFA Rules not processed for user `2991c613878e4993901199434f384f49`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:43.726508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-45445b07-6cae-498c-8f96-b53acd909e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:43.744586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:43.800265 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 762/1518] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Aug 29 22:47:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:47.811140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6ee8b-747f-4484-91f5-62f5b322a543 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:47.811676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6ee8b-747f-4484-91f5-62f5b322a543 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:47.811676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6ee8b-747f-4484-91f5-62f5b322a543 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:47.812972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 757/1519] 10.222.0.62 () {54 vars in 961 bytes} [Mon Aug 29 22:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:47:47.818240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18802cb-72d6-4011-b43b-272902acbc0d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:47.818676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18802cb-72d6-4011-b43b-272902acbc0d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:47.818780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18802cb-72d6-4011-b43b-272902acbc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:47.838190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-d18802cb-72d6-4011-b43b-272902acbc0d None None] MFA Rules not processed for user `2991c613878e4993901199434f384f49`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:47.839387 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d18802cb-72d6-4011-b43b-272902acbc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:47.848429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 763/1520] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Aug 29 22:47:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:47.856135 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6ee8b-747f-4484-91f5-62f5b322a543 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:47.869953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6ee8b-747f-4484-91f5-62f5b322a543 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:47.874910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517a148-2574-4d58-9ad1-e8a939dc0f04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2991c613878e4993901199434f384f49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:47.875501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517a148-2574-4d58-9ad1-e8a939dc0f04 service placement] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:47.875778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517a148-2574-4d58-9ad1-e8a939dc0f04 service placement] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:47.876050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517a148-2574-4d58-9ad1-e8a939dc0f04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:47.884248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517a148-2574-4d58-9ad1-e8a939dc0f04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:47.885820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517a148-2574-4d58-9ad1-e8a939dc0f04 service placement] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:47.895424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 758/1521] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:47:54.195517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ed05-8cae-40e0-ba4d-70a3684c4cf1 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:54.196122 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ed05-8cae-40e0-ba4d-70a3684c4cf1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:54.196122 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ed05-8cae-40e0-ba4d-70a3684c4cf1 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:54.197486 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:47:54.202358 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57ff48-1f0a-4911-acf2-f35a107738c4 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:54.202801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57ff48-1f0a-4911-acf2-f35a107738c4 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:54.202935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57ff48-1f0a-4911-acf2-f35a107738c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:54.223590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-6a57ff48-1f0a-4911-acf2-f35a107738c4 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:54.224845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6a57ff48-1f0a-4911-acf2-f35a107738c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:54.238583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:54.392767 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7ed05-8cae-40e0-ba4d-70a3684c4cf1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:54.408177 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7ed05-8cae-40e0-ba4d-70a3684c4cf1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:54.414612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c549bdb-830c-451a-9748-1f8410a59f67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:54.415307 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c549bdb-830c-451a-9748-1f8410a59f67 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:54.415573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c549bdb-830c-451a-9748-1f8410a59f67 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:54.415847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c549bdb-830c-451a-9748-1f8410a59f67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:54.425320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c549bdb-830c-451a-9748-1f8410a59f67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:54.426912 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c549bdb-830c-451a-9748-1f8410a59f67 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:54.437455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 765/1524] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:47:55.274613 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa502ff-9b0d-4c92-9986-ce817cdb0028 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:55.275159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa502ff-9b0d-4c92-9986-ce817cdb0028 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:55.275159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa502ff-9b0d-4c92-9986-ce817cdb0028 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:55.276658 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:47:55.281559 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cee4bb-e49d-4738-9358-65606e554f42 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:55.281984 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cee4bb-e49d-4738-9358-65606e554f42 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:55.282100 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cee4bb-e49d-4738-9358-65606e554f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:55.303684 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-71cee4bb-e49d-4738-9358-65606e554f42 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:55.304928 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-71cee4bb-e49d-4738-9358-65606e554f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:55.312888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:55.467674 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa502ff-9b0d-4c92-9986-ce817cdb0028 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:55.484157 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa502ff-9b0d-4c92-9986-ce817cdb0028 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:55.490554 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4ce76-1965-41d8-8425-66ae34bc5d55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:55.491165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4ce76-1965-41d8-8425-66ae34bc5d55 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:55.491445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4ce76-1965-41d8-8425-66ae34bc5d55 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:55.491723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4ce76-1965-41d8-8425-66ae34bc5d55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:55.500028 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4ce76-1965-41d8-8425-66ae34bc5d55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:55.501627 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4ce76-1965-41d8-8425-66ae34bc5d55 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:55.511607 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 761/1527] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:47:59.811111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96d651-fcac-468b-b77e-07da681ef5b7 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:59.811635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96d651-fcac-468b-b77e-07da681ef5b7 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:59.811635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96d651-fcac-468b-b77e-07da681ef5b7 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:59.813026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:47:59.818565 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d65690-2085-4199-94bd-faef66a61967 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:59.819042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d65690-2085-4199-94bd-faef66a61967 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:59.819155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d65690-2085-4199-94bd-faef66a61967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:59.838378 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-68d65690-2085-4199-94bd-faef66a61967 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:59.844166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-68d65690-2085-4199-94bd-faef66a61967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:59.848393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:48:00.141653 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96d651-fcac-468b-b77e-07da681ef5b7 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:48:00.143364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-7e96d651-fcac-468b-b77e-07da681ef5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:00.233867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96d651-fcac-468b-b77e-07da681ef5b7 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:48:00.237547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a801113-cc34-4cb7-afef-a9a6324fddbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:48:00.238154 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a801113-cc34-4cb7-afef-a9a6324fddbd service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:00.238438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a801113-cc34-4cb7-afef-a9a6324fddbd service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:00.238717 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a801113-cc34-4cb7-afef-a9a6324fddbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:00.251100 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a801113-cc34-4cb7-afef-a9a6324fddbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:48:00.252642 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a801113-cc34-4cb7-afef-a9a6324fddbd service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:48:00.262274 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 768/1530] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:48:02.207408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc121d23-99ff-4239-ba20-7d5f1faae9bf None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:02.207944 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc121d23-99ff-4239-ba20-7d5f1faae9bf None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:02.208057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc121d23-99ff-4239-ba20-7d5f1faae9bf None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:02.209373 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:48:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:48:02.214605 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924dd37-6442-4daf-bffc-38c3ded9ee25 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:02.214990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924dd37-6442-4daf-bffc-38c3ded9ee25 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:02.215145 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924dd37-6442-4daf-bffc-38c3ded9ee25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:02.235100 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-1924dd37-6442-4daf-bffc-38c3ded9ee25 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:48:02.236335 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-1924dd37-6442-4daf-bffc-38c3ded9ee25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:02.244290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:48:02.533943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc121d23-99ff-4239-ba20-7d5f1faae9bf None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:48:02.535666 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-bc121d23-99ff-4239-ba20-7d5f1faae9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:02.548669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc121d23-99ff-4239-ba20-7d5f1faae9bf None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:48:02.553139 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a99f5-cd1f-4b6e-ac5c-60553ccdac50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:48:02.553764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a99f5-cd1f-4b6e-ac5c-60553ccdac50 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:02.554039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a99f5-cd1f-4b6e-ac5c-60553ccdac50 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:02.554364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a99f5-cd1f-4b6e-ac5c-60553ccdac50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:02.563293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a99f5-cd1f-4b6e-ac5c-60553ccdac50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:48:02.564738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a99f5-cd1f-4b6e-ac5c-60553ccdac50 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:48:02.574813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 764/1533] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:48:06.188348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc62f-3f15-427d-a28f-cccf37ca1f12 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:06.188915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc62f-3f15-427d-a28f-cccf37ca1f12 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:06.188915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc62f-3f15-427d-a28f-cccf37ca1f12 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:06.190312 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:48:06.196109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457abc9-e576-42ab-a1c3-d27c5a36fda7 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:06.196556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457abc9-e576-42ab-a1c3-d27c5a36fda7 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:06.196834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457abc9-e576-42ab-a1c3-d27c5a36fda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:06.216414 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-9457abc9-e576-42ab-a1c3-d27c5a36fda7 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:48:06.217602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9457abc9-e576-42ab-a1c3-d27c5a36fda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:06.225677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:48:06.778100 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecc62f-3f15-427d-a28f-cccf37ca1f12 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:48:06.779803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-bdecc62f-3f15-427d-a28f-cccf37ca1f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:06.849820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:06.863368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecc62f-3f15-427d-a28f-cccf37ca1f12 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:48:06.868116 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29c893-2ad9-42eb-8e48-77ac9e2958cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:48:06.868724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29c893-2ad9-42eb-8e48-77ac9e2958cc service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:06.868977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29c893-2ad9-42eb-8e48-77ac9e2958cc service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:06.869243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29c893-2ad9-42eb-8e48-77ac9e2958cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:06.878247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29c893-2ad9-42eb-8e48-77ac9e2958cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:48:06.879667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29c893-2ad9-42eb-8e48-77ac9e2958cc service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:48:06.889132 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 771/1536] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:48:08.821744 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b0b5b-761d-4608-a3fc-2dba9c76522c None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:08.822393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b0b5b-761d-4608-a3fc-2dba9c76522c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:08.822393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b0b5b-761d-4608-a3fc-2dba9c76522c None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:08.823624 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:48:08.828722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829838e-ad9b-47a6-b180-c5edd4d4a73e None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:08.829180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829838e-ad9b-47a6-b180-c5edd4d4a73e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:08.829286 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829838e-ad9b-47a6-b180-c5edd4d4a73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:08.850259 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-e829838e-ad9b-47a6-b180-c5edd4d4a73e None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:48:08.851391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e829838e-ad9b-47a6-b180-c5edd4d4a73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:08.859444 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:48:09.413452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b0b5b-761d-4608-a3fc-2dba9c76522c None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:48:09.415099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-686b0b5b-761d-4608-a3fc-2dba9c76522c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:09.422760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=84 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:09.429342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b0b5b-761d-4608-a3fc-2dba9c76522c None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:48:09.432915 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c06ef1-978a-4cce-80c7-a26cd5bea9dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:48:09.433529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c06ef1-978a-4cce-80c7-a26cd5bea9dd service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:09.433804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c06ef1-978a-4cce-80c7-a26cd5bea9dd service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:09.434075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c06ef1-978a-4cce-80c7-a26cd5bea9dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:09.443883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c06ef1-978a-4cce-80c7-a26cd5bea9dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:48:09.445399 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c06ef1-978a-4cce-80c7-a26cd5bea9dd service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:48:09.454870 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 767/1539] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:48:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:48:18.843929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=11 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:19.461448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:38.660117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357fd47-3bff-499c-b16f-b4c29d773cc0 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:38.660886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357fd47-3bff-499c-b16f-b4c29d773cc0 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:38.660886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357fd47-3bff-499c-b16f-b4c29d773cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:38.689989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-3357fd47-3bff-499c-b16f-b4c29d773cc0 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:38.691220 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3357fd47-3bff-499c-b16f-b4c29d773cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:38.704916 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 773/1540] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:38.714677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa99af-d109-422a-be41-cae4a047cb8b None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:38.715238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa99af-d109-422a-be41-cae4a047cb8b None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:38.715238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa99af-d109-422a-be41-cae4a047cb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:38.739345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-c8fa99af-d109-422a-be41-cae4a047cb8b None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:38.740589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-c8fa99af-d109-422a-be41-cae4a047cb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:38.750354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 768/1541] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:38.755570 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357fd47-3bff-499c-b16f-b4c29d773cc0 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:38.765837 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357fd47-3bff-499c-b16f-b4c29d773cc0 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:38.773453 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4168be-c4af-4f22-9366-24af8d1a03a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:38.774601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4168be-c4af-4f22-9366-24af8d1a03a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:38.774893 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4168be-c4af-4f22-9366-24af8d1a03a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:38.775174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4168be-c4af-4f22-9366-24af8d1a03a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:38.775839 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4168be-c4af-4f22-9366-24af8d1a03a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:49:38.776169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4168be-c4af-4f22-9366-24af8d1a03a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:38.777792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4168be-c4af-4f22-9366-24af8d1a03a3 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:38.795369 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 774/1542] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:49:38.804626 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa99af-d109-422a-be41-cae4a047cb8b None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:38.814399 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa99af-d109-422a-be41-cae4a047cb8b None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:38.819147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e8fdd-faec-43fc-978e-a6b11c055d47 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:38.819432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e8fdd-faec-43fc-978e-a6b11c055d47 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:38.819713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e8fdd-faec-43fc-978e-a6b11c055d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:38.826152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7324ac8-cdcd-45c0-9764-84ae98a33e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:38.826777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7324ac8-cdcd-45c0-9764-84ae98a33e2e admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:38.827058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7324ac8-cdcd-45c0-9764-84ae98a33e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:38.827332 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7324ac8-cdcd-45c0-9764-84ae98a33e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:38.827970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7324ac8-cdcd-45c0-9764-84ae98a33e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:38.829945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7324ac8-cdcd-45c0-9764-84ae98a33e2e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:38.858298 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-d55e8fdd-faec-43fc-978e-a6b11c055d47 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:38.860001 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d55e8fdd-faec-43fc-978e-a6b11c055d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:38.878510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 775/1543] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:38.879762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa90ea6-e01e-4cfe-ae60-da2d606181fa None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:38.880052 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa90ea6-e01e-4cfe-ae60-da2d606181fa None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:38.886586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa90ea6-e01e-4cfe-ae60-da2d606181fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:38.911983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-dfa90ea6-e01e-4cfe-ae60-da2d606181fa None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:38.913269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-dfa90ea6-e01e-4cfe-ae60-da2d606181fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:38.921578 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 776/1544] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:38.923355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0903ab2-58f7-45cc-89a3-157cbfe213e6 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:38.923885 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0903ab2-58f7-45cc-89a3-157cbfe213e6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:38.924230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0903ab2-58f7-45cc-89a3-157cbfe213e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:38.944854 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-c0903ab2-58f7-45cc-89a3-157cbfe213e6 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:38.946222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c0903ab2-58f7-45cc-89a3-157cbfe213e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:38.954636 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 777/1545] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:38.955788 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2dd3c-2d31-4ee2-9c2f-8c48fbc6d832 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:38.956104 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2dd3c-2d31-4ee2-9c2f-8c48fbc6d832 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:38.956402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2dd3c-2d31-4ee2-9c2f-8c48fbc6d832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:38.976227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-65f2dd3c-2d31-4ee2-9c2f-8c48fbc6d832 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:38.977960 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-65f2dd3c-2d31-4ee2-9c2f-8c48fbc6d832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:38.985883 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 778/1546] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:38.987036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc6da1-16ae-4ca6-9869-58b064d1cc5b None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:38.987321 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc6da1-16ae-4ca6-9869-58b064d1cc5b None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:38.987597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc6da1-16ae-4ca6-9869-58b064d1cc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.004969 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 769/1547] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:49:38 2022] POST /identity/v3/projects => generated 389 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:39.006477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e654215-4cbe-46d2-8498-3783d4d68300 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.006645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-e9cc6da1-16ae-4ca6-9869-58b064d1cc5b None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:39.006745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e654215-4cbe-46d2-8498-3783d4d68300 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.007023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e654215-4cbe-46d2-8498-3783d4d68300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.008193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e9cc6da1-16ae-4ca6-9869-58b064d1cc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:39.026116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-9e654215-4cbe-46d2-8498-3783d4d68300 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:39.027305 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9e654215-4cbe-46d2-8498-3783d4d68300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:39.069112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 779/1548] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:39.072381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c054ea8-4cfb-46b2-ba40-678de57b8911 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.072381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c054ea8-4cfb-46b2-ba40-678de57b8911 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.072381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c054ea8-4cfb-46b2-ba40-678de57b8911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.089680 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 770/1549] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:39.090370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-6c054ea8-4cfb-46b2-ba40-678de57b8911 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:39.090912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2949d-36ef-460b-8cf8-da20f114f648 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.091197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2949d-36ef-460b-8cf8-da20f114f648 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.091475 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2949d-36ef-460b-8cf8-da20f114f648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.091663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-6c054ea8-4cfb-46b2-ba40-678de57b8911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:39.101359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 780/1550] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:39.102760 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeb87e-4818-4828-a3d8-70aedcae37b6 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.103047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeb87e-4818-4828-a3d8-70aedcae37b6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.103323 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeb87e-4818-4828-a3d8-70aedcae37b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.111486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-63e2949d-36ef-460b-8cf8-da20f114f648 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:39.112679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-63e2949d-36ef-460b-8cf8-da20f114f648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:39.120825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 771/1551] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:39.122205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-abbeb87e-4818-4828-a3d8-70aedcae37b6 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:39.123367 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-abbeb87e-4818-4828-a3d8-70aedcae37b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:39.126867 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c0075-a1f1-40ce-ac70-dc8e901626c2 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.127154 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c0075-a1f1-40ce-ac70-dc8e901626c2 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.127443 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c0075-a1f1-40ce-ac70-dc8e901626c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.133917 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 781/1552] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:39.135182 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e8846-ae8c-4d59-913c-6f93041278a7 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.135383 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e8846-ae8c-4d59-913c-6f93041278a7 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.135656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e8846-ae8c-4d59-913c-6f93041278a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.149038 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-bd6c0075-a1f1-40ce-ac70-dc8e901626c2 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:39.150246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-bd6c0075-a1f1-40ce-ac70-dc8e901626c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:39.155250 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-3c5e8846-ae8c-4d59-913c-6f93041278a7 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:39.157066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3c5e8846-ae8c-4d59-913c-6f93041278a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:39.158777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 772/1553] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:39.159472 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c0075-a1f1-40ce-ac70-dc8e901626c2 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.166792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 782/1554] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:39.167714 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e8846-ae8c-4d59-913c-6f93041278a7 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.168626 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c0075-a1f1-40ce-ac70-dc8e901626c2 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.173370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c55c3-5a3e-4cc5-9801-f03e7c1573a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.174211 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c55c3-5a3e-4cc5-9801-f03e7c1573a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.174491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c55c3-5a3e-4cc5-9801-f03e7c1573a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.174763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c55c3-5a3e-4cc5-9801-f03e7c1573a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.175415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c55c3-5a3e-4cc5-9801-f03e7c1573a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.176447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: WARNING py.warnings [None req-696c55c3-5a3e-4cc5-9801-f03e7c1573a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:49:39.176447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: warnings.warn(msg) Aug 29 22:49:39.176447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: Aug 29 22:49:39.177336 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e8846-ae8c-4d59-913c-6f93041278a7 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.177658 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c55c3-5a3e-4cc5-9801-f03e7c1573a4 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.181923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455b4a1-1fe7-43ff-a147-3efeb89392f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.182503 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455b4a1-1fe7-43ff-a147-3efeb89392f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.182785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455b4a1-1fe7-43ff-a147-3efeb89392f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.183062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455b4a1-1fe7-43ff-a147-3efeb89392f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.183709 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455b4a1-1fe7-43ff-a147-3efeb89392f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:49:39.184013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455b4a1-1fe7-43ff-a147-3efeb89392f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.185630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455b4a1-1fe7-43ff-a147-3efeb89392f5 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.197534 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 783/1555] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:49:39.198912 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1272f3c-edc6-49f2-a16d-3ef60efb0b58 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.199031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1272f3c-edc6-49f2-a16d-3ef60efb0b58 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.199245 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1272f3c-edc6-49f2-a16d-3ef60efb0b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.218607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-f1272f3c-edc6-49f2-a16d-3ef60efb0b58 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:39.220386 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f1272f3c-edc6-49f2-a16d-3ef60efb0b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:39.228326 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 784/1556] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:39.229088 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1272f3c-edc6-49f2-a16d-3ef60efb0b58 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.238032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1272f3c-edc6-49f2-a16d-3ef60efb0b58 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.242572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705922a1-5ffb-4c73-8aee-bd2d00aee7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.243138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705922a1-5ffb-4c73-8aee-bd2d00aee7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.243420 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705922a1-5ffb-4c73-8aee-bd2d00aee7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.243697 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705922a1-5ffb-4c73-8aee-bd2d00aee7e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.244368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705922a1-5ffb-4c73-8aee-bd2d00aee7e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:49:39.244672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705922a1-5ffb-4c73-8aee-bd2d00aee7e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.246241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705922a1-5ffb-4c73-8aee-bd2d00aee7e6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.257359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 785/1557] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:49:39.258442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3569d8c-85e6-4dcb-8bde-f279f1ef7cbc None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.258729 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3569d8c-85e6-4dcb-8bde-f279f1ef7cbc None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.259006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3569d8c-85e6-4dcb-8bde-f279f1ef7cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.278976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-a3569d8c-85e6-4dcb-8bde-f279f1ef7cbc None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:39.280237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a3569d8c-85e6-4dcb-8bde-f279f1ef7cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:39.286261 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 773/1558] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:39.286261 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a48f9-2ba6-4b73-99a0-7382f3fa0cae None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.286261 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a48f9-2ba6-4b73-99a0-7382f3fa0cae None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.286261 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a48f9-2ba6-4b73-99a0-7382f3fa0cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.292511 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 786/1559] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:39.293571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3569d8c-85e6-4dcb-8bde-f279f1ef7cbc None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.304608 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-238a48f9-2ba6-4b73-99a0-7382f3fa0cae None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:39.305845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-238a48f9-2ba6-4b73-99a0-7382f3fa0cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:39.306117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3569d8c-85e6-4dcb-8bde-f279f1ef7cbc None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.310677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b24c8-d7d7-42b6-865c-a89028d5b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.311271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b24c8-d7d7-42b6-865c-a89028d5b081 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.311558 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b24c8-d7d7-42b6-865c-a89028d5b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.311830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b24c8-d7d7-42b6-865c-a89028d5b081 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.312588 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b24c8-d7d7-42b6-865c-a89028d5b081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:49:39.312977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b24c8-d7d7-42b6-865c-a89028d5b081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.313825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 774/1560] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:39.314436 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b24c8-d7d7-42b6-865c-a89028d5b081 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.314660 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a48f9-2ba6-4b73-99a0-7382f3fa0cae None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.324001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a48f9-2ba6-4b73-99a0-7382f3fa0cae None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.334266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 787/1561] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:49:39.334266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b24c8-d7d7-42b6-865c-a89028d5b081 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.336356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861b974-5c92-4a0b-82cc-683e1e61c05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.336963 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861b974-5c92-4a0b-82cc-683e1e61c05a admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.337248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861b974-5c92-4a0b-82cc-683e1e61c05a admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.337524 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861b974-5c92-4a0b-82cc-683e1e61c05a admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.337639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b24c8-d7d7-42b6-865c-a89028d5b081 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.338201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861b974-5c92-4a0b-82cc-683e1e61c05a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:49:39.338510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861b974-5c92-4a0b-82cc-683e1e61c05a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.339508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: WARNING py.warnings [None req-9861b974-5c92-4a0b-82cc-683e1e61c05a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:49:39.339508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: warnings.warn(msg) Aug 29 22:49:39.339508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: Aug 29 22:49:39.340436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861b974-5c92-4a0b-82cc-683e1e61c05a admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.342556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b6c66-563d-43bd-a5a4-df86367f0558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.343133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b6c66-563d-43bd-a5a4-df86367f0558 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.343413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b6c66-563d-43bd-a5a4-df86367f0558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.344369 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b6c66-563d-43bd-a5a4-df86367f0558 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.345015 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b6c66-563d-43bd-a5a4-df86367f0558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.345996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: WARNING py.warnings [None req-599b6c66-563d-43bd-a5a4-df86367f0558 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:49:39.345996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: warnings.warn(msg) Aug 29 22:49:39.345996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: Aug 29 22:49:39.347173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b6c66-563d-43bd-a5a4-df86367f0558 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.360049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 775/1562] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:49:39.360049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861b974-5c92-4a0b-82cc-683e1e61c05a admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.363672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861b974-5c92-4a0b-82cc-683e1e61c05a admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.368629 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17e8eb-86e7-44f6-84a6-469c13cade32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.369225 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17e8eb-86e7-44f6-84a6-469c13cade32 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.369508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17e8eb-86e7-44f6-84a6-469c13cade32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.369786 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17e8eb-86e7-44f6-84a6-469c13cade32 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.370437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17e8eb-86e7-44f6-84a6-469c13cade32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:49:39.370741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17e8eb-86e7-44f6-84a6-469c13cade32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.372351 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17e8eb-86e7-44f6-84a6-469c13cade32 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.384250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 776/1563] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:49:39.385011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17e8eb-86e7-44f6-84a6-469c13cade32 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.394606 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17e8eb-86e7-44f6-84a6-469c13cade32 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.399454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9429e-2e52-44aa-968f-a581c7b42b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.400030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9429e-2e52-44aa-968f-a581c7b42b28 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.405236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9429e-2e52-44aa-968f-a581c7b42b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.405236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9429e-2e52-44aa-968f-a581c7b42b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.405236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9429e-2e52-44aa-968f-a581c7b42b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.405236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9429e-2e52-44aa-968f-a581c7b42b28 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.464900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 788/1564] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:39.464900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b6c66-563d-43bd-a5a4-df86367f0558 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.482986 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:39.490035 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 777/1565] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:39.490035 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9429e-2e52-44aa-968f-a581c7b42b28 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.525697 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b6c66-563d-43bd-a5a4-df86367f0558 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.533398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:39.554243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9429e-2e52-44aa-968f-a581c7b42b28 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.558952 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863fe8d-0d32-439f-a5af-347df51e9268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.559559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863fe8d-0d32-439f-a5af-347df51e9268 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.559843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863fe8d-0d32-439f-a5af-347df51e9268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.560148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863fe8d-0d32-439f-a5af-347df51e9268 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.560895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863fe8d-0d32-439f-a5af-347df51e9268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:49:39.561181 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863fe8d-0d32-439f-a5af-347df51e9268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.563401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863fe8d-0d32-439f-a5af-347df51e9268 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.576934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 778/1566] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:49:39.577956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863fe8d-0d32-439f-a5af-347df51e9268 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.582553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43f75-1a47-4756-9167-01fb592c2014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.583288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43f75-1a47-4756-9167-01fb592c2014 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.583675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43f75-1a47-4756-9167-01fb592c2014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.584000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43f75-1a47-4756-9167-01fb592c2014 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.584687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d43f75-1a47-4756-9167-01fb592c2014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.589749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d43f75-1a47-4756-9167-01fb592c2014 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.589903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863fe8d-0d32-439f-a5af-347df51e9268 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.594757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7390c-5fb1-4344-910c-599e6d65c8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.597806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7390c-5fb1-4344-910c-599e6d65c8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.597806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7390c-5fb1-4344-910c-599e6d65c8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.597806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7390c-5fb1-4344-910c-599e6d65c8f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.597806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7390c-5fb1-4344-910c-599e6d65c8f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:49:39.597806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7390c-5fb1-4344-910c-599e6d65c8f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.598213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 789/1567] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:39.598492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43f75-1a47-4756-9167-01fb592c2014 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.598682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7390c-5fb1-4344-910c-599e6d65c8f4 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.610563 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43f75-1a47-4756-9167-01fb592c2014 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.612230 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 779/1568] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:49:39.613072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7390c-5fb1-4344-910c-599e6d65c8f4 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.615479 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ce3cb-0f46-4068-b634-ed52af6785d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.616020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ce3cb-0f46-4068-b634-ed52af6785d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.616320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ce3cb-0f46-4068-b634-ed52af6785d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.616598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ce3cb-0f46-4068-b634-ed52af6785d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.617230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ce3cb-0f46-4068-b634-ed52af6785d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.619420 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ce3cb-0f46-4068-b634-ed52af6785d4 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.629761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7390c-5fb1-4344-910c-599e6d65c8f4 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.634381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87b133-506d-403e-8165-ed22b9673660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.635103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87b133-506d-403e-8165-ed22b9673660 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.635438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87b133-506d-403e-8165-ed22b9673660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.647755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87b133-506d-403e-8165-ed22b9673660 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.647755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87b133-506d-403e-8165-ed22b9673660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.647755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87b133-506d-403e-8165-ed22b9673660 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.741028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 790/1569] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:39.741836 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ce3cb-0f46-4068-b634-ed52af6785d4 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.755329 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 780/1570] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:39.755329 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87b133-506d-403e-8165-ed22b9673660 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.809788 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ce3cb-0f46-4068-b634-ed52af6785d4 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.815035 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441119b8-7f91-496c-823b-319cde8b6708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.815642 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441119b8-7f91-496c-823b-319cde8b6708 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.815922 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441119b8-7f91-496c-823b-319cde8b6708 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.816224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441119b8-7f91-496c-823b-319cde8b6708 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.816880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441119b8-7f91-496c-823b-319cde8b6708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.817626 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87b133-506d-403e-8165-ed22b9673660 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.818857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441119b8-7f91-496c-823b-319cde8b6708 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.822381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24b8cf-7f50-46a1-847a-dcdcc42baea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.822988 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24b8cf-7f50-46a1-847a-dcdcc42baea1 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.823322 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24b8cf-7f50-46a1-847a-dcdcc42baea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.823537 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24b8cf-7f50-46a1-847a-dcdcc42baea1 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.824384 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24b8cf-7f50-46a1-847a-dcdcc42baea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.826087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24b8cf-7f50-46a1-847a-dcdcc42baea1 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.900701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 791/1571] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:39.901426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441119b8-7f91-496c-823b-319cde8b6708 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.931047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:39.962055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441119b8-7f91-496c-823b-319cde8b6708 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.966837 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e19ac-6079-4d6f-8ca6-42bd11a55b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.967423 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e19ac-6079-4d6f-8ca6-42bd11a55b5a admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.967701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e19ac-6079-4d6f-8ca6-42bd11a55b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.967972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e19ac-6079-4d6f-8ca6-42bd11a55b5a admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.968633 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e19ac-6079-4d6f-8ca6-42bd11a55b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.970550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e19ac-6079-4d6f-8ca6-42bd11a55b5a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:39.982155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 781/1572] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:39.982155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24b8cf-7f50-46a1-847a-dcdcc42baea1 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:39.990725 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24b8cf-7f50-46a1-847a-dcdcc42baea1 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:39.995391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9e4e-1d70-425f-9c7c-ac935e5a4658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:39.995985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9e4e-1d70-425f-9c7c-ac935e5a4658 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:39.996302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9e4e-1d70-425f-9c7c-ac935e5a4658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:39.996582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9e4e-1d70-425f-9c7c-ac935e5a4658 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:39.997214 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc9e4e-1d70-425f-9c7c-ac935e5a4658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:39.999105 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc9e4e-1d70-425f-9c7c-ac935e5a4658 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.057188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 792/1573] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:40.057188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e19ac-6079-4d6f-8ca6-42bd11a55b5a admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.064883 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e19ac-6079-4d6f-8ca6-42bd11a55b5a admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.069505 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad30a86-8a30-47c5-b3e7-8da7e5cc0fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.070087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad30a86-8a30-47c5-b3e7-8da7e5cc0fbf admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.070385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad30a86-8a30-47c5-b3e7-8da7e5cc0fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.070639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad30a86-8a30-47c5-b3e7-8da7e5cc0fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.071270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad30a86-8a30-47c5-b3e7-8da7e5cc0fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.072912 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad30a86-8a30-47c5-b3e7-8da7e5cc0fbf admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.082560 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 793/1574] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:40.083301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad30a86-8a30-47c5-b3e7-8da7e5cc0fbf admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.092419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad30a86-8a30-47c5-b3e7-8da7e5cc0fbf admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.097062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde99b3b-e4b2-498c-b9d5-ea47e315a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.100044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde99b3b-e4b2-498c-b9d5-ea47e315a4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.100044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde99b3b-e4b2-498c-b9d5-ea47e315a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.100044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde99b3b-e4b2-498c-b9d5-ea47e315a4b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.100044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde99b3b-e4b2-498c-b9d5-ea47e315a4b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.100635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde99b3b-e4b2-498c-b9d5-ea47e315a4b3 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.101762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 782/1575] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:49:39 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:40.102515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9e4e-1d70-425f-9c7c-ac935e5a4658 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.165410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9e4e-1d70-425f-9c7c-ac935e5a4658 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.169994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf9a88-09bf-4e09-b47d-a30205706b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.170600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf9a88-09bf-4e09-b47d-a30205706b5a admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.170881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf9a88-09bf-4e09-b47d-a30205706b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.171147 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf9a88-09bf-4e09-b47d-a30205706b5a admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.172296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf9a88-09bf-4e09-b47d-a30205706b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.174466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf9a88-09bf-4e09-b47d-a30205706b5a admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.176192 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 794/1576] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:49:40 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:40.176989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde99b3b-e4b2-498c-b9d5-ea47e315a4b3 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.184527 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:40.239976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde99b3b-e4b2-498c-b9d5-ea47e315a4b3 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.244799 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738902af-36c6-410d-a75b-44ae8cfb83a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.245399 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738902af-36c6-410d-a75b-44ae8cfb83a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.245680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738902af-36c6-410d-a75b-44ae8cfb83a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.245959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738902af-36c6-410d-a75b-44ae8cfb83a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.246659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738902af-36c6-410d-a75b-44ae8cfb83a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.248553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738902af-36c6-410d-a75b-44ae8cfb83a0 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.293746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 783/1577] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:49:40 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:40.294665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf9a88-09bf-4e09-b47d-a30205706b5a admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.305032 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf9a88-09bf-4e09-b47d-a30205706b5a admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.310224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d38a46-b264-4fc4-814d-48575bc927c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.310804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d38a46-b264-4fc4-814d-48575bc927c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.311085 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d38a46-b264-4fc4-814d-48575bc927c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.311357 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d38a46-b264-4fc4-814d-48575bc927c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.311974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d38a46-b264-4fc4-814d-48575bc927c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.313906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d38a46-b264-4fc4-814d-48575bc927c7 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.322756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 795/1578] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:49:40 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:40.322756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738902af-36c6-410d-a75b-44ae8cfb83a0 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.332051 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738902af-36c6-410d-a75b-44ae8cfb83a0 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.336621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b360d3c-275c-4562-97bf-954bcf4ff72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.337199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b360d3c-275c-4562-97bf-954bcf4ff72a admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.337483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b360d3c-275c-4562-97bf-954bcf4ff72a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.337757 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b360d3c-275c-4562-97bf-954bcf4ff72a admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.338390 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b360d3c-275c-4562-97bf-954bcf4ff72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.339977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b360d3c-275c-4562-97bf-954bcf4ff72a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.350188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 796/1579] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:40.353264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b360d3c-275c-4562-97bf-954bcf4ff72a admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.360783 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b360d3c-275c-4562-97bf-954bcf4ff72a admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.365283 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b6951-ae06-4a5d-a459-3023fcead1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.365829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b6951-ae06-4a5d-a459-3023fcead1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.366111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b6951-ae06-4a5d-a459-3023fcead1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.366395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b6951-ae06-4a5d-a459-3023fcead1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.367001 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b6951-ae06-4a5d-a459-3023fcead1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.368563 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b6951-ae06-4a5d-a459-3023fcead1a2 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.378535 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 797/1580] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:40.379268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b6951-ae06-4a5d-a459-3023fcead1a2 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.388395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b6951-ae06-4a5d-a459-3023fcead1a2 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.393053 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a57839-4785-4cc9-9181-f86a8ef4609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.393657 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a57839-4785-4cc9-9181-f86a8ef4609c admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.394013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a57839-4785-4cc9-9181-f86a8ef4609c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.394221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a57839-4785-4cc9-9181-f86a8ef4609c admin admin] PATH_INFO: `/v3/projects/38984b1146604a92847a5db3c209e062/users/bd130bf777664a62ab043200c84ac8b7/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.404777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 784/1581] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:49:40 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:40.404777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d38a46-b264-4fc4-814d-48575bc927c7 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.413586 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d38a46-b264-4fc4-814d-48575bc927c7 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.413824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a57839-4785-4cc9-9181-f86a8ef4609c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38984b1146604a92847a5db3c209e062, user_id=bd130bf777664a62ab043200c84ac8b7, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.414845 dv-cinder-854269-4-smb devstack@keystone.service[82237]: WARNING py.warnings [None req-95a57839-4785-4cc9-9181-f86a8ef4609c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:49:40.414845 dv-cinder-854269-4-smb devstack@keystone.service[82237]: warnings.warn(msg) Aug 29 22:49:40.414845 dv-cinder-854269-4-smb devstack@keystone.service[82237]: Aug 29 22:49:40.416887 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a57839-4785-4cc9-9181-f86a8ef4609c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.418641 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e875c-7e89-45ca-bac6-ef19939a6f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.419242 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e875c-7e89-45ca-bac6-ef19939a6f84 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.419774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e875c-7e89-45ca-bac6-ef19939a6f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.420193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e875c-7e89-45ca-bac6-ef19939a6f84 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.420827 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e875c-7e89-45ca-bac6-ef19939a6f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.423434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e875c-7e89-45ca-bac6-ef19939a6f84 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.482564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 798/1582] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:49:40 2022] PUT /identity/v3/projects/38984b1146604a92847a5db3c209e062/users/bd130bf777664a62ab043200c84ac8b7/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:40.483909 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a57839-4785-4cc9-9181-f86a8ef4609c admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.490001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 785/1583] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:49:40 2022] POST /identity/v3/users => generated 289 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:40.490001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e875c-7e89-45ca-bac6-ef19939a6f84 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.499628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e875c-7e89-45ca-bac6-ef19939a6f84 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.516173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:40.549456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a57839-4785-4cc9-9181-f86a8ef4609c admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.554162 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3767f1c-e368-45a9-bec0-c903f9bea5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.554766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3767f1c-e368-45a9-bec0-c903f9bea5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.555099 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3767f1c-e368-45a9-bec0-c903f9bea5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.555325 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3767f1c-e368-45a9-bec0-c903f9bea5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.555957 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3767f1c-e368-45a9-bec0-c903f9bea5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.556155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eeb90-2544-4a55-8d96-0399b647a27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.556755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eeb90-2544-4a55-8d96-0399b647a27a admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.557020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eeb90-2544-4a55-8d96-0399b647a27a admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.557290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eeb90-2544-4a55-8d96-0399b647a27a admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.557912 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3767f1c-e368-45a9-bec0-c903f9bea5c6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.558019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140eeb90-2544-4a55-8d96-0399b647a27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.559566 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140eeb90-2544-4a55-8d96-0399b647a27a admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.570057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 786/1584] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:40.571007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eeb90-2544-4a55-8d96-0399b647a27a admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.581358 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eeb90-2544-4a55-8d96-0399b647a27a admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.586465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527846e-1419-4854-ae98-157bd6ef398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.587067 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527846e-1419-4854-ae98-157bd6ef398b admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.587350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527846e-1419-4854-ae98-157bd6ef398b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.587626 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527846e-1419-4854-ae98-157bd6ef398b admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.588308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527846e-1419-4854-ae98-157bd6ef398b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.589918 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527846e-1419-4854-ae98-157bd6ef398b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.600570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 787/1585] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:40.601348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527846e-1419-4854-ae98-157bd6ef398b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.610698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527846e-1419-4854-ae98-157bd6ef398b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.615342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3a7d1-caf9-4e0e-a3a1-fad5cbf89288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.615939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3a7d1-caf9-4e0e-a3a1-fad5cbf89288 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.622511 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3a7d1-caf9-4e0e-a3a1-fad5cbf89288 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.622511 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3a7d1-caf9-4e0e-a3a1-fad5cbf89288 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.622754 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 799/1586] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:49:40 2022] POST /identity/v3/users => generated 283 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:40.622841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3a7d1-caf9-4e0e-a3a1-fad5cbf89288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.622927 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3767f1c-e368-45a9-bec0-c903f9bea5c6 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.623011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3a7d1-caf9-4e0e-a3a1-fad5cbf89288 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.627665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3767f1c-e368-45a9-bec0-c903f9bea5c6 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.632625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 788/1587] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:40.632625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3a7d1-caf9-4e0e-a3a1-fad5cbf89288 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.632879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d2bee-33d7-4bb5-a7ef-7603fe29f6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.633209 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d2bee-33d7-4bb5-a7ef-7603fe29f6be admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.633331 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d2bee-33d7-4bb5-a7ef-7603fe29f6be admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.633596 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d2bee-33d7-4bb5-a7ef-7603fe29f6be admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.634246 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d2bee-33d7-4bb5-a7ef-7603fe29f6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.635843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d2bee-33d7-4bb5-a7ef-7603fe29f6be admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.641050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3a7d1-caf9-4e0e-a3a1-fad5cbf89288 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.645729 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb38c7f-fe0d-41e2-9715-da3974bdd8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.646323 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb38c7f-fe0d-41e2-9715-da3974bdd8cf admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.646605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb38c7f-fe0d-41e2-9715-da3974bdd8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.646880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb38c7f-fe0d-41e2-9715-da3974bdd8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.647511 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb38c7f-fe0d-41e2-9715-da3974bdd8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.649165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb38c7f-fe0d-41e2-9715-da3974bdd8cf admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.653452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 800/1588] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:40.653452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df9a4-9882-4d34-bba2-cd8787d4e19d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.653452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df9a4-9882-4d34-bba2-cd8787d4e19d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.653452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df9a4-9882-4d34-bba2-cd8787d4e19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.666116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 789/1589] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:40.666116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb38c7f-fe0d-41e2-9715-da3974bdd8cf admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.672878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-c08df9a4-9882-4d34-bba2-cd8787d4e19d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:40.673267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb38c7f-fe0d-41e2-9715-da3974bdd8cf admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.674282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c08df9a4-9882-4d34-bba2-cd8787d4e19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:40.678222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024936a9-5d85-4825-892c-3ee65ec6442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.678816 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024936a9-5d85-4825-892c-3ee65ec6442a admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.679095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024936a9-5d85-4825-892c-3ee65ec6442a admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.679370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024936a9-5d85-4825-892c-3ee65ec6442a admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.680009 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024936a9-5d85-4825-892c-3ee65ec6442a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.681617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024936a9-5d85-4825-892c-3ee65ec6442a admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.685455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 801/1590] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:40.685455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08df9a4-9882-4d34-bba2-cd8787d4e19d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.692028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08df9a4-9882-4d34-bba2-cd8787d4e19d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.694768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 790/1591] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:40.695713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024936a9-5d85-4825-892c-3ee65ec6442a admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.697246 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20602ad-6f03-4fa7-8410-cbcae7b1c828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.697853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20602ad-6f03-4fa7-8410-cbcae7b1c828 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.698134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20602ad-6f03-4fa7-8410-cbcae7b1c828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.698407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20602ad-6f03-4fa7-8410-cbcae7b1c828 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.699051 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20602ad-6f03-4fa7-8410-cbcae7b1c828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.700675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20602ad-6f03-4fa7-8410-cbcae7b1c828 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.705960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024936a9-5d85-4825-892c-3ee65ec6442a admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.710707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfbd62-036a-40bd-9768-92f48f79d60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.711152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 802/1592] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:40.711274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfbd62-036a-40bd-9768-92f48f79d60f admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.711562 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfbd62-036a-40bd-9768-92f48f79d60f admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.711837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfbd62-036a-40bd-9768-92f48f79d60f admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.711946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20602ad-6f03-4fa7-8410-cbcae7b1c828 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.712509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfbd62-036a-40bd-9768-92f48f79d60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.714304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfbd62-036a-40bd-9768-92f48f79d60f admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.721901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20602ad-6f03-4fa7-8410-cbcae7b1c828 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.725659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 791/1593] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:40.726601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d38a48-8f1b-4dfe-ad3d-c259de20d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.727185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d38a48-8f1b-4dfe-ad3d-c259de20d1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.727464 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d38a48-8f1b-4dfe-ad3d-c259de20d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.727725 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfbd62-036a-40bd-9768-92f48f79d60f admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.727831 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d38a48-8f1b-4dfe-ad3d-c259de20d1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.728448 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d38a48-8f1b-4dfe-ad3d-c259de20d1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.730027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d38a48-8f1b-4dfe-ad3d-c259de20d1a3 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.737630 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfbd62-036a-40bd-9768-92f48f79d60f admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.742681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 803/1594] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:40.742681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d38a48-8f1b-4dfe-ad3d-c259de20d1a3 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.743233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefc2cd-bb1e-4246-a015-8a0abb00b3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.743233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefc2cd-bb1e-4246-a015-8a0abb00b3af admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.743435 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefc2cd-bb1e-4246-a015-8a0abb00b3af admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.743535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefc2cd-bb1e-4246-a015-8a0abb00b3af admin admin] PATH_INFO: `/v3/projects/4ccbcc79b7424deaa55628532129cfe4/users/702f1e3b8d0342fc999f63d701bc4772/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.750282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d38a48-8f1b-4dfe-ad3d-c259de20d1a3 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.754973 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa211ce-ca45-4027-a34f-81f61aaa2cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.755756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa211ce-ca45-4027-a34f-81f61aaa2cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.756039 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa211ce-ca45-4027-a34f-81f61aaa2cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.756372 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa211ce-ca45-4027-a34f-81f61aaa2cc6 admin admin] PATH_INFO: `/v3/projects/5c198150daad4dc7a9248004e204392b/users/d4fbfe7d86aa42019a66868517eea7bd/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.758473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefc2cd-bb1e-4246-a015-8a0abb00b3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ccbcc79b7424deaa55628532129cfe4, user_id=702f1e3b8d0342fc999f63d701bc4772, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.761135 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefc2cd-bb1e-4246-a015-8a0abb00b3af admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.771359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa211ce-ca45-4027-a34f-81f61aaa2cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c198150daad4dc7a9248004e204392b, user_id=d4fbfe7d86aa42019a66868517eea7bd, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.775991 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa211ce-ca45-4027-a34f-81f61aaa2cc6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:40.864986 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 792/1595] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:49:40 2022] PUT /identity/v3/projects/4ccbcc79b7424deaa55628532129cfe4/users/702f1e3b8d0342fc999f63d701bc4772/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:40.866460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefc2cd-bb1e-4246-a015-8a0abb00b3af admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.877075 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 804/1596] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:49:40 2022] PUT /identity/v3/projects/5c198150daad4dc7a9248004e204392b/users/d4fbfe7d86aa42019a66868517eea7bd/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:40.878023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa211ce-ca45-4027-a34f-81f61aaa2cc6 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:40.910022 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:40.932327 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefc2cd-bb1e-4246-a015-8a0abb00b3af admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.935234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa211ce-ca45-4027-a34f-81f61aaa2cc6 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:40.939637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ee3f3-1316-4c9e-bdb1-54f406e885d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.940264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ee3f3-1316-4c9e-bdb1-54f406e885d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.940546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ee3f3-1316-4c9e-bdb1-54f406e885d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.940847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ee3f3-1316-4c9e-bdb1-54f406e885d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.989772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac321d-fb25-49e6-acef-7d4669334d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:40.990376 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac321d-fb25-49e6-acef-7d4669334d68 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:40.990662 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac321d-fb25-49e6-acef-7d4669334d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:40.990930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac321d-fb25-49e6-acef-7d4669334d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:40.991568 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac321d-fb25-49e6-acef-7d4669334d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:40.993178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac321d-fb25-49e6-acef-7d4669334d68 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:41.000858 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ee3f3-1316-4c9e-bdb1-54f406e885d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:41.002356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ee3f3-1316-4c9e-bdb1-54f406e885d8 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:41.005267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 793/1597] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:41.006091 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac321d-fb25-49e6-acef-7d4669334d68 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:41.013698 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 805/1598] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:41.014546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ee3f3-1316-4c9e-bdb1-54f406e885d8 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:41.016192 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac321d-fb25-49e6-acef-7d4669334d68 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:41.019847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:41.020955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec45c9-77d4-4001-9abc-d3eceeca691a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:41.021570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec45c9-77d4-4001-9abc-d3eceeca691a admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.021856 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec45c9-77d4-4001-9abc-d3eceeca691a admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.022228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec45c9-77d4-4001-9abc-d3eceeca691a admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.022787 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec45c9-77d4-4001-9abc-d3eceeca691a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:41.024498 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec45c9-77d4-4001-9abc-d3eceeca691a admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:41.024980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ee3f3-1316-4c9e-bdb1-54f406e885d8 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:41.029697 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b423e-7dfc-4593-bd58-56762bd65698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:41.030736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b423e-7dfc-4593-bd58-56762bd65698 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.030736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b423e-7dfc-4593-bd58-56762bd65698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.034600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b423e-7dfc-4593-bd58-56762bd65698 admin admin] PATH_INFO: `/v3/projects/587ad1bdb7104d108f1e61785bef7b99/users/8f00295c4d744e13b649b4c12ad6c2db/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.036544 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 794/1599] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:41.040220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec45c9-77d4-4001-9abc-d3eceeca691a admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:41.047166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b423e-7dfc-4593-bd58-56762bd65698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=587ad1bdb7104d108f1e61785bef7b99, user_id=8f00295c4d744e13b649b4c12ad6c2db, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:41.050159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b423e-7dfc-4593-bd58-56762bd65698 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:41.050289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec45c9-77d4-4001-9abc-d3eceeca691a admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:41.054865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52432ac8-91e3-4085-bd49-c4a803aa5dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:41.057486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52432ac8-91e3-4085-bd49-c4a803aa5dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.057486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52432ac8-91e3-4085-bd49-c4a803aa5dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.057486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52432ac8-91e3-4085-bd49-c4a803aa5dd5 admin admin] PATH_INFO: `/v3/projects/674ec1eb54804fb4b8ac32359d07a57d/users/61bf4c3fe10a434eadd7702c015ba618/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.071389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52432ac8-91e3-4085-bd49-c4a803aa5dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674ec1eb54804fb4b8ac32359d07a57d, user_id=61bf4c3fe10a434eadd7702c015ba618, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:41.074140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52432ac8-91e3-4085-bd49-c4a803aa5dd5 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:41.158092 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 806/1600] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:49:41 2022] PUT /identity/v3/projects/587ad1bdb7104d108f1e61785bef7b99/users/8f00295c4d744e13b649b4c12ad6c2db/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:41.158977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b423e-7dfc-4593-bd58-56762bd65698 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:41.159343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 795/1601] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:49:41 2022] PUT /identity/v3/projects/674ec1eb54804fb4b8ac32359d07a57d/users/61bf4c3fe10a434eadd7702c015ba618/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:41.161273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c9a1c-1551-468f-b29b-5c5b6ea366ca None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.161556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c9a1c-1551-468f-b29b-5c5b6ea366ca None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.161894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c9a1c-1551-468f-b29b-5c5b6ea366ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.184059 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-129c9a1c-1551-468f-b29b-5c5b6ea366ca None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:41.184572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-129c9a1c-1551-468f-b29b-5c5b6ea366ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:41.245364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b423e-7dfc-4593-bd58-56762bd65698 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:41.248220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 796/1602] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:41.249463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c66c33-c03a-413d-a822-ea1b97838e1c None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.249761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c66c33-c03a-413d-a822-ea1b97838e1c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.250554 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c66c33-c03a-413d-a822-ea1b97838e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.252668 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501236cc-8438-45e9-9cd9-321aab298f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:41.257089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501236cc-8438-45e9-9cd9-321aab298f14 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.257089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501236cc-8438-45e9-9cd9-321aab298f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.257089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501236cc-8438-45e9-9cd9-321aab298f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.257089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501236cc-8438-45e9-9cd9-321aab298f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:41.257089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501236cc-8438-45e9-9cd9-321aab298f14 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:41.267393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 807/1603] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:41.268222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501236cc-8438-45e9-9cd9-321aab298f14 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:41.271872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d5c66c33-c03a-413d-a822-ea1b97838e1c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:41.273138 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d5c66c33-c03a-413d-a822-ea1b97838e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:41.277973 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501236cc-8438-45e9-9cd9-321aab298f14 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:41.281007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 797/1604] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:41.281776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c66c33-c03a-413d-a822-ea1b97838e1c None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:41.282812 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129381c1-e2ab-48e2-a997-269148178ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:41.283443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129381c1-e2ab-48e2-a997-269148178ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.283721 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129381c1-e2ab-48e2-a997-269148178ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.284104 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129381c1-e2ab-48e2-a997-269148178ec1 admin admin] PATH_INFO: `/v3/projects/562a996e65ef45698a2fc9c59376efcf/users/bf1742c24231461aa0e4962e5790641c/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.293172 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c66c33-c03a-413d-a822-ea1b97838e1c None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:41.297241 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6058811-b094-4aef-b283-445206d2b741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:41.297924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6058811-b094-4aef-b283-445206d2b741 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.298203 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6058811-b094-4aef-b283-445206d2b741 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.298482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6058811-b094-4aef-b283-445206d2b741 admin admin] PATH_INFO: `/v3/projects/b22fd9e58c694121a162b855555cd884/users/b7998943912747c6935db310ff1a4b3a/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.300794 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129381c1-e2ab-48e2-a997-269148178ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562a996e65ef45698a2fc9c59376efcf, user_id=bf1742c24231461aa0e4962e5790641c, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:41.303710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129381c1-e2ab-48e2-a997-269148178ec1 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:41.314498 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6058811-b094-4aef-b283-445206d2b741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22fd9e58c694121a162b855555cd884, user_id=b7998943912747c6935db310ff1a4b3a, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:41.317173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6058811-b094-4aef-b283-445206d2b741 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:41.368959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 808/1605] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:49:41 2022] PUT /identity/v3/projects/562a996e65ef45698a2fc9c59376efcf/users/bf1742c24231461aa0e4962e5790641c/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:41.370404 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19e5b-ef9e-45be-ad9d-163f1eefcaf8 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.370698 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19e5b-ef9e-45be-ad9d-163f1eefcaf8 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.370973 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19e5b-ef9e-45be-ad9d-163f1eefcaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.405392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-88d19e5b-ef9e-45be-ad9d-163f1eefcaf8 None None] MFA Rules not processed for user `61bf4c3fe10a434eadd7702c015ba618`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:41.406766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-88d19e5b-ef9e-45be-ad9d-163f1eefcaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:41.436795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 798/1606] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:49:41 2022] PUT /identity/v3/projects/b22fd9e58c694121a162b855555cd884/users/b7998943912747c6935db310ff1a4b3a/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:41.436795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e91d5-358c-4eda-9cdf-5ae4f2e4a6ce None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.436795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e91d5-358c-4eda-9cdf-5ae4f2e4a6ce None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.436795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e91d5-358c-4eda-9cdf-5ae4f2e4a6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.460623 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:41.463838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-f28e91d5-358c-4eda-9cdf-5ae4f2e4a6ce None None] MFA Rules not processed for user `8f00295c4d744e13b649b4c12ad6c2db`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:41.465156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-f28e91d5-358c-4eda-9cdf-5ae4f2e4a6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:41.480848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 809/1607] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:41.484861 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19e5b-ef9e-45be-ad9d-163f1eefcaf8 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:41.527604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:41.540247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 799/1608] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:41.541777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e91d5-358c-4eda-9cdf-5ae4f2e4a6ce None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:41.543426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19e5b-ef9e-45be-ad9d-163f1eefcaf8 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:41.595805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e020d-7ced-4d0a-9d45-7a53483b857c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:41.603696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e020d-7ced-4d0a-9d45-7a53483b857c service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.603696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e020d-7ced-4d0a-9d45-7a53483b857c service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.603696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e020d-7ced-4d0a-9d45-7a53483b857c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.621953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e91d5-358c-4eda-9cdf-5ae4f2e4a6ce None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:41.627751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29187f2-516b-40b9-ac28-3df179c1be19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:41.628450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29187f2-516b-40b9-ac28-3df179c1be19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.628936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29187f2-516b-40b9-ac28-3df179c1be19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.629048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29187f2-516b-40b9-ac28-3df179c1be19 admin admin] PATH_INFO: `/v3/projects/ef74fc50b645410bbf694b3f0b8e9d78/users/5636bb138fba4ddbb13b6fc4078b0569/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.646203 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29187f2-516b-40b9-ac28-3df179c1be19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef74fc50b645410bbf694b3f0b8e9d78, user_id=5636bb138fba4ddbb13b6fc4078b0569, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:41.648889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29187f2-516b-40b9-ac28-3df179c1be19 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:41.674046 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e020d-7ced-4d0a-9d45-7a53483b857c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:41.675491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e020d-7ced-4d0a-9d45-7a53483b857c service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:41.689676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 810/1609] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:41.689676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e020d-7ced-4d0a-9d45-7a53483b857c service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:41.696743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e020d-7ced-4d0a-9d45-7a53483b857c service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:41.700698 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f652269-e354-4c83-bbc0-ba901059f250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:41.701297 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f652269-e354-4c83-bbc0-ba901059f250 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.701715 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f652269-e354-4c83-bbc0-ba901059f250 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.702456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f652269-e354-4c83-bbc0-ba901059f250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.713538 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f652269-e354-4c83-bbc0-ba901059f250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:41.715004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f652269-e354-4c83-bbc0-ba901059f250 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:41.722650 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 800/1610] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:49:41 2022] PUT /identity/v3/projects/ef74fc50b645410bbf694b3f0b8e9d78/users/5636bb138fba4ddbb13b6fc4078b0569/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:41.724023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52852f0f-0e5a-40c7-aac8-21817e09661a None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.724344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52852f0f-0e5a-40c7-aac8-21817e09661a None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.724767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52852f0f-0e5a-40c7-aac8-21817e09661a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.726787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 811/1611] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:41.728483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d7e91-78f6-42f9-abcf-732223a052be None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.728770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d7e91-78f6-42f9-abcf-732223a052be None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.729045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d7e91-78f6-42f9-abcf-732223a052be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.752249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-8f1d7e91-78f6-42f9-abcf-732223a052be None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:41.753471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8f1d7e91-78f6-42f9-abcf-732223a052be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:41.761049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-52852f0f-0e5a-40c7-aac8-21817e09661a None None] MFA Rules not processed for user `bf1742c24231461aa0e4962e5790641c`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:41.761932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-52852f0f-0e5a-40c7-aac8-21817e09661a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:41.823933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 812/1612] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:41.825199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d7e91-78f6-42f9-abcf-732223a052be None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:41.835512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d7e91-78f6-42f9-abcf-732223a052be None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:41.841489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76da60-8372-4b84-b8c9-d39c6025bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:41.842228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76da60-8372-4b84-b8c9-d39c6025bd5c admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.842630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76da60-8372-4b84-b8c9-d39c6025bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.843093 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76da60-8372-4b84-b8c9-d39c6025bd5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.848616 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 801/1613] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:41.848808 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76da60-8372-4b84-b8c9-d39c6025bd5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:41.848914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52852f0f-0e5a-40c7-aac8-21817e09661a None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:41.849016 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76da60-8372-4b84-b8c9-d39c6025bd5c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:41.864122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52852f0f-0e5a-40c7-aac8-21817e09661a None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:41.870347 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018e8f7-cc5a-449f-8f5f-68815275430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:41.871165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018e8f7-cc5a-449f-8f5f-68815275430d admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.871506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018e8f7-cc5a-449f-8f5f-68815275430d admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.871878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018e8f7-cc5a-449f-8f5f-68815275430d admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.872697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018e8f7-cc5a-449f-8f5f-68815275430d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:41.875554 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018e8f7-cc5a-449f-8f5f-68815275430d admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:41.896288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:41.970571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 813/1614] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:49:41 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:41.971764 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5551-4ced-4af8-82bb-2285b5e99315 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:41.972051 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5551-4ced-4af8-82bb-2285b5e99315 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:41.972373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5551-4ced-4af8-82bb-2285b5e99315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:41.994016 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:42.004069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-161b5551-4ced-4af8-82bb-2285b5e99315 None None] MFA Rules not processed for user `5636bb138fba4ddbb13b6fc4078b0569`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:42.017625 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-161b5551-4ced-4af8-82bb-2285b5e99315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:42.017900 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 802/1615] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:49:41 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:42.017900 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018e8f7-cc5a-449f-8f5f-68815275430d admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:42.085746 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 814/1616] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:42.087698 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a01a-aea6-4ff3-a038-1c2bf8e13089 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:42.088034 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a01a-aea6-4ff3-a038-1c2bf8e13089 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:42.088340 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a01a-aea6-4ff3-a038-1c2bf8e13089 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:42.090173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 815/1617] 10.222.0.62 () {54 vars in 962 bytes} [Mon Aug 29 22:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:42.090897 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859a01a-aea6-4ff3-a038-1c2bf8e13089 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:42.102156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018e8f7-cc5a-449f-8f5f-68815275430d admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:42.120440 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fc8b9-6be7-4537-af10-7198e46128ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:42.130884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fc8b9-6be7-4537-af10-7198e46128ba service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:42.130884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fc8b9-6be7-4537-af10-7198e46128ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:42.130884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fc8b9-6be7-4537-af10-7198e46128ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:42.181347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859a01a-aea6-4ff3-a038-1c2bf8e13089 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:42.186132 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c43f79-e964-4509-94cb-03dcaf973295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:42.187995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c43f79-e964-4509-94cb-03dcaf973295 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:42.187995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c43f79-e964-4509-94cb-03dcaf973295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:42.187995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c43f79-e964-4509-94cb-03dcaf973295 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:42.188297 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c43f79-e964-4509-94cb-03dcaf973295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:42.190268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c43f79-e964-4509-94cb-03dcaf973295 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:42.197068 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fc8b9-6be7-4537-af10-7198e46128ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:42.198549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fc8b9-6be7-4537-af10-7198e46128ba service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:42.216569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 803/1618] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:42.219516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fc8b9-6be7-4537-af10-7198e46128ba service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:42.233091 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fc8b9-6be7-4537-af10-7198e46128ba service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:42.240155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bf4ec-e7b3-4ef1-97d1-3af66e4f2098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:42.243222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bf4ec-e7b3-4ef1-97d1-3af66e4f2098 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:42.243222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bf4ec-e7b3-4ef1-97d1-3af66e4f2098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:42.243222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bf4ec-e7b3-4ef1-97d1-3af66e4f2098 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:42.243222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bf4ec-e7b3-4ef1-97d1-3af66e4f2098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:42.244529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bf4ec-e7b3-4ef1-97d1-3af66e4f2098 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:42.304766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 816/1619] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:49:42 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:42.304766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bf8ba-1420-4872-82c5-f19a94360346 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:42.304766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bf8ba-1420-4872-82c5-f19a94360346 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:42.304766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bf8ba-1420-4872-82c5-f19a94360346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:42.356822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-6f9bf8ba-1420-4872-82c5-f19a94360346 None None] MFA Rules not processed for user `f06d910badb84c6aa6b48f3b56b91f82`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:42.359261 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-6f9bf8ba-1420-4872-82c5-f19a94360346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:42.359403 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 804/1620] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:49:42 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:42.359861 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bf4ec-e7b3-4ef1-97d1-3af66e4f2098 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:42.441130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bf4ec-e7b3-4ef1-97d1-3af66e4f2098 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:42.445626 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7ba88-903d-4a74-a4cc-427e3c4342fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:42.446314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7ba88-903d-4a74-a4cc-427e3c4342fa service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:42.446845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7ba88-903d-4a74-a4cc-427e3c4342fa service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:42.447077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7ba88-903d-4a74-a4cc-427e3c4342fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:42.457978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7ba88-903d-4a74-a4cc-427e3c4342fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:42.459634 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7ba88-903d-4a74-a4cc-427e3c4342fa service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:42.460771 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 817/1621] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Aug 29 22:49:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:42.462063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bf8ba-1420-4872-82c5-f19a94360346 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:42.472326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 805/1622] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:42.477622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bf8ba-1420-4872-82c5-f19a94360346 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:42.483483 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7ba88-903d-4a74-a4cc-427e3c4342fa service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:42.485713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ee39b-4549-4de6-9c78-8012392f1388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:42.486492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ee39b-4549-4de6-9c78-8012392f1388 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:42.486790 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ee39b-4549-4de6-9c78-8012392f1388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:42.487386 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ee39b-4549-4de6-9c78-8012392f1388 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:42.488818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ee39b-4549-4de6-9c78-8012392f1388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:42.490885 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ee39b-4549-4de6-9c78-8012392f1388 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:42.509039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7ba88-903d-4a74-a4cc-427e3c4342fa service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:42.523169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee66959-dfb2-4e3a-993e-0b48d830b57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:42.524609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee66959-dfb2-4e3a-993e-0b48d830b57e admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:42.524609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee66959-dfb2-4e3a-993e-0b48d830b57e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:42.524609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee66959-dfb2-4e3a-993e-0b48d830b57e admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:42.525508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee66959-dfb2-4e3a-993e-0b48d830b57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:42.527132 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee66959-dfb2-4e3a-993e-0b48d830b57e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:42.530131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 818/1623] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:42.531516 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ee39b-4549-4de6-9c78-8012392f1388 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:42.543596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 806/1624] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:42.543596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee66959-dfb2-4e3a-993e-0b48d830b57e admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:42.566312 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ee39b-4549-4de6-9c78-8012392f1388 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:42.573565 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee66959-dfb2-4e3a-993e-0b48d830b57e admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:42.574416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce863750-406e-4b35-af73-e7cd3be2b4c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:42.575041 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce863750-406e-4b35-af73-e7cd3be2b4c4 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:42.575573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce863750-406e-4b35-af73-e7cd3be2b4c4 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:42.575848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce863750-406e-4b35-af73-e7cd3be2b4c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:42.581093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe33795-19e7-4f32-b323-c5ec8bcacad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:42.582087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe33795-19e7-4f32-b323-c5ec8bcacad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:42.582649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe33795-19e7-4f32-b323-c5ec8bcacad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:42.583148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe33795-19e7-4f32-b323-c5ec8bcacad5 admin admin] PATH_INFO: `/v3/projects/db0414b405344b26925374acb608f81a/users/e8a03d67e4e0435eb11b1359006ae41a/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:42.611671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe33795-19e7-4f32-b323-c5ec8bcacad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0414b405344b26925374acb608f81a, user_id=e8a03d67e4e0435eb11b1359006ae41a, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:42.614955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe33795-19e7-4f32-b323-c5ec8bcacad5 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:42.708231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce863750-406e-4b35-af73-e7cd3be2b4c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:42.710484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce863750-406e-4b35-af73-e7cd3be2b4c4 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:42.720676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 807/1625] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:49:42 2022] PUT /identity/v3/projects/db0414b405344b26925374acb608f81a/users/e8a03d67e4e0435eb11b1359006ae41a/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:42.720676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe33795-19e7-4f32-b323-c5ec8bcacad5 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:42.729544 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 819/1626] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:42.730481 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce863750-406e-4b35-af73-e7cd3be2b4c4 service nova] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:42.745112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:42.757343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce863750-406e-4b35-af73-e7cd3be2b4c4 service nova] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:42.880948 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe33795-19e7-4f32-b323-c5ec8bcacad5 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:42.887354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8d398-484f-40d3-9b2e-22db14592a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:42.887977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8d398-484f-40d3-9b2e-22db14592a19 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:42.888596 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8d398-484f-40d3-9b2e-22db14592a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:42.890956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8d398-484f-40d3-9b2e-22db14592a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:42.890956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8d398-484f-40d3-9b2e-22db14592a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:42.894670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8d398-484f-40d3-9b2e-22db14592a19 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:42.896544 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f6501-15d1-4e0f-8389-6a3010cf79d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:42.897937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f6501-15d1-4e0f-8389-6a3010cf79d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:42.898242 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f6501-15d1-4e0f-8389-6a3010cf79d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:42.899661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f6501-15d1-4e0f-8389-6a3010cf79d0 admin admin] PATH_INFO: `/v3/projects/eb58eeb12bbd46bf8e868d6bc0181c56/users/33ad0a4fcd0d4f80ade697f7f833aa3a/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:42.919283 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 820/1627] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:42.925066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8d398-484f-40d3-9b2e-22db14592a19 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:42.946610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f6501-15d1-4e0f-8389-6a3010cf79d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb58eeb12bbd46bf8e868d6bc0181c56, user_id=33ad0a4fcd0d4f80ade697f7f833aa3a, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:42.948111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8d398-484f-40d3-9b2e-22db14592a19 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:42.949951 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f6501-15d1-4e0f-8389-6a3010cf79d0 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:42.964364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23813218-43f6-42bd-b902-5746e52d017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:42.965174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23813218-43f6-42bd-b902-5746e52d017a admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:42.965462 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23813218-43f6-42bd-b902-5746e52d017a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:42.971257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23813218-43f6-42bd-b902-5746e52d017a admin admin] PATH_INFO: `/v3/projects/db0414b405344b26925374acb608f81a/users/e8a03d67e4e0435eb11b1359006ae41a/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:42.971257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23813218-43f6-42bd-b902-5746e52d017a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0414b405344b26925374acb608f81a, user_id=e8a03d67e4e0435eb11b1359006ae41a, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:42.971444 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23813218-43f6-42bd-b902-5746e52d017a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:43.000411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 821/1628] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:49:42 2022] PUT /identity/v3/projects/db0414b405344b26925374acb608f81a/users/e8a03d67e4e0435eb11b1359006ae41a/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:43.002730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b2fe1-4c45-42f3-a92e-383456490e9a None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:43.002730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b2fe1-4c45-42f3-a92e-383456490e9a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:43.003051 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b2fe1-4c45-42f3-a92e-383456490e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:43.051451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 808/1629] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:49:42 2022] PUT /identity/v3/projects/eb58eeb12bbd46bf8e868d6bc0181c56/users/33ad0a4fcd0d4f80ade697f7f833aa3a/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:43.055305 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f6501-15d1-4e0f-8389-6a3010cf79d0 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:43.081096 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ae6b2fe1-4c45-42f3-a92e-383456490e9a None None] MFA Rules not processed for user `e8a03d67e4e0435eb11b1359006ae41a`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:43.084354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ae6b2fe1-4c45-42f3-a92e-383456490e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:43.134027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:43.185191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f6501-15d1-4e0f-8389-6a3010cf79d0 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:43.190769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4f1bd-16c0-4344-9445-dc1ed5a3344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:43.191393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f1bd-16c0-4344-9445-dc1ed5a3344e admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:43.191675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f1bd-16c0-4344-9445-dc1ed5a3344e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:43.192303 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f1bd-16c0-4344-9445-dc1ed5a3344e admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:43.192964 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4f1bd-16c0-4344-9445-dc1ed5a3344e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:43.194579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4f1bd-16c0-4344-9445-dc1ed5a3344e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:43.210977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 809/1630] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:43.212049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 822/1631] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:43.212407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956937ec-7995-4a1e-9faa-a7498f46d3d2 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:43.212665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956937ec-7995-4a1e-9faa-a7498f46d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:43.212946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956937ec-7995-4a1e-9faa-a7498f46d3d2 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:43.213422 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b2fe1-4c45-42f3-a92e-383456490e9a None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:43.219445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 810/1632] 10.222.0.62 () {54 vars in 912 bytes} [Mon Aug 29 22:49:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:43.220473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20713da5-1e08-49f9-85c6-3ddb243e60ed None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:43.220808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20713da5-1e08-49f9-85c6-3ddb243e60ed None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:43.221039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20713da5-1e08-49f9-85c6-3ddb243e60ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:43.242605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-20713da5-1e08-49f9-85c6-3ddb243e60ed None None] MFA Rules not processed for user `f06d910badb84c6aa6b48f3b56b91f82`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:43.243845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-20713da5-1e08-49f9-85c6-3ddb243e60ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:43.256446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b2fe1-4c45-42f3-a92e-383456490e9a None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:43.262080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c99f89-ec29-41dd-8288-5c29939b9c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:43.262960 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c99f89-ec29-41dd-8288-5c29939b9c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:43.263241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c99f89-ec29-41dd-8288-5c29939b9c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:43.263537 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c99f89-ec29-41dd-8288-5c29939b9c37 admin admin] PATH_INFO: `/v3/projects/eb58eeb12bbd46bf8e868d6bc0181c56/users/33ad0a4fcd0d4f80ade697f7f833aa3a/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:43.266125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c99f89-ec29-41dd-8288-5c29939b9c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb58eeb12bbd46bf8e868d6bc0181c56, user_id=33ad0a4fcd0d4f80ade697f7f833aa3a, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:43.269988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c99f89-ec29-41dd-8288-5c29939b9c37 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:43.283738 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 823/1633] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:49:43 2022] PUT /identity/v3/projects/eb58eeb12bbd46bf8e868d6bc0181c56/users/33ad0a4fcd0d4f80ade697f7f833aa3a/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:43.285052 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c99f89-ec29-41dd-8288-5c29939b9c37 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:43.331594 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 811/1634] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 29 22:49:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:43.338398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae9274-a752-40c1-b0d7-b48723ba444d None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:43.338692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae9274-a752-40c1-b0d7-b48723ba444d None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:43.339124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae9274-a752-40c1-b0d7-b48723ba444d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:43.385172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c99f89-ec29-41dd-8288-5c29939b9c37 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:43.390553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe542e-2620-4c3c-95ec-88052c2b5d79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:43.391234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe542e-2620-4c3c-95ec-88052c2b5d79 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:43.391528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe542e-2620-4c3c-95ec-88052c2b5d79 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:43.391793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe542e-2620-4c3c-95ec-88052c2b5d79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:43.400729 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-87ae9274-a752-40c1-b0d7-b48723ba444d None None] MFA Rules not processed for user `33ad0a4fcd0d4f80ade697f7f833aa3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:43.407317 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-87ae9274-a752-40c1-b0d7-b48723ba444d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:43.494162 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe542e-2620-4c3c-95ec-88052c2b5d79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:43.495890 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe542e-2620-4c3c-95ec-88052c2b5d79 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:43.512219 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 812/1635] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:43.513085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 824/1636] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:43.588791 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:43.670503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae9274-a752-40c1-b0d7-b48723ba444d None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:43.683252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae9274-a752-40c1-b0d7-b48723ba444d None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:43.689984 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0e2a2-5eb6-4347-b13f-7e8d4b2b0c09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:43.692128 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0e2a2-5eb6-4347-b13f-7e8d4b2b0c09 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:43.692645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0e2a2-5eb6-4347-b13f-7e8d4b2b0c09 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:43.693480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0e2a2-5eb6-4347-b13f-7e8d4b2b0c09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:43.807036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe542e-2620-4c3c-95ec-88052c2b5d79 service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:43.816830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe542e-2620-4c3c-95ec-88052c2b5d79 service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:43.828736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655f3a0-9dfa-4035-b631-3836a669080e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:43.829511 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655f3a0-9dfa-4035-b631-3836a669080e service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:43.829795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655f3a0-9dfa-4035-b631-3836a669080e service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:43.830065 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655f3a0-9dfa-4035-b631-3836a669080e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:43.843307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0e2a2-5eb6-4347-b13f-7e8d4b2b0c09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:43.843307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0e2a2-5eb6-4347-b13f-7e8d4b2b0c09 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:43.854759 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655f3a0-9dfa-4035-b631-3836a669080e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:43.856251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655f3a0-9dfa-4035-b631-3836a669080e service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:43.873525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 813/1637] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:43.886136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 825/1638] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:43.945881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:44.512597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0e2a2-5eb6-4347-b13f-7e8d4b2b0c09 service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:44.512597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0e2a2-5eb6-4347-b13f-7e8d4b2b0c09 service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:44.512597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fb5a3-a8d7-4fc7-9774-4e84572c642a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:44.512597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fb5a3-a8d7-4fc7-9774-4e84572c642a service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:44.514801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fb5a3-a8d7-4fc7-9774-4e84572c642a service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:44.514801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fb5a3-a8d7-4fc7-9774-4e84572c642a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:44.606930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fb5a3-a8d7-4fc7-9774-4e84572c642a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:44.608694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fb5a3-a8d7-4fc7-9774-4e84572c642a service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:44.631319 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 814/1639] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:45.028721 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655f3a0-9dfa-4035-b631-3836a669080e service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:45.053540 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655f3a0-9dfa-4035-b631-3836a669080e service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:45.066268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a4e58-0107-4a06-a001-962518f49126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:45.067114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a4e58-0107-4a06-a001-962518f49126 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:45.067467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a4e58-0107-4a06-a001-962518f49126 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:45.067821 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a4e58-0107-4a06-a001-962518f49126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:45.230404 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a4e58-0107-4a06-a001-962518f49126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:45.235232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a4e58-0107-4a06-a001-962518f49126 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:45.273026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 826/1640] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:46.121410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e31a3-404f-4207-a627-1c8c710a0bb6 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:46.122346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e31a3-404f-4207-a627-1c8c710a0bb6 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:46.122811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e31a3-404f-4207-a627-1c8c710a0bb6 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:46.124732 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 815/1641] 10.222.0.62 () {54 vars in 962 bytes} [Mon Aug 29 22:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:46.144133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baf6bd-74e4-4f62-9611-b347853ce90e None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:46.144617 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baf6bd-74e4-4f62-9611-b347853ce90e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:46.144688 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baf6bd-74e4-4f62-9611-b347853ce90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:46.196850 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-32baf6bd-74e4-4f62-9611-b347853ce90e None None] MFA Rules not processed for user `f06d910badb84c6aa6b48f3b56b91f82`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:46.198164 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-32baf6bd-74e4-4f62-9611-b347853ce90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:46.221839 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 827/1642] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Aug 29 22:49:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:46.229767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a25311-8ef3-416b-b396-ecd186620e86 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:46.230053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a25311-8ef3-416b-b396-ecd186620e86 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:46.230352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a25311-8ef3-416b-b396-ecd186620e86 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:46.231707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 816/1643] 10.222.0.62 () {54 vars in 912 bytes} [Mon Aug 29 22:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:49:46.239318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3b11e-32c7-458e-b653-0ac97cee5954 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:46.239827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3b11e-32c7-458e-b653-0ac97cee5954 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:46.240347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3b11e-32c7-458e-b653-0ac97cee5954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:46.278292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-f6b3b11e-32c7-458e-b653-0ac97cee5954 None None] MFA Rules not processed for user `f06d910badb84c6aa6b48f3b56b91f82`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:46.279539 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f6b3b11e-32c7-458e-b653-0ac97cee5954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:46.302643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 828/1644] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 29 22:49:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:46.316283 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a25311-8ef3-416b-b396-ecd186620e86 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:46.340941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a25311-8ef3-416b-b396-ecd186620e86 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:46.355318 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef5193-4b15-4fc7-905b-4c0044f360fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:46.355967 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef5193-4b15-4fc7-905b-4c0044f360fb service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:46.356365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef5193-4b15-4fc7-905b-4c0044f360fb service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:46.360556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef5193-4b15-4fc7-905b-4c0044f360fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:46.383288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef5193-4b15-4fc7-905b-4c0044f360fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:46.384779 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef5193-4b15-4fc7-905b-4c0044f360fb service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:46.397610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:46.418668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 817/1645] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:48.767806 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3b11e-32c7-458e-b653-0ac97cee5954 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:48.791363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:48.920723 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3b11e-32c7-458e-b653-0ac97cee5954 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:48.933374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6bdc7-9ae0-412f-bbbb-438dffecf5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:48.934261 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6bdc7-9ae0-412f-bbbb-438dffecf5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:48.934608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6bdc7-9ae0-412f-bbbb-438dffecf5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:48.935009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6bdc7-9ae0-412f-bbbb-438dffecf5c6 admin admin] PATH_INFO: `/v3/users/bf1742c24231461aa0e4962e5790641c` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:48.938059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6bdc7-9ae0-412f-bbbb-438dffecf5c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf1742c24231461aa0e4962e5790641c)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:48.939225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: WARNING py.warnings [None req-62d6bdc7-9ae0-412f-bbbb-438dffecf5c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:49:48.939225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: warnings.warn(msg) Aug 29 22:49:48.939225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: Aug 29 22:49:48.940711 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6bdc7-9ae0-412f-bbbb-438dffecf5c6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:49.381153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-62d6bdc7-9ae0-412f-bbbb-438dffecf5c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf1742c24231461aa0e4962e5790641c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:49.382225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-62d6bdc7-9ae0-412f-bbbb-438dffecf5c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf1742c24231461aa0e4962e5790641c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:49.522187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-62d6bdc7-9ae0-412f-bbbb-438dffecf5c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf1742c24231461aa0e4962e5790641c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:49.522857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-62d6bdc7-9ae0-412f-bbbb-438dffecf5c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf1742c24231461aa0e4962e5790641c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:49.565361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-62d6bdc7-9ae0-412f-bbbb-438dffecf5c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf1742c24231461aa0e4962e5790641c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:49.615161 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 829/1646] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:49:48 2022] DELETE /identity/v3/users/bf1742c24231461aa0e4962e5790641c => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:49.620037 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d13191-b8be-4101-8f49-a39a994fea20 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:49.620570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d13191-b8be-4101-8f49-a39a994fea20 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:49.620651 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d13191-b8be-4101-8f49-a39a994fea20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:49.658916 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-01d13191-b8be-4101-8f49-a39a994fea20 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:49.660438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-01d13191-b8be-4101-8f49-a39a994fea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:49.836745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 818/1647] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:50.094186 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6bdc7-9ae0-412f-bbbb-438dffecf5c6 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:50.096727 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-62d6bdc7-9ae0-412f-bbbb-438dffecf5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:50.223663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6bdc7-9ae0-412f-bbbb-438dffecf5c6 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:50.228441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf4491-95c0-4410-982d-9ec1ec3e811c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:50.245159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf4491-95c0-4410-982d-9ec1ec3e811c service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:50.246038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf4491-95c0-4410-982d-9ec1ec3e811c service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:50.251288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf4491-95c0-4410-982d-9ec1ec3e811c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:50.261615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf4491-95c0-4410-982d-9ec1ec3e811c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:50.264455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf4491-95c0-4410-982d-9ec1ec3e811c service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:50.319385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 830/1648] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:49:50.797954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d13191-b8be-4101-8f49-a39a994fea20 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:50.802926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-01d13191-b8be-4101-8f49-a39a994fea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:50.844130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d13191-b8be-4101-8f49-a39a994fea20 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:50.873723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec1e6d-e82c-42d0-b23e-816f7f255836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:50.874438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec1e6d-e82c-42d0-b23e-816f7f255836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:50.874730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec1e6d-e82c-42d0-b23e-816f7f255836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:50.876499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec1e6d-e82c-42d0-b23e-816f7f255836 admin admin] PATH_INFO: `/v3/users/8f00295c4d744e13b649b4c12ad6c2db` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:50.885683 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec1e6d-e82c-42d0-b23e-816f7f255836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f00295c4d744e13b649b4c12ad6c2db)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:50.893121 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec1e6d-e82c-42d0-b23e-816f7f255836 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:51.212432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ceec1e6d-e82c-42d0-b23e-816f7f255836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f00295c4d744e13b649b4c12ad6c2db'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:51.255358 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ceec1e6d-e82c-42d0-b23e-816f7f255836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f00295c4d744e13b649b4c12ad6c2db'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:51.338898 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ceec1e6d-e82c-42d0-b23e-816f7f255836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f00295c4d744e13b649b4c12ad6c2db'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:51.339482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ceec1e6d-e82c-42d0-b23e-816f7f255836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f00295c4d744e13b649b4c12ad6c2db'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:51.340674 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ceec1e6d-e82c-42d0-b23e-816f7f255836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f00295c4d744e13b649b4c12ad6c2db'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:51.379252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 819/1649] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:49:50 2022] DELETE /identity/v3/users/8f00295c4d744e13b649b4c12ad6c2db => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:51.380992 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3440d-b084-431d-a8dd-c601ef2cd999 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:51.381856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3440d-b084-431d-a8dd-c601ef2cd999 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:51.382350 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3440d-b084-431d-a8dd-c601ef2cd999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:51.431492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-58f3440d-b084-431d-a8dd-c601ef2cd999 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:51.437811 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-58f3440d-b084-431d-a8dd-c601ef2cd999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:51.550920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:51.658363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 831/1650] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:51.678757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec1e6d-e82c-42d0-b23e-816f7f255836 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:51.680563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ceec1e6d-e82c-42d0-b23e-816f7f255836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:51.790495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec1e6d-e82c-42d0-b23e-816f7f255836 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:51.795155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ea3a2-efbd-4f16-b31c-948bbdb51231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:51.795445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ea3a2-efbd-4f16-b31c-948bbdb51231 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:51.795895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ea3a2-efbd-4f16-b31c-948bbdb51231 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:51.796198 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ea3a2-efbd-4f16-b31c-948bbdb51231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:51.812373 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ea3a2-efbd-4f16-b31c-948bbdb51231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:51.814542 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ea3a2-efbd-4f16-b31c-948bbdb51231 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:51.833633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 820/1651] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:52.477875 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3440d-b084-431d-a8dd-c601ef2cd999 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:52.479505 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-58f3440d-b084-431d-a8dd-c601ef2cd999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:52.511493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3440d-b084-431d-a8dd-c601ef2cd999 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:52.524842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9271e-61a7-4d18-9a57-105aabfe9cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:52.531879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9271e-61a7-4d18-9a57-105aabfe9cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:52.531879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9271e-61a7-4d18-9a57-105aabfe9cda admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:52.531879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9271e-61a7-4d18-9a57-105aabfe9cda admin admin] PATH_INFO: `/v3/projects/562a996e65ef45698a2fc9c59376efcf` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:52.531879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9271e-61a7-4d18-9a57-105aabfe9cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=562a996e65ef45698a2fc9c59376efcf)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:52.537821 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9271e-61a7-4d18-9a57-105aabfe9cda admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:52.799599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1ad9271e-61a7-4d18-9a57-105aabfe9cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562a996e65ef45698a2fc9c59376efcf', 'request_id': 'req-1ad9271e-61a7-4d18-9a57-105aabfe9cda'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:52.815024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1ad9271e-61a7-4d18-9a57-105aabfe9cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562a996e65ef45698a2fc9c59376efcf', 'request_id': 'req-1ad9271e-61a7-4d18-9a57-105aabfe9cda'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:52.905313 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1ad9271e-61a7-4d18-9a57-105aabfe9cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562a996e65ef45698a2fc9c59376efcf', 'request_id': 'req-1ad9271e-61a7-4d18-9a57-105aabfe9cda'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:52.931449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1ad9271e-61a7-4d18-9a57-105aabfe9cda admin admin] The token cache is being invalidate because project 562a996e65ef45698a2fc9c59376efcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:49:52.932483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1ad9271e-61a7-4d18-9a57-105aabfe9cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:52.933815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1ad9271e-61a7-4d18-9a57-105aabfe9cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:52.937804 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 832/1652] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:49:52 2022] DELETE /identity/v3/projects/562a996e65ef45698a2fc9c59376efcf => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:52.942571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10846414-daa5-40cb-8c76-7709e2eaf5e1 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:52.943023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10846414-daa5-40cb-8c76-7709e2eaf5e1 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:52.943294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10846414-daa5-40cb-8c76-7709e2eaf5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:52.980313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-10846414-daa5-40cb-8c76-7709e2eaf5e1 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:52.983802 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-10846414-daa5-40cb-8c76-7709e2eaf5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:53.007156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:53.106491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 821/1653] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:53.108268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad9bc-2a01-421f-93df-eed8e2af2590 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:53.108754 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad9bc-2a01-421f-93df-eed8e2af2590 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:53.109538 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad9bc-2a01-421f-93df-eed8e2af2590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:53.163814 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-48bad9bc-2a01-421f-93df-eed8e2af2590 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:53.168453 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-48bad9bc-2a01-421f-93df-eed8e2af2590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:53.182598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 833/1654] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:49:53.187245 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10846414-daa5-40cb-8c76-7709e2eaf5e1 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:53.198330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10846414-daa5-40cb-8c76-7709e2eaf5e1 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:53.212235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234a8d7-ad30-4aa4-ae8b-8e32fa520611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:53.213276 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a8d7-ad30-4aa4-ae8b-8e32fa520611 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:53.214434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a8d7-ad30-4aa4-ae8b-8e32fa520611 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:53.214916 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a8d7-ad30-4aa4-ae8b-8e32fa520611 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:53.216022 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234a8d7-ad30-4aa4-ae8b-8e32fa520611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:49:53.216595 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234a8d7-ad30-4aa4-ae8b-8e32fa520611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:53.219115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234a8d7-ad30-4aa4-ae8b-8e32fa520611 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:53.250814 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 822/1655] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:49:53.255835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad9bc-2a01-421f-93df-eed8e2af2590 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:53.277586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad9bc-2a01-421f-93df-eed8e2af2590 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:53.285616 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88652917-1182-4d91-901e-6529dd1e720a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:53.286413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88652917-1182-4d91-901e-6529dd1e720a admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:53.286801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88652917-1182-4d91-901e-6529dd1e720a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:53.287242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88652917-1182-4d91-901e-6529dd1e720a admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:53.288040 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88652917-1182-4d91-901e-6529dd1e720a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:53.290181 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88652917-1182-4d91-901e-6529dd1e720a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:53.403633 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 834/1656] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:49:53 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:49:53.408172 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234a8d7-ad30-4aa4-ae8b-8e32fa520611 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:53.434159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234a8d7-ad30-4aa4-ae8b-8e32fa520611 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:53.570188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde20be9-26a0-4b73-a559-5f5c9c1ed2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:53.571089 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde20be9-26a0-4b73-a559-5f5c9c1ed2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:53.571514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde20be9-26a0-4b73-a559-5f5c9c1ed2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:53.571933 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde20be9-26a0-4b73-a559-5f5c9c1ed2a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:53.572852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde20be9-26a0-4b73-a559-5f5c9c1ed2a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:53.575087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde20be9-26a0-4b73-a559-5f5c9c1ed2a1 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:53.637615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88652917-1182-4d91-901e-6529dd1e720a admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:53.638789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-88652917-1182-4d91-901e-6529dd1e720a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:53.664396 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88652917-1182-4d91-901e-6529dd1e720a admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:53.682903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f1ec2-f808-4b56-a35a-94216096717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:53.684075 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f1ec2-f808-4b56-a35a-94216096717f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:53.684594 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f1ec2-f808-4b56-a35a-94216096717f admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:53.685083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f1ec2-f808-4b56-a35a-94216096717f admin admin] PATH_INFO: `/v3/projects/587ad1bdb7104d108f1e61785bef7b99` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:53.685469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 823/1657] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:49:53 2022] POST /identity/v3/users => generated 288 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:53.686632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde20be9-26a0-4b73-a559-5f5c9c1ed2a1 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:53.688176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f1ec2-f808-4b56-a35a-94216096717f admin admin] RBAC: Authorizing `identity:delete_project(project_id=587ad1bdb7104d108f1e61785bef7b99)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:53.690128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f1ec2-f808-4b56-a35a-94216096717f admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:53.712446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde20be9-26a0-4b73-a559-5f5c9c1ed2a1 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:53.724238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dff5b-2080-4dc6-b3df-2e6b56088db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:53.724238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dff5b-2080-4dc6-b3df-2e6b56088db1 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:53.724238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dff5b-2080-4dc6-b3df-2e6b56088db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:53.724794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dff5b-2080-4dc6-b3df-2e6b56088db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:53.742561 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dff5b-2080-4dc6-b3df-2e6b56088db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:53.744562 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dff5b-2080-4dc6-b3df-2e6b56088db1 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:53.783164 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 824/1658] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:53.787628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dff5b-2080-4dc6-b3df-2e6b56088db1 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:53.807902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dff5b-2080-4dc6-b3df-2e6b56088db1 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:53.820797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd27636-a1fe-4dbf-b3c9-61482b35e882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:53.821495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd27636-a1fe-4dbf-b3c9-61482b35e882 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:53.821953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd27636-a1fe-4dbf-b3c9-61482b35e882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:53.822461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd27636-a1fe-4dbf-b3c9-61482b35e882 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:53.823638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd27636-a1fe-4dbf-b3c9-61482b35e882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:53.825795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd27636-a1fe-4dbf-b3c9-61482b35e882 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:53.843672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 825/1659] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:53.859265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd27636-a1fe-4dbf-b3c9-61482b35e882 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:53.872367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd27636-a1fe-4dbf-b3c9-61482b35e882 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:53.888842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed9eef-2a02-481e-8fa6-12cd34a43227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:53.892510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed9eef-2a02-481e-8fa6-12cd34a43227 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:53.892510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed9eef-2a02-481e-8fa6-12cd34a43227 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:53.893542 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed9eef-2a02-481e-8fa6-12cd34a43227 admin admin] PATH_INFO: `/v3/projects/bfc47e0d2d194bd2aeb3482e2e13c4ca/users/30ed5083a3f4474892413fe76324d331/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:53.920955 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-437f1ec2-f808-4b56-a35a-94216096717f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '587ad1bdb7104d108f1e61785bef7b99', 'request_id': 'req-437f1ec2-f808-4b56-a35a-94216096717f'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:53.942482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-437f1ec2-f808-4b56-a35a-94216096717f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '587ad1bdb7104d108f1e61785bef7b99', 'request_id': 'req-437f1ec2-f808-4b56-a35a-94216096717f'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:53.947510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed9eef-2a02-481e-8fa6-12cd34a43227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc47e0d2d194bd2aeb3482e2e13c4ca, user_id=30ed5083a3f4474892413fe76324d331, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:53.955865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed9eef-2a02-481e-8fa6-12cd34a43227 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:54.052952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-437f1ec2-f808-4b56-a35a-94216096717f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '587ad1bdb7104d108f1e61785bef7b99', 'request_id': 'req-437f1ec2-f808-4b56-a35a-94216096717f'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:54.070761 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-437f1ec2-f808-4b56-a35a-94216096717f admin admin] The token cache is being invalidate because project 587ad1bdb7104d108f1e61785bef7b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:49:54.071737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-437f1ec2-f808-4b56-a35a-94216096717f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:54.073771 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-437f1ec2-f808-4b56-a35a-94216096717f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:54.077317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 835/1660] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:49:53 2022] DELETE /identity/v3/projects/587ad1bdb7104d108f1e61785bef7b99 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:49:54.080538 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf04256-71e3-44cc-a8a6-0c1de79105aa None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:54.083758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf04256-71e3-44cc-a8a6-0c1de79105aa None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:54.100477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 826/1661] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:49:53 2022] PUT /identity/v3/projects/bfc47e0d2d194bd2aeb3482e2e13c4ca/users/30ed5083a3f4474892413fe76324d331/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:54.100477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed9eef-2a02-481e-8fa6-12cd34a43227 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:54.100677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf04256-71e3-44cc-a8a6-0c1de79105aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:54.104784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-efed9eef-2a02-481e-8fa6-12cd34a43227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:54.166522 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:54.171010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-cdf04256-71e3-44cc-a8a6-0c1de79105aa None None] MFA Rules not processed for user `d4fbfe7d86aa42019a66868517eea7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:54.177570 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-cdf04256-71e3-44cc-a8a6-0c1de79105aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:54.287394 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed9eef-2a02-481e-8fa6-12cd34a43227 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:54.301559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e60e4f-e2a6-41c5-a9a9-ab88dca0bde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:54.302474 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e60e4f-e2a6-41c5-a9a9-ab88dca0bde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:54.302757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e60e4f-e2a6-41c5-a9a9-ab88dca0bde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:54.303032 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e60e4f-e2a6-41c5-a9a9-ab88dca0bde1 admin admin] PATH_INFO: `/v3/users/33ad0a4fcd0d4f80ade697f7f833aa3a` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:54.305910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e60e4f-e2a6-41c5-a9a9-ab88dca0bde1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ad0a4fcd0d4f80ade697f7f833aa3a)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:54.309498 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e60e4f-e2a6-41c5-a9a9-ab88dca0bde1 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:54.339649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 836/1662] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:49:54.341022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f57453-2612-446b-b385-6075e66e4223 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:54.341307 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f57453-2612-446b-b385-6075e66e4223 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:54.341582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f57453-2612-446b-b385-6075e66e4223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:54.408962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-d0f57453-2612-446b-b385-6075e66e4223 None None] MFA Rules not processed for user `30ed5083a3f4474892413fe76324d331`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:54.410373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d0f57453-2612-446b-b385-6075e66e4223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:54.544216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 837/1663] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:54.544216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96f81b-5025-4ca8-9d71-123ae68ec5dd None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:54.544216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96f81b-5025-4ca8-9d71-123ae68ec5dd None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:54.544216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96f81b-5025-4ca8-9d71-123ae68ec5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:54.572411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-58e60e4f-e2a6-41c5-a9a9-ab88dca0bde1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ad0a4fcd0d4f80ade697f7f833aa3a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:54.593150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-3e96f81b-5025-4ca8-9d71-123ae68ec5dd None None] MFA Rules not processed for user `d4fbfe7d86aa42019a66868517eea7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:54.595027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3e96f81b-5025-4ca8-9d71-123ae68ec5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:54.602003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-58e60e4f-e2a6-41c5-a9a9-ab88dca0bde1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ad0a4fcd0d4f80ade697f7f833aa3a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:54.615608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 838/1664] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:54.620734 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96f81b-5025-4ca8-9d71-123ae68ec5dd None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:54.626583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3e96f81b-5025-4ca8-9d71-123ae68ec5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:54.710501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-58e60e4f-e2a6-41c5-a9a9-ab88dca0bde1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ad0a4fcd0d4f80ade697f7f833aa3a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:54.711526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-58e60e4f-e2a6-41c5-a9a9-ab88dca0bde1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ad0a4fcd0d4f80ade697f7f833aa3a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:54.712476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-58e60e4f-e2a6-41c5-a9a9-ab88dca0bde1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ad0a4fcd0d4f80ade697f7f833aa3a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:54.734455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96f81b-5025-4ca8-9d71-123ae68ec5dd None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:54.740847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec86596-da29-40da-a3e0-e449437a40e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:54.741578 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec86596-da29-40da-a3e0-e449437a40e6 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:54.742212 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec86596-da29-40da-a3e0-e449437a40e6 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:54.742212 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec86596-da29-40da-a3e0-e449437a40e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:54.744266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0ec86596-da29-40da-a3e0-e449437a40e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:54.756826 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec86596-da29-40da-a3e0-e449437a40e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:54.758719 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec86596-da29-40da-a3e0-e449437a40e6 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:54.763673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 827/1665] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:49:54 2022] DELETE /identity/v3/users/33ad0a4fcd0d4f80ade697f7f833aa3a => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:54.768231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e60e4f-e2a6-41c5-a9a9-ab88dca0bde1 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:54.772149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-58e60e4f-e2a6-41c5-a9a9-ab88dca0bde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:54.778714 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 839/1666] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:55.012492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e60e4f-e2a6-41c5-a9a9-ab88dca0bde1 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:55.051049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca701d9-4e57-4472-a202-2fd791d5d7c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:55.051698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca701d9-4e57-4472-a202-2fd791d5d7c4 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:55.051981 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca701d9-4e57-4472-a202-2fd791d5d7c4 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:55.052286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca701d9-4e57-4472-a202-2fd791d5d7c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:55.068029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-bca701d9-4e57-4472-a202-2fd791d5d7c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:55.165740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec86596-da29-40da-a3e0-e449437a40e6 service nova] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:55.165819 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:55.168161 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0ec86596-da29-40da-a3e0-e449437a40e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:55.208893 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec86596-da29-40da-a3e0-e449437a40e6 service nova] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:55.230672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca701d9-4e57-4472-a202-2fd791d5d7c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:55.232346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca701d9-4e57-4472-a202-2fd791d5d7c4 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:55.263103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 828/1667] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:55.306217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1e2e9-4bda-420b-b79b-2d19cbec8eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:55.307152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1e2e9-4bda-420b-b79b-2d19cbec8eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:55.307622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1e2e9-4bda-420b-b79b-2d19cbec8eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:55.308058 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1e2e9-4bda-420b-b79b-2d19cbec8eb7 admin admin] PATH_INFO: `/v3/users/30ed5083a3f4474892413fe76324d331` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:55.310182 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1e2e9-4bda-420b-b79b-2d19cbec8eb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30ed5083a3f4474892413fe76324d331)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:55.326151 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1e2e9-4bda-420b-b79b-2d19cbec8eb7 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:55.751916 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-c3c1e2e9-4bda-420b-b79b-2d19cbec8eb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30ed5083a3f4474892413fe76324d331'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:55.754260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-c3c1e2e9-4bda-420b-b79b-2d19cbec8eb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30ed5083a3f4474892413fe76324d331'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:55.818558 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-c3c1e2e9-4bda-420b-b79b-2d19cbec8eb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30ed5083a3f4474892413fe76324d331'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:55.819231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-c3c1e2e9-4bda-420b-b79b-2d19cbec8eb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30ed5083a3f4474892413fe76324d331'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:55.847488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-c3c1e2e9-4bda-420b-b79b-2d19cbec8eb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30ed5083a3f4474892413fe76324d331'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:55.853585 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 840/1668] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:49:55 2022] DELETE /identity/v3/users/30ed5083a3f4474892413fe76324d331 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:55.858308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cf5e8-9d28-4276-b77c-aac2dc93b467 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:55.858844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cf5e8-9d28-4276-b77c-aac2dc93b467 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:55.859236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cf5e8-9d28-4276-b77c-aac2dc93b467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:55.881939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-fa9cf5e8-9d28-4276-b77c-aac2dc93b467 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:55.883398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-fa9cf5e8-9d28-4276-b77c-aac2dc93b467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:55.973935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 829/1669] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:56.004294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1e2e9-4bda-420b-b79b-2d19cbec8eb7 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:56.008306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c3c1e2e9-4bda-420b-b79b-2d19cbec8eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:56.085169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:56.122488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1e2e9-4bda-420b-b79b-2d19cbec8eb7 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:56.132285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e5222-642f-4ca9-89f1-a4e72598c102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:56.133264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e5222-642f-4ca9-89f1-a4e72598c102 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:56.133821 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e5222-642f-4ca9-89f1-a4e72598c102 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:56.134367 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e5222-642f-4ca9-89f1-a4e72598c102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:56.151397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e5222-642f-4ca9-89f1-a4e72598c102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:56.153373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e5222-642f-4ca9-89f1-a4e72598c102 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:56.175820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 841/1670] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:56.403015 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:56.470143 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c45e13-6e7a-458c-8d90-330946b8eb92 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:56.470434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c45e13-6e7a-458c-8d90-330946b8eb92 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:56.471189 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c45e13-6e7a-458c-8d90-330946b8eb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:56.537167 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-64c45e13-6e7a-458c-8d90-330946b8eb92 None None] MFA Rules not processed for user `bd130bf777664a62ab043200c84ac8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:56.538952 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-64c45e13-6e7a-458c-8d90-330946b8eb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:56.666071 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbdaf0-088f-4b8a-8d88-229bf802e174 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:56.666357 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbdaf0-088f-4b8a-8d88-229bf802e174 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:56.666631 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbdaf0-088f-4b8a-8d88-229bf802e174 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:56.667974 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 842/1671] 10.222.0.62 () {54 vars in 912 bytes} [Mon Aug 29 22:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:49:56.676600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88912593-3ec0-4ed8-b431-b6489dd763fd None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:56.676600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88912593-3ec0-4ed8-b431-b6489dd763fd None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:56.676600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88912593-3ec0-4ed8-b431-b6489dd763fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:56.743624 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 830/1672] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:56.758937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c45e13-6e7a-458c-8d90-330946b8eb92 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:56.760718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-64c45e13-6e7a-458c-8d90-330946b8eb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:56.796070 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-88912593-3ec0-4ed8-b431-b6489dd763fd None None] MFA Rules not processed for user `d8794e99a0024672974412ca4c045b63`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:56.798871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-88912593-3ec0-4ed8-b431-b6489dd763fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:56.825498 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 843/1673] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 29 22:49:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 29 22:49:56.900390 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88912593-3ec0-4ed8-b431-b6489dd763fd None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:56.901816 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-88912593-3ec0-4ed8-b431-b6489dd763fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:56.951649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88912593-3ec0-4ed8-b431-b6489dd763fd None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:56.975212 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d190bf-5667-49a4-aaac-d9d781efdc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:56.976305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d190bf-5667-49a4-aaac-d9d781efdc5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:56.976305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d190bf-5667-49a4-aaac-d9d781efdc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:56.976491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d190bf-5667-49a4-aaac-d9d781efdc5c admin admin] PATH_INFO: `/v3/users/5636bb138fba4ddbb13b6fc4078b0569` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:56.983251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d190bf-5667-49a4-aaac-d9d781efdc5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5636bb138fba4ddbb13b6fc4078b0569)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:56.985967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d190bf-5667-49a4-aaac-d9d781efdc5c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:57.014727 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:57.045307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c45e13-6e7a-458c-8d90-330946b8eb92 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:57.065505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8c5d6-d9e6-4ef9-a211-fa0d406345d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:57.066136 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8c5d6-d9e6-4ef9-a211-fa0d406345d9 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:57.066410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8c5d6-d9e6-4ef9-a211-fa0d406345d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:57.066700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8c5d6-d9e6-4ef9-a211-fa0d406345d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:57.086562 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8c5d6-d9e6-4ef9-a211-fa0d406345d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:57.099977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8c5d6-d9e6-4ef9-a211-fa0d406345d9 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:57.121074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 831/1674] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:49:57.127417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8c5d6-d9e6-4ef9-a211-fa0d406345d9 service nova] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:57.132026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-67c8c5d6-d9e6-4ef9-a211-fa0d406345d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:57.162823 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8c5d6-d9e6-4ef9-a211-fa0d406345d9 service nova] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:57.176885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb596f0e-568d-4441-910d-98d4f7fb9c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:57.178849 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb596f0e-568d-4441-910d-98d4f7fb9c26 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:57.179358 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb596f0e-568d-4441-910d-98d4f7fb9c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:57.180439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb596f0e-568d-4441-910d-98d4f7fb9c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:57.201992 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb596f0e-568d-4441-910d-98d4f7fb9c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:57.207081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb596f0e-568d-4441-910d-98d4f7fb9c26 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:57.227046 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 832/1675] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:57.228636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb596f0e-568d-4441-910d-98d4f7fb9c26 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:57.230760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-bb596f0e-568d-4441-910d-98d4f7fb9c26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:57.265380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb596f0e-568d-4441-910d-98d4f7fb9c26 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:57.279820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593df9f-ef0e-4af6-9868-9d099ad0b354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:57.281818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593df9f-ef0e-4af6-9868-9d099ad0b354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:57.283115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593df9f-ef0e-4af6-9868-9d099ad0b354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:57.285279 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593df9f-ef0e-4af6-9868-9d099ad0b354 admin admin] PATH_INFO: `/v3/projects/eb58eeb12bbd46bf8e868d6bc0181c56` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:57.288782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593df9f-ef0e-4af6-9868-9d099ad0b354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb58eeb12bbd46bf8e868d6bc0181c56)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:57.290069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: WARNING py.warnings [None req-c593df9f-ef0e-4af6-9868-9d099ad0b354 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:49:57.290069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: warnings.warn(msg) Aug 29 22:49:57.290069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: Aug 29 22:49:57.292280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-55d190bf-5667-49a4-aaac-d9d781efdc5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5636bb138fba4ddbb13b6fc4078b0569'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:57.293563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593df9f-ef0e-4af6-9868-9d099ad0b354 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:57.296183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-55d190bf-5667-49a4-aaac-d9d781efdc5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5636bb138fba4ddbb13b6fc4078b0569'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:57.396699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-55d190bf-5667-49a4-aaac-d9d781efdc5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5636bb138fba4ddbb13b6fc4078b0569'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:57.397248 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-55d190bf-5667-49a4-aaac-d9d781efdc5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5636bb138fba4ddbb13b6fc4078b0569'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:57.421584 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-55d190bf-5667-49a4-aaac-d9d781efdc5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5636bb138fba4ddbb13b6fc4078b0569'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:57.470618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 844/1676] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:49:56 2022] DELETE /identity/v3/users/5636bb138fba4ddbb13b6fc4078b0569 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:57.475351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d86b0-6989-4e43-9a11-a593d4b2d9db None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:57.475504 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d86b0-6989-4e43-9a11-a593d4b2d9db None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:57.478529 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d86b0-6989-4e43-9a11-a593d4b2d9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:57.544020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c593df9f-ef0e-4af6-9868-9d099ad0b354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb58eeb12bbd46bf8e868d6bc0181c56', 'request_id': 'req-c593df9f-ef0e-4af6-9868-9d099ad0b354'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:57.569384 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-210d86b0-6989-4e43-9a11-a593d4b2d9db None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:57.572765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-210d86b0-6989-4e43-9a11-a593d4b2d9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:57.653901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c593df9f-ef0e-4af6-9868-9d099ad0b354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb58eeb12bbd46bf8e868d6bc0181c56', 'request_id': 'req-c593df9f-ef0e-4af6-9868-9d099ad0b354'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:57.663353 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c593df9f-ef0e-4af6-9868-9d099ad0b354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb58eeb12bbd46bf8e868d6bc0181c56', 'request_id': 'req-c593df9f-ef0e-4af6-9868-9d099ad0b354'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:57.733234 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c593df9f-ef0e-4af6-9868-9d099ad0b354 admin admin] The token cache is being invalidate because project eb58eeb12bbd46bf8e868d6bc0181c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:49:57.734341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c593df9f-ef0e-4af6-9868-9d099ad0b354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:57.738165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c593df9f-ef0e-4af6-9868-9d099ad0b354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:57.742415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 833/1677] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:49:57 2022] DELETE /identity/v3/projects/eb58eeb12bbd46bf8e868d6bc0181c56 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:57.749465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ad871-342f-463c-8b4d-ea962176c35a None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:57.749971 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ad871-342f-463c-8b4d-ea962176c35a None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:57.751111 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ad871-342f-463c-8b4d-ea962176c35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:57.802634 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 845/1678] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:57.811788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d98ad871-342f-463c-8b4d-ea962176c35a None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:57.813327 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d98ad871-342f-463c-8b4d-ea962176c35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:57.820462 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:57.834979 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 834/1679] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:57.840772 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d86b0-6989-4e43-9a11-a593d4b2d9db None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:57.842693 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-210d86b0-6989-4e43-9a11-a593d4b2d9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:57.845638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45fa32-ada4-47a5-8231-aae79ac05eb8 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:57.846776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45fa32-ada4-47a5-8231-aae79ac05eb8 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:57.848031 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45fa32-ada4-47a5-8231-aae79ac05eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:57.915207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-dc45fa32-ada4-47a5-8231-aae79ac05eb8 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:57.916516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-dc45fa32-ada4-47a5-8231-aae79ac05eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:57.949986 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 835/1680] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:57.952755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45fa32-ada4-47a5-8231-aae79ac05eb8 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:57.982771 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45fa32-ada4-47a5-8231-aae79ac05eb8 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:58.003978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26aa94-133e-4d73-9279-635d6ff9e1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:58.004663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26aa94-133e-4d73-9279-635d6ff9e1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:58.008295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26aa94-133e-4d73-9279-635d6ff9e1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:58.008593 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26aa94-133e-4d73-9279-635d6ff9e1e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:58.012531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26aa94-133e-4d73-9279-635d6ff9e1e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:49:58.014010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26aa94-133e-4d73-9279-635d6ff9e1e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:58.018711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26aa94-133e-4d73-9279-635d6ff9e1e7 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:58.038477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d86b0-6989-4e43-9a11-a593d4b2d9db None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:58.065310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aece1-e227-4024-8938-0ffda84072d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:58.066069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aece1-e227-4024-8938-0ffda84072d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:58.066368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aece1-e227-4024-8938-0ffda84072d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:58.066645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aece1-e227-4024-8938-0ffda84072d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:58.080167 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 836/1681] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:49:58.086186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26aa94-133e-4d73-9279-635d6ff9e1e7 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:58.109361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1aece1-e227-4024-8938-0ffda84072d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:58.112745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1aece1-e227-4024-8938-0ffda84072d0 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:58.121130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26aa94-133e-4d73-9279-635d6ff9e1e7 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:58.142599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931d662-9aa4-4023-aa00-a5404e7d5cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:58.143649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931d662-9aa4-4023-aa00-a5404e7d5cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:58.144149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931d662-9aa4-4023-aa00-a5404e7d5cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:58.144583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931d662-9aa4-4023-aa00-a5404e7d5cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:58.145372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931d662-9aa4-4023-aa00-a5404e7d5cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:58.147740 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931d662-9aa4-4023-aa00-a5404e7d5cb1 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:58.147916 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 846/1682] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:49:58.176967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aece1-e227-4024-8938-0ffda84072d0 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:58.182140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8d1aece1-e227-4024-8938-0ffda84072d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:58.200365 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aece1-e227-4024-8938-0ffda84072d0 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:58.212183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6675238-d9c3-4073-86e6-cd162b1069bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:58.212949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675238-d9c3-4073-86e6-cd162b1069bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:58.213297 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675238-d9c3-4073-86e6-cd162b1069bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:58.213798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675238-d9c3-4073-86e6-cd162b1069bd admin admin] PATH_INFO: `/v3/projects/bfc47e0d2d194bd2aeb3482e2e13c4ca` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:58.215820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6675238-d9c3-4073-86e6-cd162b1069bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc47e0d2d194bd2aeb3482e2e13c4ca)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:58.220625 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6675238-d9c3-4073-86e6-cd162b1069bd admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:58.275647 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 837/1683] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:49:58 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:58.279972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931d662-9aa4-4023-aa00-a5404e7d5cb1 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:58.455848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e6675238-d9c3-4073-86e6-cd162b1069bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc47e0d2d194bd2aeb3482e2e13c4ca', 'request_id': 'req-e6675238-d9c3-4073-86e6-cd162b1069bd'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:58.494333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931d662-9aa4-4023-aa00-a5404e7d5cb1 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:58.501218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e6675238-d9c3-4073-86e6-cd162b1069bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc47e0d2d194bd2aeb3482e2e13c4ca', 'request_id': 'req-e6675238-d9c3-4073-86e6-cd162b1069bd'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:58.572636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:58.583215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661760d-9bc9-47a1-b4fb-a6086120c954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:58.584060 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661760d-9bc9-47a1-b4fb-a6086120c954 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:58.584564 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661760d-9bc9-47a1-b4fb-a6086120c954 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:58.585146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661760d-9bc9-47a1-b4fb-a6086120c954 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:58.585952 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661760d-9bc9-47a1-b4fb-a6086120c954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:58.588048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661760d-9bc9-47a1-b4fb-a6086120c954 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:58.590412 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e6675238-d9c3-4073-86e6-cd162b1069bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc47e0d2d194bd2aeb3482e2e13c4ca', 'request_id': 'req-e6675238-d9c3-4073-86e6-cd162b1069bd'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:58.611569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e6675238-d9c3-4073-86e6-cd162b1069bd admin admin] The token cache is being invalidate because project bfc47e0d2d194bd2aeb3482e2e13c4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:49:58.612106 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e6675238-d9c3-4073-86e6-cd162b1069bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:58.612940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e6675238-d9c3-4073-86e6-cd162b1069bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:49:58.615017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 847/1684] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:49:58 2022] DELETE /identity/v3/projects/bfc47e0d2d194bd2aeb3482e2e13c4ca => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:58.616007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6675238-d9c3-4073-86e6-cd162b1069bd admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:58.619786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e6675238-d9c3-4073-86e6-cd162b1069bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:58.719790 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 838/1685] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:49:58 2022] POST /identity/v3/users => generated 289 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:58.721774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157cca9-c5f8-47e0-b4c2-39be4f927628 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:58.722428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157cca9-c5f8-47e0-b4c2-39be4f927628 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:58.724666 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157cca9-c5f8-47e0-b4c2-39be4f927628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:58.809870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6675238-d9c3-4073-86e6-cd162b1069bd admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:58.813301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-8157cca9-c5f8-47e0-b4c2-39be4f927628 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:58.815831 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8157cca9-c5f8-47e0-b4c2-39be4f927628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:58.831815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ee731-8eca-4ec5-a44e-28143e91b554 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2991c613878e4993901199434f384f49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:58.836931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ee731-8eca-4ec5-a44e-28143e91b554 service placement] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:58.836931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ee731-8eca-4ec5-a44e-28143e91b554 service placement] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:58.836931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ee731-8eca-4ec5-a44e-28143e91b554 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:58.863346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-322ee731-8eca-4ec5-a44e-28143e91b554 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:58.867072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 839/1686] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:58.869244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157cca9-c5f8-47e0-b4c2-39be4f927628 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:58.875508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8157cca9-c5f8-47e0-b4c2-39be4f927628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:58.896278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ee731-8eca-4ec5-a44e-28143e91b554 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:58.899668 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ee731-8eca-4ec5-a44e-28143e91b554 service placement] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:58.904911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157cca9-c5f8-47e0-b4c2-39be4f927628 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:58.919540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82112c-3b55-425d-9f61-3dac6553ca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:58.920270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82112c-3b55-425d-9f61-3dac6553ca36 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:58.920553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82112c-3b55-425d-9f61-3dac6553ca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:58.921972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82112c-3b55-425d-9f61-3dac6553ca36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:58.922792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82112c-3b55-425d-9f61-3dac6553ca36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:58.927493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 848/1687] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:58.927952 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82112c-3b55-425d-9f61-3dac6553ca36 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:58.930657 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ada830-4d9b-40a3-a490-639e7bd9f240 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:58.931774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ada830-4d9b-40a3-a490-639e7bd9f240 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:58.932062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ada830-4d9b-40a3-a490-639e7bd9f240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:58.957210 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 840/1688] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:58.958599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418ddd1-d607-453b-8b79-0f8110be92e3 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:58.958890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418ddd1-d607-453b-8b79-0f8110be92e3 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:58.959168 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418ddd1-d607-453b-8b79-0f8110be92e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:58.993441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:59.004608 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-9418ddd1-d607-453b-8b79-0f8110be92e3 None None] MFA Rules not processed for user `d4fbfe7d86aa42019a66868517eea7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:59.004694 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-24ada830-4d9b-40a3-a490-639e7bd9f240 None None] MFA Rules not processed for user `702f1e3b8d0342fc999f63d701bc4772`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:59.006867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-24ada830-4d9b-40a3-a490-639e7bd9f240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:59.009864 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9418ddd1-d607-453b-8b79-0f8110be92e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:59.228153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 849/1689] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:59.245736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb3bd8-0f4b-40eb-ad0d-7274b28f2699 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:59.248457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb3bd8-0f4b-40eb-ad0d-7274b28f2699 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:59.248457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb3bd8-0f4b-40eb-ad0d-7274b28f2699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:59.263672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 841/1690] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:59.264375 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418ddd1-d607-453b-8b79-0f8110be92e3 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:59.309728 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-5aeb3bd8-0f4b-40eb-ad0d-7274b28f2699 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:59.310996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-5aeb3bd8-0f4b-40eb-ad0d-7274b28f2699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:59.322784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418ddd1-d607-453b-8b79-0f8110be92e3 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:59.339266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 850/1691] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:59.340458 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb3bd8-0f4b-40eb-ad0d-7274b28f2699 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:59.344645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619392a1-fa64-4523-96f7-a6ed0f7320fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:59.345280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619392a1-fa64-4523-96f7-a6ed0f7320fb admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:59.347230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-5aeb3bd8-0f4b-40eb-ad0d-7274b28f2699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:59.350865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619392a1-fa64-4523-96f7-a6ed0f7320fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:59.356616 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619392a1-fa64-4523-96f7-a6ed0f7320fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:59.357558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619392a1-fa64-4523-96f7-a6ed0f7320fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:59.359417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619392a1-fa64-4523-96f7-a6ed0f7320fb admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:59.419019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 842/1692] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:49:59.430215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619392a1-fa64-4523-96f7-a6ed0f7320fb admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:59.464860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619392a1-fa64-4523-96f7-a6ed0f7320fb admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:59.491287 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f551dff-46da-47a3-8fb7-833417d36405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:59.491935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f551dff-46da-47a3-8fb7-833417d36405 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:59.492392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f551dff-46da-47a3-8fb7-833417d36405 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:59.492745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f551dff-46da-47a3-8fb7-833417d36405 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:59.493483 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f551dff-46da-47a3-8fb7-833417d36405 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:49:59.496912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f551dff-46da-47a3-8fb7-833417d36405 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:59.501623 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f551dff-46da-47a3-8fb7-833417d36405 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:59.522316 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb3bd8-0f4b-40eb-ad0d-7274b28f2699 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:59.529259 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2c302-3c52-4218-88c5-80ee034abe6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:59.530023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2c302-3c52-4218-88c5-80ee034abe6f service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:59.531040 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2c302-3c52-4218-88c5-80ee034abe6f service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:59.531560 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2c302-3c52-4218-88c5-80ee034abe6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:59.544944 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2c302-3c52-4218-88c5-80ee034abe6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:59.551406 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2c302-3c52-4218-88c5-80ee034abe6f service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:59.555489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 843/1693] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:49:59.557408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f551dff-46da-47a3-8fb7-833417d36405 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:59.585158 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 851/1694] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:49:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:49:59.587752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2c302-3c52-4218-88c5-80ee034abe6f service nova] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:59.615860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f551dff-46da-47a3-8fb7-833417d36405 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:59.628253 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a5aa9-7001-41bf-acad-3f406a09ce77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:59.629279 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a5aa9-7001-41bf-acad-3f406a09ce77 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:59.629651 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a5aa9-7001-41bf-acad-3f406a09ce77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:59.629930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a5aa9-7001-41bf-acad-3f406a09ce77 admin admin] PATH_INFO: `/v3/projects/987947b29de3484087706ccdf759150b/users/59bdd9dab0c34b9ba99e9de4c015998b/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:59.643434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2c302-3c52-4218-88c5-80ee034abe6f service nova] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:59.665158 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a5aa9-7001-41bf-acad-3f406a09ce77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987947b29de3484087706ccdf759150b, user_id=59bdd9dab0c34b9ba99e9de4c015998b, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:59.668337 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a5aa9-7001-41bf-acad-3f406a09ce77 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:59.674432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908804cb-43ee-4ebc-89f2-8bd5870976a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:59.675072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908804cb-43ee-4ebc-89f2-8bd5870976a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:59.675363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908804cb-43ee-4ebc-89f2-8bd5870976a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:59.675638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908804cb-43ee-4ebc-89f2-8bd5870976a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:59.676320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908804cb-43ee-4ebc-89f2-8bd5870976a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:59.678283 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908804cb-43ee-4ebc-89f2-8bd5870976a8 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:49:59.753348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 844/1695] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:49:59 2022] PUT /identity/v3/projects/987947b29de3484087706ccdf759150b/users/59bdd9dab0c34b9ba99e9de4c015998b/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:49:59.765906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df646950-7167-4aa2-bcee-b6887586d4bb None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:59.766240 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df646950-7167-4aa2-bcee-b6887586d4bb None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:59.767026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df646950-7167-4aa2-bcee-b6887586d4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:59.838911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-df646950-7167-4aa2-bcee-b6887586d4bb None None] MFA Rules not processed for user `59bdd9dab0c34b9ba99e9de4c015998b`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:59.840874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-df646950-7167-4aa2-bcee-b6887586d4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:59.865803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 852/1696] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:49:59 2022] POST /identity/v3/projects => generated 405 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:49:59.869887 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908804cb-43ee-4ebc-89f2-8bd5870976a8 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:49:59.954617 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908804cb-43ee-4ebc-89f2-8bd5870976a8 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:49:59.975684 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bdda1-aa11-4e74-a117-799fb62e58aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:49:59.976351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bdda1-aa11-4e74-a117-799fb62e58aa admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:59.977832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bdda1-aa11-4e74-a117-799fb62e58aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:59.978141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bdda1-aa11-4e74-a117-799fb62e58aa admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:59.978800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bdda1-aa11-4e74-a117-799fb62e58aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:49:59.982078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bdda1-aa11-4e74-a117-799fb62e58aa admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:00.017690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 845/1697] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:49:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:00.019208 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df646950-7167-4aa2-bcee-b6887586d4bb None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:00.110326 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 853/1698] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:49:59 2022] POST /identity/v3/users => generated 303 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:00.112623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bdda1-aa11-4e74-a117-799fb62e58aa admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:00.138490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bdda1-aa11-4e74-a117-799fb62e58aa admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:00.173038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a23bba-732a-4f82-8cd0-4f425b9cef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:00.173970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a23bba-732a-4f82-8cd0-4f425b9cef3f admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:00.174258 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a23bba-732a-4f82-8cd0-4f425b9cef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:00.174532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a23bba-732a-4f82-8cd0-4f425b9cef3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:00.175859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a23bba-732a-4f82-8cd0-4f425b9cef3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:00.180854 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a23bba-732a-4f82-8cd0-4f425b9cef3f admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:00.209488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 854/1699] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:00.217490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a23bba-732a-4f82-8cd0-4f425b9cef3f admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:00.219552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df646950-7167-4aa2-bcee-b6887586d4bb None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:00.236912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc8176-b8bf-4a88-90dd-7b09da5b1f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:00.237648 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc8176-b8bf-4a88-90dd-7b09da5b1f0e admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:00.237936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc8176-b8bf-4a88-90dd-7b09da5b1f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:00.238262 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc8176-b8bf-4a88-90dd-7b09da5b1f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:00.239318 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc8176-b8bf-4a88-90dd-7b09da5b1f0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:00.240749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a23bba-732a-4f82-8cd0-4f425b9cef3f admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:00.240872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc8176-b8bf-4a88-90dd-7b09da5b1f0e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:00.253450 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85dc5e-3c1c-42a0-8b48-41059d3fb7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:00.254089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85dc5e-3c1c-42a0-8b48-41059d3fb7ab admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:00.254375 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85dc5e-3c1c-42a0-8b48-41059d3fb7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:00.254653 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85dc5e-3c1c-42a0-8b48-41059d3fb7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:00.255310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85dc5e-3c1c-42a0-8b48-41059d3fb7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:00.256968 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85dc5e-3c1c-42a0-8b48-41059d3fb7ab admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:00.286230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 855/1700] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:00.290432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85dc5e-3c1c-42a0-8b48-41059d3fb7ab admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:00.308599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85dc5e-3c1c-42a0-8b48-41059d3fb7ab admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:00.314406 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01def53b-6ac0-4d95-880b-77aba782fa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:00.317092 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01def53b-6ac0-4d95-880b-77aba782fa80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:00.317680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01def53b-6ac0-4d95-880b-77aba782fa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:00.318108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01def53b-6ac0-4d95-880b-77aba782fa80 admin admin] PATH_INFO: `/v3/projects/d00893d3c2f540e78e2ccd8ddc2d0203/users/cca8f52c214846549147899d11636eff/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:00.337146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01def53b-6ac0-4d95-880b-77aba782fa80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00893d3c2f540e78e2ccd8ddc2d0203, user_id=cca8f52c214846549147899d11636eff, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:00.340311 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01def53b-6ac0-4d95-880b-77aba782fa80 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:00.416915 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 846/1701] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:00 2022] POST /identity/v3/projects => generated 379 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:00.418055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc8176-b8bf-4a88-90dd-7b09da5b1f0e admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:00.422756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d7bc8176-b8bf-4a88-90dd-7b09da5b1f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:00.478392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 856/1702] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:00 2022] PUT /identity/v3/projects/d00893d3c2f540e78e2ccd8ddc2d0203/users/cca8f52c214846549147899d11636eff/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:50:00.486921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01def53b-6ac0-4d95-880b-77aba782fa80 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:00.628439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc8176-b8bf-4a88-90dd-7b09da5b1f0e admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:00.633105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01def53b-6ac0-4d95-880b-77aba782fa80 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:00.641848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792f26f-4e07-47b5-835f-701f76407063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:00.642515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792f26f-4e07-47b5-835f-701f76407063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:00.642799 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792f26f-4e07-47b5-835f-701f76407063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:00.643076 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792f26f-4e07-47b5-835f-701f76407063 admin admin] PATH_INFO: `/v3/projects/ef74fc50b645410bbf694b3f0b8e9d78` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:00.647122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792f26f-4e07-47b5-835f-701f76407063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef74fc50b645410bbf694b3f0b8e9d78)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:00.647721 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a895b-2871-4229-88c4-9e51ab30faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:00.648392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a895b-2871-4229-88c4-9e51ab30faa6 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:00.648809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a895b-2871-4229-88c4-9e51ab30faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:00.648977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792f26f-4e07-47b5-835f-701f76407063 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:00.649066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a895b-2871-4229-88c4-9e51ab30faa6 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:00.650099 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a895b-2871-4229-88c4-9e51ab30faa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:00.654153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a895b-2871-4229-88c4-9e51ab30faa6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:00.723132 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:00.757592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 857/1703] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:00 2022] POST /identity/v3/users => generated 296 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:00.759197 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb30529-87c0-4798-9c35-ac08deb03359 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:00.759766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb30529-87c0-4798-9c35-ac08deb03359 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:00.760051 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb30529-87c0-4798-9c35-ac08deb03359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:00.801143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-4cb30529-87c0-4798-9c35-ac08deb03359 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:00.802409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4cb30529-87c0-4798-9c35-ac08deb03359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:00.836553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 858/1704] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:00.841811 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fff6f7-28e5-450b-a0ba-d6162fbaa9a1 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:00.842100 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fff6f7-28e5-450b-a0ba-d6162fbaa9a1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:00.842376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fff6f7-28e5-450b-a0ba-d6162fbaa9a1 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:00.846720 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 859/1705] 10.222.0.62 () {54 vars in 912 bytes} [Mon Aug 29 22:50:00 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:00.849814 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b499278-a7c6-44f0-a250-0190b1a979d6 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:00.850129 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b499278-a7c6-44f0-a250-0190b1a979d6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:00.850409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b499278-a7c6-44f0-a250-0190b1a979d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:00.853921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d792f26f-4e07-47b5-835f-701f76407063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef74fc50b645410bbf694b3f0b8e9d78', 'request_id': 'req-d792f26f-4e07-47b5-835f-701f76407063'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:00.910971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-3b499278-a7c6-44f0-a250-0190b1a979d6 None None] MFA Rules not processed for user `b7998943912747c6935db310ff1a4b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:00.912300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3b499278-a7c6-44f0-a250-0190b1a979d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:00.957968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d792f26f-4e07-47b5-835f-701f76407063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef74fc50b645410bbf694b3f0b8e9d78', 'request_id': 'req-d792f26f-4e07-47b5-835f-701f76407063'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:00.971241 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d792f26f-4e07-47b5-835f-701f76407063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef74fc50b645410bbf694b3f0b8e9d78', 'request_id': 'req-d792f26f-4e07-47b5-835f-701f76407063'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:00.985817 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d792f26f-4e07-47b5-835f-701f76407063 admin admin] The token cache is being invalidate because project ef74fc50b645410bbf694b3f0b8e9d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:00.986169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d792f26f-4e07-47b5-835f-701f76407063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:00.987075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d792f26f-4e07-47b5-835f-701f76407063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:01.003013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 847/1706] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:00 2022] DELETE /identity/v3/projects/ef74fc50b645410bbf694b3f0b8e9d78 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:01.003579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792f26f-4e07-47b5-835f-701f76407063 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:01.023515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d792f26f-4e07-47b5-835f-701f76407063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:01.174710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 860/1707] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:01.174710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b499278-a7c6-44f0-a250-0190b1a979d6 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:01.174710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3b499278-a7c6-44f0-a250-0190b1a979d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:01.228021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:01.316994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792f26f-4e07-47b5-835f-701f76407063 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:01.321460 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b499278-a7c6-44f0-a250-0190b1a979d6 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:01.336844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee311aa6-a73b-41c5-8ecf-1de14cee106e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:01.338314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879990c-ac01-4fa9-8e01-0813d41cd491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:01.339699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee311aa6-a73b-41c5-8ecf-1de14cee106e service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:01.339699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee311aa6-a73b-41c5-8ecf-1de14cee106e service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:01.339699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee311aa6-a73b-41c5-8ecf-1de14cee106e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:01.340143 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879990c-ac01-4fa9-8e01-0813d41cd491 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:01.340143 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879990c-ac01-4fa9-8e01-0813d41cd491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:01.340143 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879990c-ac01-4fa9-8e01-0813d41cd491 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:01.340376 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879990c-ac01-4fa9-8e01-0813d41cd491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:01.341905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879990c-ac01-4fa9-8e01-0813d41cd491 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:01.343674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ee311aa6-a73b-41c5-8ecf-1de14cee106e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:01.381486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 848/1708] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:01.382925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee311aa6-a73b-41c5-8ecf-1de14cee106e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:01.390529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d984d63-a33e-4ba7-9e52-6746db22e909 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:01.390816 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d984d63-a33e-4ba7-9e52-6746db22e909 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:01.391100 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d984d63-a33e-4ba7-9e52-6746db22e909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:01.391350 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee311aa6-a73b-41c5-8ecf-1de14cee106e service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:01.421012 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 861/1709] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:01.425852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f18a3-fb96-497a-9541-3c7972bfaea9 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:01.426051 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-4d984d63-a33e-4ba7-9e52-6746db22e909 None None] MFA Rules not processed for user `d8794e99a0024672974412ca4c045b63`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:01.426125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f18a3-fb96-497a-9541-3c7972bfaea9 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:01.426125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f18a3-fb96-497a-9541-3c7972bfaea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:01.427513 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-4d984d63-a33e-4ba7-9e52-6746db22e909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:01.435797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 849/1710] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 29 22:50:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:01.438049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96adc1-a67f-4524-ac75-8add4e6036ae None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:01.438441 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96adc1-a67f-4524-ac75-8add4e6036ae None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:01.438833 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96adc1-a67f-4524-ac75-8add4e6036ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:01.465606 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-8b96adc1-a67f-4524-ac75-8add4e6036ae None None] MFA Rules not processed for user `b7998943912747c6935db310ff1a4b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:01.467069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8b96adc1-a67f-4524-ac75-8add4e6036ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:01.485257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-059f18a3-fb96-497a-9541-3c7972bfaea9 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:01.487245 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-059f18a3-fb96-497a-9541-3c7972bfaea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:01.494861 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 850/1711] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:01.496810 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96adc1-a67f-4524-ac75-8add4e6036ae None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:01.527438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96adc1-a67f-4524-ac75-8add4e6036ae None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:01.542327 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4e2d1-50a8-4b13-b7b8-f264cab8588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:01.546910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4e2d1-50a8-4b13-b7b8-f264cab8588c admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:01.547204 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4e2d1-50a8-4b13-b7b8-f264cab8588c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:01.547486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4e2d1-50a8-4b13-b7b8-f264cab8588c admin admin] PATH_INFO: `/v3/projects/fc428a03548c4aff91d94206218f3a00/users/c804d695954e4580bbb73a93a95601b4/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:01.548170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 862/1712] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:01.549172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f18a3-fb96-497a-9541-3c7972bfaea9 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:01.550513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-059f18a3-fb96-497a-9541-3c7972bfaea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:01.590221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4e2d1-50a8-4b13-b7b8-f264cab8588c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc428a03548c4aff91d94206218f3a00, user_id=c804d695954e4580bbb73a93a95601b4, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:01.595030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4e2d1-50a8-4b13-b7b8-f264cab8588c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:01.692902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f18a3-fb96-497a-9541-3c7972bfaea9 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:01.697572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 851/1713] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:01 2022] PUT /identity/v3/projects/fc428a03548c4aff91d94206218f3a00/users/c804d695954e4580bbb73a93a95601b4/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:01.698195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4e2d1-50a8-4b13-b7b8-f264cab8588c admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:01.797496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc8998-9427-46ab-b2b8-599951c2f373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:01.798856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc8998-9427-46ab-b2b8-599951c2f373 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:01.799149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc8998-9427-46ab-b2b8-599951c2f373 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:01.799427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc8998-9427-46ab-b2b8-599951c2f373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:01.841575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4e2d1-50a8-4b13-b7b8-f264cab8588c admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:01.852216 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8cee5-ef66-44b2-b1ae-2cc8d6f8e3bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:01.852938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8cee5-ef66-44b2-b1ae-2cc8d6f8e3bf service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:01.853286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8cee5-ef66-44b2-b1ae-2cc8d6f8e3bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:01.853645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8cee5-ef66-44b2-b1ae-2cc8d6f8e3bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:01.871475 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8cee5-ef66-44b2-b1ae-2cc8d6f8e3bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:01.873307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8cee5-ef66-44b2-b1ae-2cc8d6f8e3bf service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:01.894044 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 852/1714] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:01.900664 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b03b4-63f2-421f-bd0d-677a46ce3b61 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:01.901017 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b03b4-63f2-421f-bd0d-677a46ce3b61 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:01.909547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b03b4-63f2-421f-bd0d-677a46ce3b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:01.948773 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-c26b03b4-63f2-421f-bd0d-677a46ce3b61 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:01.950130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-c26b03b4-63f2-421f-bd0d-677a46ce3b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:01.978460 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc8998-9427-46ab-b2b8-599951c2f373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:01.982577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc8998-9427-46ab-b2b8-599951c2f373 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:02.017886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 863/1715] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:02.018907 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc8998-9427-46ab-b2b8-599951c2f373 service nova] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:02.096145 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 853/1716] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:02.097259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b03b4-63f2-421f-bd0d-677a46ce3b61 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:02.112565 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b03b4-63f2-421f-bd0d-677a46ce3b61 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:02.113209 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc8998-9427-46ab-b2b8-599951c2f373 service nova] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:02.128847 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3fdd4-6fb4-43d3-ab27-67bbda338cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:02.128847 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3fdd4-6fb4-43d3-ab27-67bbda338cad admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:02.128847 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3fdd4-6fb4-43d3-ab27-67bbda338cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:02.128847 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3fdd4-6fb4-43d3-ab27-67bbda338cad admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:02.129117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ae544-4a33-4ee6-b5a6-8707036ed67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:02.129604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ae544-4a33-4ee6-b5a6-8707036ed67b admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:02.129891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ae544-4a33-4ee6-b5a6-8707036ed67b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:02.130168 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ae544-4a33-4ee6-b5a6-8707036ed67b admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:02.130612 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3fdd4-6fb4-43d3-ab27-67bbda338cad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:02.131060 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ae544-4a33-4ee6-b5a6-8707036ed67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:02.131283 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3fdd4-6fb4-43d3-ab27-67bbda338cad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:02.132964 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ae544-4a33-4ee6-b5a6-8707036ed67b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:02.135041 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3fdd4-6fb4-43d3-ab27-67bbda338cad admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:02.145482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 864/1717] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:02.160327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ae544-4a33-4ee6-b5a6-8707036ed67b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:02.168625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 854/1718] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:50:02.171606 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3fdd4-6fb4-43d3-ab27-67bbda338cad admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:02.172932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ae544-4a33-4ee6-b5a6-8707036ed67b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:02.178781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc083b8-dc27-4c1a-9c1c-7ba677f12097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:02.179557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc083b8-dc27-4c1a-9c1c-7ba677f12097 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:02.179896 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc083b8-dc27-4c1a-9c1c-7ba677f12097 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:02.180206 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc083b8-dc27-4c1a-9c1c-7ba677f12097 admin admin] PATH_INFO: `/v3/projects/fc428a03548c4aff91d94206218f3a00/users/c804d695954e4580bbb73a93a95601b4/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:02.182348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc083b8-dc27-4c1a-9c1c-7ba677f12097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc428a03548c4aff91d94206218f3a00, user_id=c804d695954e4580bbb73a93a95601b4, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:02.185606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc083b8-dc27-4c1a-9c1c-7ba677f12097 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:02.196578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3fdd4-6fb4-43d3-ab27-67bbda338cad admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:02.201125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 865/1719] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:02 2022] PUT /identity/v3/projects/fc428a03548c4aff91d94206218f3a00/users/c804d695954e4580bbb73a93a95601b4/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:50:02.213941 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a13bd-406e-42aa-9af1-a389c2c4e160 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:02.215323 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a13bd-406e-42aa-9af1-a389c2c4e160 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:02.215811 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a13bd-406e-42aa-9af1-a389c2c4e160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:02.267985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-728a13bd-406e-42aa-9af1-a389c2c4e160 None None] MFA Rules not processed for user `c804d695954e4580bbb73a93a95601b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:02.270255 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-728a13bd-406e-42aa-9af1-a389c2c4e160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:02.356774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bc982-7a01-46cc-a3ce-cbe3213357ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:02.358240 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bc982-7a01-46cc-a3ce-cbe3213357ec admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:02.360438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bc982-7a01-46cc-a3ce-cbe3213357ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:02.361282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bc982-7a01-46cc-a3ce-cbe3213357ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:02.362694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bc982-7a01-46cc-a3ce-cbe3213357ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:02.368314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bc982-7a01-46cc-a3ce-cbe3213357ec admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:02.440731 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 866/1720] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:02.454155 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a13bd-406e-42aa-9af1-a389c2c4e160 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:02.455793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-728a13bd-406e-42aa-9af1-a389c2c4e160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:02.534987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 855/1721] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:02 2022] POST /identity/v3/projects => generated 401 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:02.541714 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bc982-7a01-46cc-a3ce-cbe3213357ec admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:02.748646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a13bd-406e-42aa-9af1-a389c2c4e160 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:02.771341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bc982-7a01-46cc-a3ce-cbe3213357ec admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:02.795102 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1db97-7a4c-475c-a1fa-b905e4d4fab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:02.795570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1db97-7a4c-475c-a1fa-b905e4d4fab4 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:02.798512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1db97-7a4c-475c-a1fa-b905e4d4fab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:02.798512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1db97-7a4c-475c-a1fa-b905e4d4fab4 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:02.800991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1db97-7a4c-475c-a1fa-b905e4d4fab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:02.816384 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1db97-7a4c-475c-a1fa-b905e4d4fab4 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:02.832299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:02.963861 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9a67f-00d4-40d6-ab29-cf79748bb1bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:02.964545 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9a67f-00d4-40d6-ab29-cf79748bb1bd service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:02.964846 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9a67f-00d4-40d6-ab29-cf79748bb1bd service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:02.965124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9a67f-00d4-40d6-ab29-cf79748bb1bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:02.980145 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3dd9a67f-00d4-40d6-ab29-cf79748bb1bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:02.991573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 856/1722] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:02 2022] POST /identity/v3/users => generated 301 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:02.997959 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1db97-7a4c-475c-a1fa-b905e4d4fab4 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:03.018507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1db97-7a4c-475c-a1fa-b905e4d4fab4 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:03.031084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914955d-b594-479b-8460-aa38e063e7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:03.031820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914955d-b594-479b-8460-aa38e063e7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:03.032235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914955d-b594-479b-8460-aa38e063e7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:03.032622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914955d-b594-479b-8460-aa38e063e7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:03.033366 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914955d-b594-479b-8460-aa38e063e7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:03.038408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914955d-b594-479b-8460-aa38e063e7d6 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:03.066812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 857/1723] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:03.069267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914955d-b594-479b-8460-aa38e063e7d6 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:03.097376 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914955d-b594-479b-8460-aa38e063e7d6 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:03.109127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6e6b3-cedc-49b6-a46f-a311722c1da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:03.110441 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6e6b3-cedc-49b6-a46f-a311722c1da5 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:03.110774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6e6b3-cedc-49b6-a46f-a311722c1da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:03.111272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6e6b3-cedc-49b6-a46f-a311722c1da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:03.112184 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6e6b3-cedc-49b6-a46f-a311722c1da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:03.114083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6e6b3-cedc-49b6-a46f-a311722c1da5 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:03.127218 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 858/1724] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:03.131854 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6e6b3-cedc-49b6-a46f-a311722c1da5 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:03.144443 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6e6b3-cedc-49b6-a46f-a311722c1da5 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:03.151966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60161d95-70f9-4245-ae0d-28a48a9b1f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:03.153007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60161d95-70f9-4245-ae0d-28a48a9b1f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:03.153594 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60161d95-70f9-4245-ae0d-28a48a9b1f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:03.154065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60161d95-70f9-4245-ae0d-28a48a9b1f9b admin admin] PATH_INFO: `/v3/projects/b5d79ff845b1433c86a40cdcc58d1413/users/d655a66c820e4ebba21ff50ce936f5fd/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:03.182208 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60161d95-70f9-4245-ae0d-28a48a9b1f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d79ff845b1433c86a40cdcc58d1413, user_id=d655a66c820e4ebba21ff50ce936f5fd, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:03.187608 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60161d95-70f9-4245-ae0d-28a48a9b1f9b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:03.204747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9a67f-00d4-40d6-ab29-cf79748bb1bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:03.204747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9a67f-00d4-40d6-ab29-cf79748bb1bd service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:03.217061 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 867/1725] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 764 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:03.323218 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 859/1726] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:03 2022] PUT /identity/v3/projects/b5d79ff845b1433c86a40cdcc58d1413/users/d655a66c820e4ebba21ff50ce936f5fd/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:03.340972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05a93-2cd4-4794-8c34-2dbf11bcdcd7 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:03.341322 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05a93-2cd4-4794-8c34-2dbf11bcdcd7 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:03.341660 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05a93-2cd4-4794-8c34-2dbf11bcdcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:03.454166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-98d05a93-2cd4-4794-8c34-2dbf11bcdcd7 None None] MFA Rules not processed for user `d655a66c820e4ebba21ff50ce936f5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:03.462532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-98d05a93-2cd4-4794-8c34-2dbf11bcdcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:03.581694 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 868/1727] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:03 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:03.586431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60161d95-70f9-4245-ae0d-28a48a9b1f9b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:03.703159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60161d95-70f9-4245-ae0d-28a48a9b1f9b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:03.715490 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aacb3-84fc-4bcd-ad4c-02bcfffdb0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:03.724272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aacb3-84fc-4bcd-ad4c-02bcfffdb0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:03.724637 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aacb3-84fc-4bcd-ad4c-02bcfffdb0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:03.725099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aacb3-84fc-4bcd-ad4c-02bcfffdb0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:03.729410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aacb3-84fc-4bcd-ad4c-02bcfffdb0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:03.738088 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aacb3-84fc-4bcd-ad4c-02bcfffdb0c1 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:03.956207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 860/1728] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:03 2022] POST /identity/v3/projects => generated 401 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:50:03.957225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d05a93-2cd4-4794-8c34-2dbf11bcdcd7 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:03.971571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d05a93-2cd4-4794-8c34-2dbf11bcdcd7 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:04.177400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdb4e2-ca48-40f4-850e-1b4408ad7894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:04.184075 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdb4e2-ca48-40f4-850e-1b4408ad7894 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:04.184677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdb4e2-ca48-40f4-850e-1b4408ad7894 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:04.185148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdb4e2-ca48-40f4-850e-1b4408ad7894 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:04.186035 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdb4e2-ca48-40f4-850e-1b4408ad7894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:04.191303 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdb4e2-ca48-40f4-850e-1b4408ad7894 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:04.311241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 869/1729] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:03 2022] POST /identity/v3/users => generated 307 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:04.315044 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aacb3-84fc-4bcd-ad4c-02bcfffdb0c1 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:04.334401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aacb3-84fc-4bcd-ad4c-02bcfffdb0c1 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:04.363570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee545a-f5f1-49e7-bef3-fcc716e3317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:04.364355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee545a-f5f1-49e7-bef3-fcc716e3317f admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:04.364885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee545a-f5f1-49e7-bef3-fcc716e3317f admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:04.365691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee545a-f5f1-49e7-bef3-fcc716e3317f admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:04.366553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee545a-f5f1-49e7-bef3-fcc716e3317f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:04.370037 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee545a-f5f1-49e7-bef3-fcc716e3317f admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:04.404887 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 861/1730] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:04.407627 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdb4e2-ca48-40f4-850e-1b4408ad7894 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:04.424893 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdb4e2-ca48-40f4-850e-1b4408ad7894 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:04.436944 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f040cf1-7e92-4247-a0cf-4f51837d5e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:04.439052 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f040cf1-7e92-4247-a0cf-4f51837d5e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:04.439348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f040cf1-7e92-4247-a0cf-4f51837d5e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:04.439633 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f040cf1-7e92-4247-a0cf-4f51837d5e79 admin admin] PATH_INFO: `/v3/projects/478b9d7f8ff04947931f7ca9525c888d/users/97bc6cb039574a709888d235bef659ce/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:04.485079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f040cf1-7e92-4247-a0cf-4f51837d5e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=478b9d7f8ff04947931f7ca9525c888d, user_id=97bc6cb039574a709888d235bef659ce, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:04.490768 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f040cf1-7e92-4247-a0cf-4f51837d5e79 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:04.610815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 870/1731] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:04 2022] PUT /identity/v3/projects/478b9d7f8ff04947931f7ca9525c888d/users/97bc6cb039574a709888d235bef659ce/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:04.612409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee545a-f5f1-49e7-bef3-fcc716e3317f admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:04.631052 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:04.642438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee545a-f5f1-49e7-bef3-fcc716e3317f admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:04.654009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e989e53-5b3c-4fb7-8914-533b6d04dc95 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:04.654302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e989e53-5b3c-4fb7-8914-533b6d04dc95 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:04.654579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e989e53-5b3c-4fb7-8914-533b6d04dc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:04.693196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-0e989e53-5b3c-4fb7-8914-533b6d04dc95 None None] MFA Rules not processed for user `bd130bf777664a62ab043200c84ac8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:04.694681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0e989e53-5b3c-4fb7-8914-533b6d04dc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:04.796207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ef8e4-9d7c-44df-82bb-5743df0a636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:04.798033 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef8e4-9d7c-44df-82bb-5743df0a636e admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:04.798429 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef8e4-9d7c-44df-82bb-5743df0a636e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:04.799309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef8e4-9d7c-44df-82bb-5743df0a636e admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:04.800569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ef8e4-9d7c-44df-82bb-5743df0a636e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:04.802334 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ef8e4-9d7c-44df-82bb-5743df0a636e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:04.826931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 862/1732] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:04.828648 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ef8e4-9d7c-44df-82bb-5743df0a636e admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:04.830449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 871/1733] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:04.841404 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ef8e4-9d7c-44df-82bb-5743df0a636e admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:04.847358 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f9ca1-201b-4280-929d-06b4f0df61f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:04.848212 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f9ca1-201b-4280-929d-06b4f0df61f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:04.848492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f9ca1-201b-4280-929d-06b4f0df61f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:04.848765 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f9ca1-201b-4280-929d-06b4f0df61f0 admin admin] PATH_INFO: `/v3/projects/478b9d7f8ff04947931f7ca9525c888d/users/97bc6cb039574a709888d235bef659ce/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:04.853994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f9ca1-201b-4280-929d-06b4f0df61f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=478b9d7f8ff04947931f7ca9525c888d, user_id=97bc6cb039574a709888d235bef659ce, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:04.856926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f9ca1-201b-4280-929d-06b4f0df61f0 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:04.894216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fcce8-0dc0-4022-938e-e5826973c554 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:04.894216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fcce8-0dc0-4022-938e-e5826973c554 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:04.894216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fcce8-0dc0-4022-938e-e5826973c554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:04.894807 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 863/1734] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:04 2022] PUT /identity/v3/projects/478b9d7f8ff04947931f7ca9525c888d/users/97bc6cb039574a709888d235bef659ce/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:04.933527 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af62b5-fb0f-47ab-81cb-dc552e120d66 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:04.933810 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af62b5-fb0f-47ab-81cb-dc552e120d66 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:04.938410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af62b5-fb0f-47ab-81cb-dc552e120d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:04.984963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ec0fcce8-0dc0-4022-938e-e5826973c554 None None] MFA Rules not processed for user `97bc6cb039574a709888d235bef659ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:04.992105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ec0fcce8-0dc0-4022-938e-e5826973c554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:05.097895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d4af62b5-fb0f-47ab-81cb-dc552e120d66 None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:05.111994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d4af62b5-fb0f-47ab-81cb-dc552e120d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:05.183286 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 872/1735] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:04 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:05.195706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fcce8-0dc0-4022-938e-e5826973c554 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:05.341823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fcce8-0dc0-4022-938e-e5826973c554 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:05.343047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 864/1736] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 29 22:50:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:05.359993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03298878-9af0-4108-898c-8ae74b859f8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:05.371003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03298878-9af0-4108-898c-8ae74b859f8c service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:05.380606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03298878-9af0-4108-898c-8ae74b859f8c service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:05.381126 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03298878-9af0-4108-898c-8ae74b859f8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:05.399818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a50eda-0f8e-4b6b-b5af-ea4e973f66fc None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:05.400268 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a50eda-0f8e-4b6b-b5af-ea4e973f66fc None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:05.400626 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a50eda-0f8e-4b6b-b5af-ea4e973f66fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:05.420586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03298878-9af0-4108-898c-8ae74b859f8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:05.432442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03298878-9af0-4108-898c-8ae74b859f8c service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:05.480389 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 873/1737] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:05 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:50:05.484294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-58a50eda-0f8e-4b6b-b5af-ea4e973f66fc None None] MFA Rules not processed for user `cca8f52c214846549147899d11636eff`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:05.486146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-58a50eda-0f8e-4b6b-b5af-ea4e973f66fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:05.674628 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03298878-9af0-4108-898c-8ae74b859f8c service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:05.676080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-03298878-9af0-4108-898c-8ae74b859f8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:05.678478 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 865/1738] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:05 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:05.859679 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03298878-9af0-4108-898c-8ae74b859f8c service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:05.865920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7199bd-f1bb-4012-a9c6-3a1dda4559f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:05.866918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7199bd-f1bb-4012-a9c6-3a1dda4559f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:05.867399 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7199bd-f1bb-4012-a9c6-3a1dda4559f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:05.867871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7199bd-f1bb-4012-a9c6-3a1dda4559f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:05.868859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7199bd-f1bb-4012-a9c6-3a1dda4559f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:05.871409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7199bd-f1bb-4012-a9c6-3a1dda4559f2 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:05.938037 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a50eda-0f8e-4b6b-b5af-ea4e973f66fc None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:05.949946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a50eda-0f8e-4b6b-b5af-ea4e973f66fc None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:05.957595 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d79f5-9e75-462b-b28b-48a99e4c2dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:05.958390 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d79f5-9e75-462b-b28b-48a99e4c2dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:05.959524 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d79f5-9e75-462b-b28b-48a99e4c2dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:05.962358 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d79f5-9e75-462b-b28b-48a99e4c2dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:06.029871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 874/1739] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:05 2022] POST /identity/v3/projects => generated 405 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:06.031412 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7199bd-f1bb-4012-a9c6-3a1dda4559f2 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:06.035660 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-fc7199bd-f1bb-4012-a9c6-3a1dda4559f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:06.082123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:06.169275 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d79f5-9e75-462b-b28b-48a99e4c2dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:06.171688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d79f5-9e75-462b-b28b-48a99e4c2dc4 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:06.197332 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 866/1740] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:06.200034 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d79f5-9e75-462b-b28b-48a99e4c2dc4 service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:06.222658 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d79f5-9e75-462b-b28b-48a99e4c2dc4 service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:06.400810 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7199bd-f1bb-4012-a9c6-3a1dda4559f2 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:06.420122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccaa7a-6cf4-45ef-9ac3-6f443c012db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:06.421489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ec1a9-f91e-40e1-bd08-93d043de7068 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:06.421716 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccaa7a-6cf4-45ef-9ac3-6f443c012db4 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:06.422218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ec1a9-f91e-40e1-bd08-93d043de7068 service swift] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:06.423971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ec1a9-f91e-40e1-bd08-93d043de7068 service swift] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:06.423971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ec1a9-f91e-40e1-bd08-93d043de7068 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:06.424288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccaa7a-6cf4-45ef-9ac3-6f443c012db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:06.424817 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccaa7a-6cf4-45ef-9ac3-6f443c012db4 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:06.425922 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccaa7a-6cf4-45ef-9ac3-6f443c012db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:06.431503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccaa7a-6cf4-45ef-9ac3-6f443c012db4 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:06.448676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:06.554478 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 867/1741] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:06 2022] POST /identity/v3/users => generated 309 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:06.555488 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccaa7a-6cf4-45ef-9ac3-6f443c012db4 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:06.615243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ec1a9-f91e-40e1-bd08-93d043de7068 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:06.621747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ec1a9-f91e-40e1-bd08-93d043de7068 service swift] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:06.681139 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 875/1742] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:50:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:50:06.683641 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ec1a9-f91e-40e1-bd08-93d043de7068 service swift] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:06.742742 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ec1a9-f91e-40e1-bd08-93d043de7068 service swift] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:06.758329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f17eb3-5a62-4f22-a403-bb8b7f654c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:06.761951 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f17eb3-5a62-4f22-a403-bb8b7f654c2f admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:06.762622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f17eb3-5a62-4f22-a403-bb8b7f654c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:06.763062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f17eb3-5a62-4f22-a403-bb8b7f654c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:06.768761 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f17eb3-5a62-4f22-a403-bb8b7f654c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:06.773524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f17eb3-5a62-4f22-a403-bb8b7f654c2f admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:06.792853 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccaa7a-6cf4-45ef-9ac3-6f443c012db4 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:06.810426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214ef91-bfb6-4451-8745-2678ea4a9f51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:06.811583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214ef91-bfb6-4451-8745-2678ea4a9f51 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:06.816738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214ef91-bfb6-4451-8745-2678ea4a9f51 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:06.817332 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214ef91-bfb6-4451-8745-2678ea4a9f51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:06.826430 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 876/1743] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:06.836661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f17eb3-5a62-4f22-a403-bb8b7f654c2f admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:06.894005 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f17eb3-5a62-4f22-a403-bb8b7f654c2f admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:06.901491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fce2e-cfbb-4c8d-abe4-cf72c0b16459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:06.905079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fce2e-cfbb-4c8d-abe4-cf72c0b16459 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:06.907043 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fce2e-cfbb-4c8d-abe4-cf72c0b16459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:06.908272 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fce2e-cfbb-4c8d-abe4-cf72c0b16459 admin admin] PATH_INFO: `/v3/projects/21a3894774a4496d8bb186985f6d0df8/users/1a3312f0b58241c981b0d8f979450313/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:06.968412 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fce2e-cfbb-4c8d-abe4-cf72c0b16459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a3894774a4496d8bb186985f6d0df8, user_id=1a3312f0b58241c981b0d8f979450313, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:06.971385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fce2e-cfbb-4c8d-abe4-cf72c0b16459 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:07.054130 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 877/1744] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:06 2022] PUT /identity/v3/projects/21a3894774a4496d8bb186985f6d0df8/users/1a3312f0b58241c981b0d8f979450313/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:07.055544 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fce2e-cfbb-4c8d-abe4-cf72c0b16459 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:07.101787 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214ef91-bfb6-4451-8745-2678ea4a9f51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:07.112329 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214ef91-bfb6-4451-8745-2678ea4a9f51 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:07.180929 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 868/1745] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:06 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:07.401383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016623d-2f5c-46e2-acf8-6db7b2d31e78 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:07.402008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016623d-2f5c-46e2-acf8-6db7b2d31e78 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:07.402418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016623d-2f5c-46e2-acf8-6db7b2d31e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:07.437404 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fce2e-cfbb-4c8d-abe4-cf72c0b16459 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:07.475452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc8a34-2e02-469e-8590-a448fb414212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:07.477175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-a016623d-2f5c-46e2-acf8-6db7b2d31e78 None None] MFA Rules not processed for user `d8794e99a0024672974412ca4c045b63`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:07.478460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a016623d-2f5c-46e2-acf8-6db7b2d31e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:07.486166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc8a34-2e02-469e-8590-a448fb414212 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:07.490014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc8a34-2e02-469e-8590-a448fb414212 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:07.490398 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc8a34-2e02-469e-8590-a448fb414212 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:07.491795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc8a34-2e02-469e-8590-a448fb414212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:07.493490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc8a34-2e02-469e-8590-a448fb414212 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:07.549252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 878/1746] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:50:07.553945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc8a34-2e02-469e-8590-a448fb414212 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:07.601547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc8a34-2e02-469e-8590-a448fb414212 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:07.608836 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 869/1747] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Aug 29 22:50:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:07.638481 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bee386-6109-4c0f-bdc4-895bd8585258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:07.639171 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bee386-6109-4c0f-bdc4-895bd8585258 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:07.644914 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bee386-6109-4c0f-bdc4-895bd8585258 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:07.645267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bee386-6109-4c0f-bdc4-895bd8585258 admin admin] PATH_INFO: `/v3/projects/21a3894774a4496d8bb186985f6d0df8/users/1a3312f0b58241c981b0d8f979450313/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:07.649079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bee386-6109-4c0f-bdc4-895bd8585258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a3894774a4496d8bb186985f6d0df8, user_id=1a3312f0b58241c981b0d8f979450313, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:07.663508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bee386-6109-4c0f-bdc4-895bd8585258 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:07.715571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 879/1748] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:07 2022] PUT /identity/v3/projects/21a3894774a4496d8bb186985f6d0df8/users/1a3312f0b58241c981b0d8f979450313/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:07.808396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:07.873454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016623d-2f5c-46e2-acf8-6db7b2d31e78 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:07.876208 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a016623d-2f5c-46e2-acf8-6db7b2d31e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:07.908401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016623d-2f5c-46e2-acf8-6db7b2d31e78 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:08.147448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca0c1d-0794-4915-9aa3-cf3e17af9475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:08.150017 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca0c1d-0794-4915-9aa3-cf3e17af9475 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:08.150386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca0c1d-0794-4915-9aa3-cf3e17af9475 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:08.151339 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca0c1d-0794-4915-9aa3-cf3e17af9475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:08.173877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca0c1d-0794-4915-9aa3-cf3e17af9475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:08.178684 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca0c1d-0794-4915-9aa3-cf3e17af9475 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:08.200204 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 870/1749] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:08.277347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:08.641024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1684b4-c385-45ea-b508-aaa91f804468 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:08.643906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1684b4-c385-45ea-b508-aaa91f804468 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:08.644466 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1684b4-c385-45ea-b508-aaa91f804468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:08.687847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-1f1684b4-c385-45ea-b508-aaa91f804468 None None] MFA Rules not processed for user `702f1e3b8d0342fc999f63d701bc4772`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:08.690209 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-1f1684b4-c385-45ea-b508-aaa91f804468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:08.873410 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 880/1750] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:09.984875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:10.134580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:10.936639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:11.442475 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:11.548257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca0c1d-0794-4915-9aa3-cf3e17af9475 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:11.735535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca0c1d-0794-4915-9aa3-cf3e17af9475 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:11.754961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bcb72-a8e3-4afd-a1e6-75b9d2f3dad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:11.755824 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bcb72-a8e3-4afd-a1e6-75b9d2f3dad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:11.756140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bcb72-a8e3-4afd-a1e6-75b9d2f3dad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:11.756425 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bcb72-a8e3-4afd-a1e6-75b9d2f3dad8 admin admin] PATH_INFO: `/v3/users/59bdd9dab0c34b9ba99e9de4c015998b` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:11.759583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bcb72-a8e3-4afd-a1e6-75b9d2f3dad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59bdd9dab0c34b9ba99e9de4c015998b)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:11.762004 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bcb72-a8e3-4afd-a1e6-75b9d2f3dad8 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:12.020732 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-962bcb72-a8e3-4afd-a1e6-75b9d2f3dad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59bdd9dab0c34b9ba99e9de4c015998b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:12.055506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-962bcb72-a8e3-4afd-a1e6-75b9d2f3dad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59bdd9dab0c34b9ba99e9de4c015998b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:12.158917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-962bcb72-a8e3-4afd-a1e6-75b9d2f3dad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59bdd9dab0c34b9ba99e9de4c015998b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:12.162600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-962bcb72-a8e3-4afd-a1e6-75b9d2f3dad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59bdd9dab0c34b9ba99e9de4c015998b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:12.163601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-962bcb72-a8e3-4afd-a1e6-75b9d2f3dad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59bdd9dab0c34b9ba99e9de4c015998b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:12.234464 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 871/1751] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:11 2022] DELETE /identity/v3/users/59bdd9dab0c34b9ba99e9de4c015998b => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:12.239275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd719c2b-8ed3-42e5-a44d-54f390f1990e None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:12.239749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd719c2b-8ed3-42e5-a44d-54f390f1990e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:12.239749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd719c2b-8ed3-42e5-a44d-54f390f1990e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:12.283592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-cd719c2b-8ed3-42e5-a44d-54f390f1990e None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:12.285190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-cd719c2b-8ed3-42e5-a44d-54f390f1990e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:12.485960 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:12.521374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 881/1752] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:12.666822 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bcb72-a8e3-4afd-a1e6-75b9d2f3dad8 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:12.671258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-962bcb72-a8e3-4afd-a1e6-75b9d2f3dad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:12.844397 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bcb72-a8e3-4afd-a1e6-75b9d2f3dad8 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:12.851183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f0689-8c73-42b1-babd-93c4962bdc90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:12.852374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f0689-8c73-42b1-babd-93c4962bdc90 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:12.852886 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f0689-8c73-42b1-babd-93c4962bdc90 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:12.853396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f0689-8c73-42b1-babd-93c4962bdc90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:12.868830 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f0689-8c73-42b1-babd-93c4962bdc90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:12.870432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f0689-8c73-42b1-babd-93c4962bdc90 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:12.886454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 872/1753] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:12.969898 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:13.225730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dce34-66cb-4186-9825-06c9c58037a3 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:13.226023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dce34-66cb-4186-9825-06c9c58037a3 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:13.226495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dce34-66cb-4186-9825-06c9c58037a3 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:13.228080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 882/1754] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 29 22:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:13.335069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b08ce-ec23-4f75-bdef-1da81e02ad46 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:13.335069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b08ce-ec23-4f75-bdef-1da81e02ad46 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:13.335069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b08ce-ec23-4f75-bdef-1da81e02ad46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:13.398262 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-067b08ce-ec23-4f75-bdef-1da81e02ad46 None None] MFA Rules not processed for user `f06d910badb84c6aa6b48f3b56b91f82`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:13.398262 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-067b08ce-ec23-4f75-bdef-1da81e02ad46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:13.411085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc6095-468e-4034-bd70-d24455c28d03 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:13.411646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc6095-468e-4034-bd70-d24455c28d03 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:13.411646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc6095-468e-4034-bd70-d24455c28d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:13.517594 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-96cc6095-468e-4034-bd70-d24455c28d03 None None] MFA Rules not processed for user `1a3312f0b58241c981b0d8f979450313`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:13.518835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-96cc6095-468e-4034-bd70-d24455c28d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:13.609232 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:13.652004 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 873/1755] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 29 22:50:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:13.734798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 883/1756] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:13 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:13.824928 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:13.878517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b08ce-ec23-4f75-bdef-1da81e02ad46 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:13.881360 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-067b08ce-ec23-4f75-bdef-1da81e02ad46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:13.922958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b08ce-ec23-4f75-bdef-1da81e02ad46 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:13.946193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d798f83-1378-4f0e-a23a-68607c283f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:13.948147 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d798f83-1378-4f0e-a23a-68607c283f59 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:13.951228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d798f83-1378-4f0e-a23a-68607c283f59 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:13.952965 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d798f83-1378-4f0e-a23a-68607c283f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:13.986370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d798f83-1378-4f0e-a23a-68607c283f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:13.992321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d798f83-1378-4f0e-a23a-68607c283f59 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:14.029744 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 874/1757] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:14.670994 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc6095-468e-4034-bd70-d24455c28d03 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:14.672484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-96cc6095-468e-4034-bd70-d24455c28d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:14.698198 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc6095-468e-4034-bd70-d24455c28d03 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:14.707966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672b9c7-ca94-4748-bc46-3bf2d1627de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:14.708966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b9c7-ca94-4748-bc46-3bf2d1627de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:14.709264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b9c7-ca94-4748-bc46-3bf2d1627de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:14.709948 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b9c7-ca94-4748-bc46-3bf2d1627de8 admin admin] PATH_INFO: `/v3/users/d655a66c820e4ebba21ff50ce936f5fd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:14.720076 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672b9c7-ca94-4748-bc46-3bf2d1627de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d655a66c820e4ebba21ff50ce936f5fd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:14.724443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672b9c7-ca94-4748-bc46-3bf2d1627de8 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:15.047847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9672b9c7-ca94-4748-bc46-3bf2d1627de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd655a66c820e4ebba21ff50ce936f5fd'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:15.049300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9672b9c7-ca94-4748-bc46-3bf2d1627de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd655a66c820e4ebba21ff50ce936f5fd'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:15.156874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9672b9c7-ca94-4748-bc46-3bf2d1627de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd655a66c820e4ebba21ff50ce936f5fd'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:15.157522 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9672b9c7-ca94-4748-bc46-3bf2d1627de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd655a66c820e4ebba21ff50ce936f5fd'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:15.175137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9672b9c7-ca94-4748-bc46-3bf2d1627de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd655a66c820e4ebba21ff50ce936f5fd'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:15.194658 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 884/1758] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:14 2022] DELETE /identity/v3/users/d655a66c820e4ebba21ff50ce936f5fd => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:15.195959 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fac0a-86c0-4ba9-8783-bff56d1d263c None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:15.196587 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fac0a-86c0-4ba9-8783-bff56d1d263c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:15.196587 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fac0a-86c0-4ba9-8783-bff56d1d263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:15.227535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-564fac0a-86c0-4ba9-8783-bff56d1d263c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:15.229785 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-564fac0a-86c0-4ba9-8783-bff56d1d263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:15.377007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 875/1759] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:15.385453 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:15.459120 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672b9c7-ca94-4748-bc46-3bf2d1627de8 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:15.460997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9672b9c7-ca94-4748-bc46-3bf2d1627de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:15.637113 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672b9c7-ca94-4748-bc46-3bf2d1627de8 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:15.637113 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e117e4-4013-432b-84af-e9f0dee61c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:15.637113 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e117e4-4013-432b-84af-e9f0dee61c4d service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:15.637113 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e117e4-4013-432b-84af-e9f0dee61c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:15.637680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e117e4-4013-432b-84af-e9f0dee61c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:15.654144 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e117e4-4013-432b-84af-e9f0dee61c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:15.657785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e117e4-4013-432b-84af-e9f0dee61c4d service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:15.674147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 885/1760] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:16.391244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf371a9-844c-4216-a605-3d15a5f52e02 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:16.391244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf371a9-844c-4216-a605-3d15a5f52e02 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:16.391244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf371a9-844c-4216-a605-3d15a5f52e02 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:16.391244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 876/1761] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 29 22:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:16.448489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e56ba2-1004-429e-a43d-3c55b7350999 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:16.448489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e56ba2-1004-429e-a43d-3c55b7350999 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:16.448489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e56ba2-1004-429e-a43d-3c55b7350999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:16.478151 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-54e56ba2-1004-429e-a43d-3c55b7350999 None None] MFA Rules not processed for user `f06d910badb84c6aa6b48f3b56b91f82`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:16.480934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-54e56ba2-1004-429e-a43d-3c55b7350999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:16.605042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3a649-d8a7-4c3d-b3cb-9564a63e82f4 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:16.605686 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3a649-d8a7-4c3d-b3cb-9564a63e82f4 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:16.606178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3a649-d8a7-4c3d-b3cb-9564a63e82f4 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:16.608846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 877/1762] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 29 22:50:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:16.628595 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3a649-d8a7-4c3d-b3cb-9564a63e82f4 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:16.631759 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-37f3a649-d8a7-4c3d-b3cb-9564a63e82f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:16.670514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3a649-d8a7-4c3d-b3cb-9564a63e82f4 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:16.683659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1361a-5132-47c9-bec7-c22b18d5228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:16.685478 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1361a-5132-47c9-bec7-c22b18d5228e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:16.686098 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1361a-5132-47c9-bec7-c22b18d5228e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:16.686569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1361a-5132-47c9-bec7-c22b18d5228e admin admin] PATH_INFO: `/v3/projects/987947b29de3484087706ccdf759150b` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:16.688253 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1361a-5132-47c9-bec7-c22b18d5228e admin admin] RBAC: Authorizing `identity:delete_project(project_id=987947b29de3484087706ccdf759150b)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:16.707058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1361a-5132-47c9-bec7-c22b18d5228e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:16.725771 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 886/1763] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 29 22:50:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:16.843511 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0efb3-29ff-4ed0-b576-49f9458a74a7 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:16.843838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0efb3-29ff-4ed0-b576-49f9458a74a7 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:16.844365 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0efb3-29ff-4ed0-b576-49f9458a74a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:16.873945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-bbc0efb3-29ff-4ed0-b576-49f9458a74a7 None None] MFA Rules not processed for user `2991c613878e4993901199434f384f49`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:16.873945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-bbc0efb3-29ff-4ed0-b576-49f9458a74a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:16.881322 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:16.947240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 887/1764] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 29 22:50:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:16.968879 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-68b1361a-5132-47c9-bec7-c22b18d5228e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987947b29de3484087706ccdf759150b', 'request_id': 'req-68b1361a-5132-47c9-bec7-c22b18d5228e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:17.043417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-68b1361a-5132-47c9-bec7-c22b18d5228e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987947b29de3484087706ccdf759150b', 'request_id': 'req-68b1361a-5132-47c9-bec7-c22b18d5228e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:17.052639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-68b1361a-5132-47c9-bec7-c22b18d5228e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987947b29de3484087706ccdf759150b', 'request_id': 'req-68b1361a-5132-47c9-bec7-c22b18d5228e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:17.067487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc049a-d9bf-4dc4-a5e2-e2603f35db60 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:17.067794 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc049a-d9bf-4dc4-a5e2-e2603f35db60 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:17.068081 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc049a-d9bf-4dc4-a5e2-e2603f35db60 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:17.071071 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 888/1765] 10.222.0.62 () {54 vars in 961 bytes} [Mon Aug 29 22:50:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:17.078092 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6dbe1-a16d-437b-bf3c-633548c2333f None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:17.080409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6dbe1-a16d-437b-bf3c-633548c2333f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:17.080409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6dbe1-a16d-437b-bf3c-633548c2333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:17.121318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-a1e6dbe1-a16d-437b-bf3c-633548c2333f None None] MFA Rules not processed for user `2991c613878e4993901199434f384f49`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:17.126365 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a1e6dbe1-a16d-437b-bf3c-633548c2333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:17.128064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-68b1361a-5132-47c9-bec7-c22b18d5228e admin admin] The token cache is being invalidate because project 987947b29de3484087706ccdf759150b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:17.128555 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-68b1361a-5132-47c9-bec7-c22b18d5228e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:17.134550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-68b1361a-5132-47c9-bec7-c22b18d5228e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:17.149298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 878/1766] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:16 2022] DELETE /identity/v3/projects/987947b29de3484087706ccdf759150b => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:50:17.153325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1361a-5132-47c9-bec7-c22b18d5228e admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:17.174492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-68b1361a-5132-47c9-bec7-c22b18d5228e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:17.285962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 889/1767] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Aug 29 22:50:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:17.287604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6dbe1-a16d-437b-bf3c-633548c2333f None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:17.292471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a1e6dbe1-a16d-437b-bf3c-633548c2333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:17.313180 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:17.329808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1361a-5132-47c9-bec7-c22b18d5228e admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:17.346463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f04a92-0c0d-4929-894e-6e0609fa093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:17.347271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f04a92-0c0d-4929-894e-6e0609fa093d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:17.347627 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f04a92-0c0d-4929-894e-6e0609fa093d admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:17.348038 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f04a92-0c0d-4929-894e-6e0609fa093d admin admin] PATH_INFO: `/v3/users/c804d695954e4580bbb73a93a95601b4` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:17.350446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f04a92-0c0d-4929-894e-6e0609fa093d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c804d695954e4580bbb73a93a95601b4)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:17.356222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f04a92-0c0d-4929-894e-6e0609fa093d admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:17.489036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6dbe1-a16d-437b-bf3c-633548c2333f None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:17.497553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a47ced-c9da-4753-b3ab-97a67c1b3343 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:17.499036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a47ced-c9da-4753-b3ab-97a67c1b3343 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:17.504007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a47ced-c9da-4753-b3ab-97a67c1b3343 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:17.504007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a47ced-c9da-4753-b3ab-97a67c1b3343 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:17.504007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b2a47ced-c9da-4753-b3ab-97a67c1b3343 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:17.525517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a47ced-c9da-4753-b3ab-97a67c1b3343 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:17.532878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a47ced-c9da-4753-b3ab-97a67c1b3343 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:17.547561 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 890/1768] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:17.548842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a47ced-c9da-4753-b3ab-97a67c1b3343 service nova] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:17.576037 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a47ced-c9da-4753-b3ab-97a67c1b3343 service nova] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:17.583703 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61c4cf-964c-40ff-afce-6bb0508828b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2991c613878e4993901199434f384f49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:17.585086 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61c4cf-964c-40ff-afce-6bb0508828b6 service placement] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:17.585475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61c4cf-964c-40ff-afce-6bb0508828b6 service placement] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:17.585754 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61c4cf-964c-40ff-afce-6bb0508828b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:17.588704 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2b61c4cf-964c-40ff-afce-6bb0508828b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:17.603367 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61c4cf-964c-40ff-afce-6bb0508828b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:17.619138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61c4cf-964c-40ff-afce-6bb0508828b6 service placement] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:17.650096 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 891/1769] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:17.697391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d1f04a92-0c0d-4929-894e-6e0609fa093d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c804d695954e4580bbb73a93a95601b4'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:17.729402 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d1f04a92-0c0d-4929-894e-6e0609fa093d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c804d695954e4580bbb73a93a95601b4'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:17.845375 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d1f04a92-0c0d-4929-894e-6e0609fa093d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c804d695954e4580bbb73a93a95601b4'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:17.846386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d1f04a92-0c0d-4929-894e-6e0609fa093d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c804d695954e4580bbb73a93a95601b4'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:17.847196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d1f04a92-0c0d-4929-894e-6e0609fa093d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c804d695954e4580bbb73a93a95601b4'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:17.877341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 879/1770] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:17 2022] DELETE /identity/v3/users/c804d695954e4580bbb73a93a95601b4 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:18.533951 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61c4cf-964c-40ff-afce-6bb0508828b6 service placement] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:18.541639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2b61c4cf-964c-40ff-afce-6bb0508828b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:18.643426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61c4cf-964c-40ff-afce-6bb0508828b6 service placement] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:18.679252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:18.768242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c872601-779d-4c70-8dd3-b16483279b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:18.769095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c872601-779d-4c70-8dd3-b16483279b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:18.769406 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c872601-779d-4c70-8dd3-b16483279b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:18.769661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c872601-779d-4c70-8dd3-b16483279b42 admin admin] PATH_INFO: `/v3/projects/b5d79ff845b1433c86a40cdcc58d1413` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:18.771878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c872601-779d-4c70-8dd3-b16483279b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d79ff845b1433c86a40cdcc58d1413)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:18.774801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c872601-779d-4c70-8dd3-b16483279b42 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:18.957047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8c872601-779d-4c70-8dd3-b16483279b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d79ff845b1433c86a40cdcc58d1413', 'request_id': 'req-8c872601-779d-4c70-8dd3-b16483279b42'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:18.971862 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8c872601-779d-4c70-8dd3-b16483279b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d79ff845b1433c86a40cdcc58d1413', 'request_id': 'req-8c872601-779d-4c70-8dd3-b16483279b42'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:19.047615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8c872601-779d-4c70-8dd3-b16483279b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d79ff845b1433c86a40cdcc58d1413', 'request_id': 'req-8c872601-779d-4c70-8dd3-b16483279b42'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:19.090372 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8c872601-779d-4c70-8dd3-b16483279b42 admin admin] The token cache is being invalidate because project b5d79ff845b1433c86a40cdcc58d1413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:19.091570 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8c872601-779d-4c70-8dd3-b16483279b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:19.105953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8c872601-779d-4c70-8dd3-b16483279b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:19.113629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 892/1771] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:18 2022] DELETE /identity/v3/projects/b5d79ff845b1433c86a40cdcc58d1413 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:19.115142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f04a92-0c0d-4929-894e-6e0609fa093d admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:19.117548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d1f04a92-0c0d-4929-894e-6e0609fa093d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:19.132645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f04a92-0c0d-4929-894e-6e0609fa093d admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:19.218966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90519e47-2cb3-4dea-9df9-4122879bbe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:19.220011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90519e47-2cb3-4dea-9df9-4122879bbe2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:19.220474 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90519e47-2cb3-4dea-9df9-4122879bbe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:19.220894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90519e47-2cb3-4dea-9df9-4122879bbe2e admin admin] PATH_INFO: `/v3/users/97bc6cb039574a709888d235bef659ce` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:19.222661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90519e47-2cb3-4dea-9df9-4122879bbe2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=97bc6cb039574a709888d235bef659ce)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:19.227510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90519e47-2cb3-4dea-9df9-4122879bbe2e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:19.486484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-90519e47-2cb3-4dea-9df9-4122879bbe2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97bc6cb039574a709888d235bef659ce'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:19.523678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-90519e47-2cb3-4dea-9df9-4122879bbe2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97bc6cb039574a709888d235bef659ce'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:19.609550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-90519e47-2cb3-4dea-9df9-4122879bbe2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97bc6cb039574a709888d235bef659ce'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:19.609550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-90519e47-2cb3-4dea-9df9-4122879bbe2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97bc6cb039574a709888d235bef659ce'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:19.609550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-90519e47-2cb3-4dea-9df9-4122879bbe2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97bc6cb039574a709888d235bef659ce'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:19.637759 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:19.713569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 880/1772] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:19 2022] DELETE /identity/v3/users/97bc6cb039574a709888d235bef659ce => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:19.910140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c872601-779d-4c70-8dd3-b16483279b42 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:19.911816 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8c872601-779d-4c70-8dd3-b16483279b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:19.961626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c872601-779d-4c70-8dd3-b16483279b42 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:20.102327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86093ce-4c08-425c-8aad-616f68baccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:20.103967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86093ce-4c08-425c-8aad-616f68baccfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:20.105291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86093ce-4c08-425c-8aad-616f68baccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:20.105652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86093ce-4c08-425c-8aad-616f68baccfa admin admin] PATH_INFO: `/v3/users/cca8f52c214846549147899d11636eff` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:20.107231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86093ce-4c08-425c-8aad-616f68baccfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca8f52c214846549147899d11636eff)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:20.110434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86093ce-4c08-425c-8aad-616f68baccfa admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:20.385649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b86093ce-4c08-425c-8aad-616f68baccfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca8f52c214846549147899d11636eff'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:20.386586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b86093ce-4c08-425c-8aad-616f68baccfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca8f52c214846549147899d11636eff'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:20.390694 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:20.459007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b86093ce-4c08-425c-8aad-616f68baccfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca8f52c214846549147899d11636eff'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:20.459794 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b86093ce-4c08-425c-8aad-616f68baccfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca8f52c214846549147899d11636eff'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:20.500820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b86093ce-4c08-425c-8aad-616f68baccfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca8f52c214846549147899d11636eff'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:20.533664 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 893/1773] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:19 2022] DELETE /identity/v3/users/cca8f52c214846549147899d11636eff => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:21.033893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90519e47-2cb3-4dea-9df9-4122879bbe2e admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:21.035982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-90519e47-2cb3-4dea-9df9-4122879bbe2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:21.058423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90519e47-2cb3-4dea-9df9-4122879bbe2e admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:21.171043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d64f6-e4b5-418f-982a-b8374b166323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:21.172600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d64f6-e4b5-418f-982a-b8374b166323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:21.172953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d64f6-e4b5-418f-982a-b8374b166323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:21.173297 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d64f6-e4b5-418f-982a-b8374b166323 admin admin] PATH_INFO: `/v3/projects/478b9d7f8ff04947931f7ca9525c888d` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:21.175335 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d64f6-e4b5-418f-982a-b8374b166323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=478b9d7f8ff04947931f7ca9525c888d)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:21.177745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d64f6-e4b5-418f-982a-b8374b166323 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:21.376409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86093ce-4c08-425c-8aad-616f68baccfa admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:21.381619 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b86093ce-4c08-425c-8aad-616f68baccfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:21.401531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0f9d64f6-e4b5-418f-982a-b8374b166323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '478b9d7f8ff04947931f7ca9525c888d', 'request_id': 'req-0f9d64f6-e4b5-418f-982a-b8374b166323'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:21.421522 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86093ce-4c08-425c-8aad-616f68baccfa admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:21.464290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0f9d64f6-e4b5-418f-982a-b8374b166323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '478b9d7f8ff04947931f7ca9525c888d', 'request_id': 'req-0f9d64f6-e4b5-418f-982a-b8374b166323'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:21.474102 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0f9d64f6-e4b5-418f-982a-b8374b166323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '478b9d7f8ff04947931f7ca9525c888d', 'request_id': 'req-0f9d64f6-e4b5-418f-982a-b8374b166323'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:21.493939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b8669-d5d6-408a-845e-9bfe00b42ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:21.496789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b8669-d5d6-408a-845e-9bfe00b42ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:21.496789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b8669-d5d6-408a-845e-9bfe00b42ded admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:21.496789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b8669-d5d6-408a-845e-9bfe00b42ded admin admin] PATH_INFO: `/v3/projects/d00893d3c2f540e78e2ccd8ddc2d0203` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:21.496789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b8669-d5d6-408a-845e-9bfe00b42ded admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00893d3c2f540e78e2ccd8ddc2d0203)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:21.499455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b8669-d5d6-408a-845e-9bfe00b42ded admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:21.504288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0f9d64f6-e4b5-418f-982a-b8374b166323 admin admin] The token cache is being invalidate because project 478b9d7f8ff04947931f7ca9525c888d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:21.504687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0f9d64f6-e4b5-418f-982a-b8374b166323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:21.505560 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0f9d64f6-e4b5-418f-982a-b8374b166323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:21.507334 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 881/1774] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:21 2022] DELETE /identity/v3/projects/478b9d7f8ff04947931f7ca9525c888d => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:21.509634 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d64f6-e4b5-418f-982a-b8374b166323 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:21.513691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-0f9d64f6-e4b5-418f-982a-b8374b166323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:21.533539 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d64f6-e4b5-418f-982a-b8374b166323 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:21.539930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1590288-b32f-461d-a166-5f6e5b70a97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:21.540659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1590288-b32f-461d-a166-5f6e5b70a97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:21.540943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1590288-b32f-461d-a166-5f6e5b70a97c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:21.541220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1590288-b32f-461d-a166-5f6e5b70a97c admin admin] PATH_INFO: `/v3/projects/fc428a03548c4aff91d94206218f3a00` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:21.542783 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1590288-b32f-461d-a166-5f6e5b70a97c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc428a03548c4aff91d94206218f3a00)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:21.544767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1590288-b32f-461d-a166-5f6e5b70a97c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:21.644187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2e4b8669-d5d6-408a-845e-9bfe00b42ded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00893d3c2f540e78e2ccd8ddc2d0203', 'request_id': 'req-2e4b8669-d5d6-408a-845e-9bfe00b42ded'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:21.655356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2e4b8669-d5d6-408a-845e-9bfe00b42ded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00893d3c2f540e78e2ccd8ddc2d0203', 'request_id': 'req-2e4b8669-d5d6-408a-845e-9bfe00b42ded'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:21.689118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c1590288-b32f-461d-a166-5f6e5b70a97c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc428a03548c4aff91d94206218f3a00', 'request_id': 'req-c1590288-b32f-461d-a166-5f6e5b70a97c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:21.722081 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2e4b8669-d5d6-408a-845e-9bfe00b42ded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00893d3c2f540e78e2ccd8ddc2d0203', 'request_id': 'req-2e4b8669-d5d6-408a-845e-9bfe00b42ded'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:21.733110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2e4b8669-d5d6-408a-845e-9bfe00b42ded admin admin] The token cache is being invalidate because project d00893d3c2f540e78e2ccd8ddc2d0203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:21.733541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2e4b8669-d5d6-408a-845e-9bfe00b42ded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:21.734140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2e4b8669-d5d6-408a-845e-9bfe00b42ded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:21.736081 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 894/1775] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:21 2022] DELETE /identity/v3/projects/d00893d3c2f540e78e2ccd8ddc2d0203 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:21.737017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3f3d7-d256-472d-aec7-9a6b55756229 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:21.737393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3f3d7-d256-472d-aec7-9a6b55756229 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:21.737612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3f3d7-d256-472d-aec7-9a6b55756229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:21.760283 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ecb3f3d7-d256-472d-aec7-9a6b55756229 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:21.761522 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ecb3f3d7-d256-472d-aec7-9a6b55756229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:21.814693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c1590288-b32f-461d-a166-5f6e5b70a97c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc428a03548c4aff91d94206218f3a00', 'request_id': 'req-c1590288-b32f-461d-a166-5f6e5b70a97c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:21.824832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c1590288-b32f-461d-a166-5f6e5b70a97c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc428a03548c4aff91d94206218f3a00', 'request_id': 'req-c1590288-b32f-461d-a166-5f6e5b70a97c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:21.831225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 895/1776] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:21.832294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3f3d7-d256-472d-aec7-9a6b55756229 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:21.833771 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ecb3f3d7-d256-472d-aec7-9a6b55756229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:21.841383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c1590288-b32f-461d-a166-5f6e5b70a97c admin admin] The token cache is being invalidate because project fc428a03548c4aff91d94206218f3a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:21.841729 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c1590288-b32f-461d-a166-5f6e5b70a97c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:21.843138 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c1590288-b32f-461d-a166-5f6e5b70a97c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:21.849273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 882/1777] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:21 2022] DELETE /identity/v3/projects/fc428a03548c4aff91d94206218f3a00 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:21.849273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6e0d6-707e-4a76-bd42-b8a3df2face6 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:21.849273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6e0d6-707e-4a76-bd42-b8a3df2face6 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:21.849273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6e0d6-707e-4a76-bd42-b8a3df2face6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:21.849825 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3f3d7-d256-472d-aec7-9a6b55756229 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:21.865300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daed3f0-bf31-48c6-b740-c1998b2ebfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:21.865963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daed3f0-bf31-48c6-b740-c1998b2ebfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:21.866291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daed3f0-bf31-48c6-b740-c1998b2ebfae admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:21.866570 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daed3f0-bf31-48c6-b740-c1998b2ebfae admin admin] PATH_INFO: `/v3/users/1a3312f0b58241c981b0d8f979450313` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:21.868705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daed3f0-bf31-48c6-b740-c1998b2ebfae admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3312f0b58241c981b0d8f979450313)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:21.870655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daed3f0-bf31-48c6-b740-c1998b2ebfae admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:21.909430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-58b6e0d6-707e-4a76-bd42-b8a3df2face6 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:21.910778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-58b6e0d6-707e-4a76-bd42-b8a3df2face6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:21.923005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 883/1778] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:21.924842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c26b4-ef71-4a97-97c9-36bbc4bbd5b0 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:21.925336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c26b4-ef71-4a97-97c9-36bbc4bbd5b0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:21.927864 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c26b4-ef71-4a97-97c9-36bbc4bbd5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:21.958769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-606c26b4-ef71-4a97-97c9-36bbc4bbd5b0 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:21.961033 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-606c26b4-ef71-4a97-97c9-36bbc4bbd5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:21.972171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 884/1779] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:21.973261 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c26b4-ef71-4a97-97c9-36bbc4bbd5b0 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:21.990497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c26b4-ef71-4a97-97c9-36bbc4bbd5b0 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:22.004913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699dcd5-4547-4ba1-9bc4-7e8a4b086903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:22.004913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699dcd5-4547-4ba1-9bc4-7e8a4b086903 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.004913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699dcd5-4547-4ba1-9bc4-7e8a4b086903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.004913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699dcd5-4547-4ba1-9bc4-7e8a4b086903 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.005277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699dcd5-4547-4ba1-9bc4-7e8a4b086903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:22.005934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699dcd5-4547-4ba1-9bc4-7e8a4b086903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:22.007403 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699dcd5-4547-4ba1-9bc4-7e8a4b086903 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:22.023865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 885/1780] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:50:22.023865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d396d1-2027-4418-a2e3-e4ebde176948 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.023865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d396d1-2027-4418-a2e3-e4ebde176948 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.024291 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d396d1-2027-4418-a2e3-e4ebde176948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.044732 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-30d396d1-2027-4418-a2e3-e4ebde176948 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:22.046525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-30d396d1-2027-4418-a2e3-e4ebde176948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:22.056936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 886/1781] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:22.057706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d396d1-2027-4418-a2e3-e4ebde176948 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:22.065085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8daed3f0-bf31-48c6-b740-c1998b2ebfae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3312f0b58241c981b0d8f979450313'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:22.065898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8daed3f0-bf31-48c6-b740-c1998b2ebfae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3312f0b58241c981b0d8f979450313'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:22.068795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d396d1-2027-4418-a2e3-e4ebde176948 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:22.079531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dfd63-d180-4079-9acb-62f92a21d5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:22.079531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dfd63-d180-4079-9acb-62f92a21d5c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.079531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dfd63-d180-4079-9acb-62f92a21d5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.079531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dfd63-d180-4079-9acb-62f92a21d5c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.080244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dfd63-d180-4079-9acb-62f92a21d5c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:22.080518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dfd63-d180-4079-9acb-62f92a21d5c8 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:22.099459 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:22.151360 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8daed3f0-bf31-48c6-b740-c1998b2ebfae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3312f0b58241c981b0d8f979450313'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:22.152118 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8daed3f0-bf31-48c6-b740-c1998b2ebfae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3312f0b58241c981b0d8f979450313'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:22.172490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8daed3f0-bf31-48c6-b740-c1998b2ebfae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3312f0b58241c981b0d8f979450313'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:22.190592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 896/1782] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:21 2022] DELETE /identity/v3/users/1a3312f0b58241c981b0d8f979450313 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:22.192404 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daed3f0-bf31-48c6-b740-c1998b2ebfae admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:22.195397 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 887/1783] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:22 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:22.196832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8daed3f0-bf31-48c6-b740-c1998b2ebfae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:22.199993 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dfd63-d180-4079-9acb-62f92a21d5c8 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:22.201900 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-513dfd63-d180-4079-9acb-62f92a21d5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:22.296805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dfd63-d180-4079-9acb-62f92a21d5c8 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:22.304247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64f4b9-e09e-43c0-b93a-1a0e4cee9558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:22.307070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f4b9-e09e-43c0-b93a-1a0e4cee9558 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.307070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f4b9-e09e-43c0-b93a-1a0e4cee9558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.307070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f4b9-e09e-43c0-b93a-1a0e4cee9558 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.307070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64f4b9-e09e-43c0-b93a-1a0e4cee9558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:22.312416 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64f4b9-e09e-43c0-b93a-1a0e4cee9558 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:22.315454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daed3f0-bf31-48c6-b740-c1998b2ebfae admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:22.322060 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44372b8c-2d07-4173-801e-26dd4a2f744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:22.322987 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44372b8c-2d07-4173-801e-26dd4a2f744b admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.323579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44372b8c-2d07-4173-801e-26dd4a2f744b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.324308 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44372b8c-2d07-4173-801e-26dd4a2f744b admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.325234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44372b8c-2d07-4173-801e-26dd4a2f744b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:22.325726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44372b8c-2d07-4173-801e-26dd4a2f744b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:22.328805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44372b8c-2d07-4173-801e-26dd4a2f744b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:22.343472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 897/1784] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:50:22.348117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44372b8c-2d07-4173-801e-26dd4a2f744b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:22.359089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44372b8c-2d07-4173-801e-26dd4a2f744b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:22.366036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e88bd-f87c-46c6-9da0-85e315951174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:22.366770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e88bd-f87c-46c6-9da0-85e315951174 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.367101 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e88bd-f87c-46c6-9da0-85e315951174 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.367383 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e88bd-f87c-46c6-9da0-85e315951174 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.368023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e88bd-f87c-46c6-9da0-85e315951174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:22.369995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e88bd-f87c-46c6-9da0-85e315951174 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:22.439709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 888/1785] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:22 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:22.444174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64f4b9-e09e-43c0-b93a-1a0e4cee9558 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:22.462121 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64f4b9-e09e-43c0-b93a-1a0e4cee9558 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:22.468283 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63379b-191a-4290-85f0-aa343bc1ffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:22.468955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63379b-191a-4290-85f0-aa343bc1ffe9 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.469335 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63379b-191a-4290-85f0-aa343bc1ffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.470553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63379b-191a-4290-85f0-aa343bc1ffe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.471327 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63379b-191a-4290-85f0-aa343bc1ffe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:22.473295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63379b-191a-4290-85f0-aa343bc1ffe9 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:22.488230 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 889/1786] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:50:22.492842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 898/1787] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:22 2022] POST /identity/v3/projects => generated 393 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:22.494119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63379b-191a-4290-85f0-aa343bc1ffe9 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:22.498518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e88bd-f87c-46c6-9da0-85e315951174 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:22.512679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63379b-191a-4290-85f0-aa343bc1ffe9 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:22.615639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de89ec-e536-4475-9f38-20402f002a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:22.616598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de89ec-e536-4475-9f38-20402f002a09 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.616879 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de89ec-e536-4475-9f38-20402f002a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.617254 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de89ec-e536-4475-9f38-20402f002a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.617910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de89ec-e536-4475-9f38-20402f002a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:22.619711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de89ec-e536-4475-9f38-20402f002a09 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:22.630187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 890/1788] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:22.630839 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e88bd-f87c-46c6-9da0-85e315951174 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:22.634249 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de89ec-e536-4475-9f38-20402f002a09 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:22.636186 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b7435-b735-4b26-8025-f2bad2a09b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:22.636795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b7435-b735-4b26-8025-f2bad2a09b0b admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.637080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b7435-b735-4b26-8025-f2bad2a09b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.637357 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b7435-b735-4b26-8025-f2bad2a09b0b admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.638022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b7435-b735-4b26-8025-f2bad2a09b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:22.640646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b7435-b735-4b26-8025-f2bad2a09b0b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:22.645762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de89ec-e536-4475-9f38-20402f002a09 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:22.650471 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d20e59-62eb-4987-83b0-7651473405be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:22.651177 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d20e59-62eb-4987-83b0-7651473405be admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.651487 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d20e59-62eb-4987-83b0-7651473405be admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.651763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d20e59-62eb-4987-83b0-7651473405be admin admin] PATH_INFO: `/v3/projects/2e0cc679f7824953974fda39b4eb2cda/users/e2b63bc15d754875affbe5343a0ef478/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.667623 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d20e59-62eb-4987-83b0-7651473405be admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0cc679f7824953974fda39b4eb2cda, user_id=e2b63bc15d754875affbe5343a0ef478, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:22.670342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d20e59-62eb-4987-83b0-7651473405be admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:22.693542 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:22.762043 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 899/1789] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:22 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:22.762880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b7435-b735-4b26-8025-f2bad2a09b0b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:22.766950 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-1d0b7435-b735-4b26-8025-f2bad2a09b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:22.779267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b7435-b735-4b26-8025-f2bad2a09b0b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:22.785326 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b678632-0489-4b85-b187-e9ac892599b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:22.785942 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b678632-0489-4b85-b187-e9ac892599b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.786224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b678632-0489-4b85-b187-e9ac892599b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.786500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b678632-0489-4b85-b187-e9ac892599b7 admin admin] PATH_INFO: `/v3/projects/21a3894774a4496d8bb186985f6d0df8` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.787718 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b678632-0489-4b85-b187-e9ac892599b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21a3894774a4496d8bb186985f6d0df8)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:22.789670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b678632-0489-4b85-b187-e9ac892599b7 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:22.831596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 891/1790] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:22 2022] PUT /identity/v3/projects/2e0cc679f7824953974fda39b4eb2cda/users/e2b63bc15d754875affbe5343a0ef478/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:22.834352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d20e59-62eb-4987-83b0-7651473405be admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:22.895212 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d20e59-62eb-4987-83b0-7651473405be admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:22.899852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8825af4-2a12-4338-8d25-ab7418edca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:22.900494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8825af4-2a12-4338-8d25-ab7418edca70 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.900777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8825af4-2a12-4338-8d25-ab7418edca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.901048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8825af4-2a12-4338-8d25-ab7418edca70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.901685 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8825af4-2a12-4338-8d25-ab7418edca70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:22.903257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8825af4-2a12-4338-8d25-ab7418edca70 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:22.913262 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 892/1791] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:22.914379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa056cd-a730-46fe-b629-b317b3b98de0 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:22.914663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa056cd-a730-46fe-b629-b317b3b98de0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:22.914939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa056cd-a730-46fe-b629-b317b3b98de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:22.942792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7b678632-0489-4b85-b187-e9ac892599b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21a3894774a4496d8bb186985f6d0df8', 'request_id': 'req-7b678632-0489-4b85-b187-e9ac892599b7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:22.947410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-8fa056cd-a730-46fe-b629-b317b3b98de0 None None] MFA Rules not processed for user `e2b63bc15d754875affbe5343a0ef478`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:22.954243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8fa056cd-a730-46fe-b629-b317b3b98de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:22.958764 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7b678632-0489-4b85-b187-e9ac892599b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21a3894774a4496d8bb186985f6d0df8', 'request_id': 'req-7b678632-0489-4b85-b187-e9ac892599b7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:23.019839 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 893/1792] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:23.021627 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa056cd-a730-46fe-b629-b317b3b98de0 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:23.040926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7b678632-0489-4b85-b187-e9ac892599b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21a3894774a4496d8bb186985f6d0df8', 'request_id': 'req-7b678632-0489-4b85-b187-e9ac892599b7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:23.053293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7b678632-0489-4b85-b187-e9ac892599b7 admin admin] The token cache is being invalidate because project 21a3894774a4496d8bb186985f6d0df8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:23.053587 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7b678632-0489-4b85-b187-e9ac892599b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:23.054333 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7b678632-0489-4b85-b187-e9ac892599b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:23.056373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 900/1793] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:22 2022] DELETE /identity/v3/projects/21a3894774a4496d8bb186985f6d0df8 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:23.057138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b678632-0489-4b85-b187-e9ac892599b7 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:23.059200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-7b678632-0489-4b85-b187-e9ac892599b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:23.095339 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa056cd-a730-46fe-b629-b317b3b98de0 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:23.100999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b664f-7d65-4b27-a399-f6e1418de018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:23.101676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b664f-7d65-4b27-a399-f6e1418de018 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.102020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b664f-7d65-4b27-a399-f6e1418de018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.102308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b664f-7d65-4b27-a399-f6e1418de018 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.103013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b664f-7d65-4b27-a399-f6e1418de018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:23.104711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b664f-7d65-4b27-a399-f6e1418de018 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:23.118716 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 894/1794] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:23.120821 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aa0c9-0e15-4ba8-80da-7ef89e67e9a0 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.121447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aa0c9-0e15-4ba8-80da-7ef89e67e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.121960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aa0c9-0e15-4ba8-80da-7ef89e67e9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.132811 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b678632-0489-4b85-b187-e9ac892599b7 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:23.137979 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345090b-6bb4-4e8f-a1d7-83039c10e94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:23.138644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345090b-6bb4-4e8f-a1d7-83039c10e94c admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.139513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345090b-6bb4-4e8f-a1d7-83039c10e94c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.139825 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345090b-6bb4-4e8f-a1d7-83039c10e94c admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.140537 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345090b-6bb4-4e8f-a1d7-83039c10e94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:23.142493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345090b-6bb4-4e8f-a1d7-83039c10e94c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:23.147106 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-e03aa0c9-0e15-4ba8-80da-7ef89e67e9a0 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:23.148270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e03aa0c9-0e15-4ba8-80da-7ef89e67e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:23.156515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 895/1795] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:23.157539 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03aa0c9-0e15-4ba8-80da-7ef89e67e9a0 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:23.158822 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e03aa0c9-0e15-4ba8-80da-7ef89e67e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:23.170358 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03aa0c9-0e15-4ba8-80da-7ef89e67e9a0 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:23.175168 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee455f-c383-40f3-b93e-5b9494458ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:23.175821 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee455f-c383-40f3-b93e-5b9494458ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.180617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee455f-c383-40f3-b93e-5b9494458ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.180617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee455f-c383-40f3-b93e-5b9494458ccd admin admin] PATH_INFO: `/v3/projects/de1bc1793dfa4ea49bc4323088deb41d/users/ef2e23a07f6d43158cc6187dc3e27f50/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.192941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee455f-c383-40f3-b93e-5b9494458ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1bc1793dfa4ea49bc4323088deb41d, user_id=ef2e23a07f6d43158cc6187dc3e27f50, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:23.196365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee455f-c383-40f3-b93e-5b9494458ccd admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:23.258969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 901/1796] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:23 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:23.260024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cf37c-b5bb-4c27-8745-bb430d6b61a1 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.260387 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cf37c-b5bb-4c27-8745-bb430d6b61a1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.260672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cf37c-b5bb-4c27-8745-bb430d6b61a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.280537 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-b11cf37c-b5bb-4c27-8745-bb430d6b61a1 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:23.281800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b11cf37c-b5bb-4c27-8745-bb430d6b61a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:23.288232 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 896/1797] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:23 2022] PUT /identity/v3/projects/de1bc1793dfa4ea49bc4323088deb41d/users/ef2e23a07f6d43158cc6187dc3e27f50/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:23.289586 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee455f-c383-40f3-b93e-5b9494458ccd admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:23.344736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 902/1798] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:23.349244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545259a-1c25-41bd-9c06-287de9b4913f None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.349999 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545259a-1c25-41bd-9c06-287de9b4913f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.350357 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545259a-1c25-41bd-9c06-287de9b4913f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.362105 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee455f-c383-40f3-b93e-5b9494458ccd admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:23.368247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc1262-fdd3-4d44-befb-e2c7069506ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:23.369421 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc1262-fdd3-4d44-befb-e2c7069506ef admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.369421 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc1262-fdd3-4d44-befb-e2c7069506ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.369421 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc1262-fdd3-4d44-befb-e2c7069506ef admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.370167 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc1262-fdd3-4d44-befb-e2c7069506ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:23.372226 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc1262-fdd3-4d44-befb-e2c7069506ef admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:23.381240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-4545259a-1c25-41bd-9c06-287de9b4913f None None] MFA Rules not processed for user `ef2e23a07f6d43158cc6187dc3e27f50`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:23.382510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4545259a-1c25-41bd-9c06-287de9b4913f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:23.447673 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 903/1799] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:23.448616 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545259a-1c25-41bd-9c06-287de9b4913f None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:23.459408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545259a-1c25-41bd-9c06-287de9b4913f None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:23.464439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928e876-1494-4913-9dcf-661246652908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:23.469805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e876-1494-4913-9dcf-661246652908 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.469805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e876-1494-4913-9dcf-661246652908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.469805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e876-1494-4913-9dcf-661246652908 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.469805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928e876-1494-4913-9dcf-661246652908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:23.469805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928e876-1494-4913-9dcf-661246652908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:23.469805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928e876-1494-4913-9dcf-661246652908 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:23.474277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 897/1800] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:23 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:23.474277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc1262-fdd3-4d44-befb-e2c7069506ef admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:23.485853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 904/1801] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:50:23.485853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928e876-1494-4913-9dcf-661246652908 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:23.492978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc1262-fdd3-4d44-befb-e2c7069506ef admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:23.492978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6939f8-2cd2-4d48-89a2-83e982f808c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:23.492978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6939f8-2cd2-4d48-89a2-83e982f808c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.492978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6939f8-2cd2-4d48-89a2-83e982f808c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.493265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6939f8-2cd2-4d48-89a2-83e982f808c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.493265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6939f8-2cd2-4d48-89a2-83e982f808c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:23.493638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928e876-1494-4913-9dcf-661246652908 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:23.494064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6939f8-2cd2-4d48-89a2-83e982f808c4 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:23.498387 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8375aa-2636-4851-bc13-e626bcc8ce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:23.498897 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8375aa-2636-4851-bc13-e626bcc8ce48 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.499966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8375aa-2636-4851-bc13-e626bcc8ce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.499966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8375aa-2636-4851-bc13-e626bcc8ce48 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.500256 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8375aa-2636-4851-bc13-e626bcc8ce48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:23.501795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8375aa-2636-4851-bc13-e626bcc8ce48 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:23.513653 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 905/1802] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:23.515166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8375aa-2636-4851-bc13-e626bcc8ce48 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:23.528977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8375aa-2636-4851-bc13-e626bcc8ce48 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:23.536619 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd47de5-7eac-46d4-a90e-290bca35401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:23.537246 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd47de5-7eac-46d4-a90e-290bca35401c admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.537536 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd47de5-7eac-46d4-a90e-290bca35401c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.537813 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd47de5-7eac-46d4-a90e-290bca35401c admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.538457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd47de5-7eac-46d4-a90e-290bca35401c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:23.540417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd47de5-7eac-46d4-a90e-290bca35401c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:23.618719 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 898/1803] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:23 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:23.618719 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6939f8-2cd2-4d48-89a2-83e982f808c4 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:23.653756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 906/1804] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:23 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:23.655786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd47de5-7eac-46d4-a90e-290bca35401c admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:23.691682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6939f8-2cd2-4d48-89a2-83e982f808c4 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:23.727849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd47de5-7eac-46d4-a90e-290bca35401c admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:23.732999 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaca0e-ab88-49e4-aa26-97793a38a257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:23.733777 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaca0e-ab88-49e4-aa26-97793a38a257 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.734204 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaca0e-ab88-49e4-aa26-97793a38a257 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.734550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaca0e-ab88-49e4-aa26-97793a38a257 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.735260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaca0e-ab88-49e4-aa26-97793a38a257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:23.737416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaca0e-ab88-49e4-aa26-97793a38a257 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:23.761223 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d9f66-7d5b-4d6d-ab9d-86230232855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:23.761877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d9f66-7d5b-4d6d-ab9d-86230232855d admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.762157 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d9f66-7d5b-4d6d-ab9d-86230232855d admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.762434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d9f66-7d5b-4d6d-ab9d-86230232855d admin admin] PATH_INFO: `/v3/projects/f27ad4cb5f514ac293b801b9b368cae9/users/ea82a743e0a44169a8d1479331a1aca2/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.778999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d9f66-7d5b-4d6d-ab9d-86230232855d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27ad4cb5f514ac293b801b9b368cae9, user_id=ea82a743e0a44169a8d1479331a1aca2, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:23.781776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d9f66-7d5b-4d6d-ab9d-86230232855d admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:23.851796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 899/1805] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:23 2022] PUT /identity/v3/projects/f27ad4cb5f514ac293b801b9b368cae9/users/ea82a743e0a44169a8d1479331a1aca2/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:23.852716 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d9f66-7d5b-4d6d-ab9d-86230232855d admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:23.856656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 907/1806] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:23 2022] POST /identity/v3/users => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:23.856656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaca0e-ab88-49e4-aa26-97793a38a257 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:23.867266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaca0e-ab88-49e4-aa26-97793a38a257 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:23.921770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d9f66-7d5b-4d6d-ab9d-86230232855d admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:23.927754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73bf17-5b20-4b69-aaf9-c0eca6f8a971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:23.928408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73bf17-5b20-4b69-aaf9-c0eca6f8a971 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.928687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73bf17-5b20-4b69-aaf9-c0eca6f8a971 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.928966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73bf17-5b20-4b69-aaf9-c0eca6f8a971 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.929602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73bf17-5b20-4b69-aaf9-c0eca6f8a971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:23.931571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73bf17-5b20-4b69-aaf9-c0eca6f8a971 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:23.932815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ef568-c77b-493d-80e5-2de0f18f29cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:23.933452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ef568-c77b-493d-80e5-2de0f18f29cf admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.933738 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ef568-c77b-493d-80e5-2de0f18f29cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.934008 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ef568-c77b-493d-80e5-2de0f18f29cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.934664 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ef568-c77b-493d-80e5-2de0f18f29cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:23.936942 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ef568-c77b-493d-80e5-2de0f18f29cf admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:23.947183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 908/1807] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:23.947183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ef568-c77b-493d-80e5-2de0f18f29cf admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:23.961551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ef568-c77b-493d-80e5-2de0f18f29cf admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:23.965936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c4a98-23c9-4186-aed4-7984b1b8eda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:23.966610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4a98-23c9-4186-aed4-7984b1b8eda8 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:23.966897 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4a98-23c9-4186-aed4-7984b1b8eda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:23.967172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4a98-23c9-4186-aed4-7984b1b8eda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:23.967811 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c4a98-23c9-4186-aed4-7984b1b8eda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:23.969426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c4a98-23c9-4186-aed4-7984b1b8eda8 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:23.981017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 909/1808] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:23.981260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c4a98-23c9-4186-aed4-7984b1b8eda8 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:23.993946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c4a98-23c9-4186-aed4-7984b1b8eda8 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:24.000257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6d44b-aba8-4ba9-84ac-291c8ab3071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:24.000921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6d44b-aba8-4ba9-84ac-291c8ab3071a admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.001206 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6d44b-aba8-4ba9-84ac-291c8ab3071a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.001520 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6d44b-aba8-4ba9-84ac-291c8ab3071a admin admin] PATH_INFO: `/v3/projects/f27ad4cb5f514ac293b801b9b368cae9/users/ea82a743e0a44169a8d1479331a1aca2/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.004343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6d44b-aba8-4ba9-84ac-291c8ab3071a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27ad4cb5f514ac293b801b9b368cae9, user_id=ea82a743e0a44169a8d1479331a1aca2, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:24.007138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6d44b-aba8-4ba9-84ac-291c8ab3071a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:24.017702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 900/1809] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:23 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:24.018692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73bf17-5b20-4b69-aaf9-c0eca6f8a971 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:24.039935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 910/1810] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:23 2022] PUT /identity/v3/projects/f27ad4cb5f514ac293b801b9b368cae9/users/ea82a743e0a44169a8d1479331a1aca2/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:24.039935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6d44b-aba8-4ba9-84ac-291c8ab3071a admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:24.040205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73bf17-5b20-4b69-aaf9-c0eca6f8a971 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:24.083945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:24.093534 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6d44b-aba8-4ba9-84ac-291c8ab3071a admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:24.098376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab88049-88dd-4057-9c44-3ecb0e4829b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:24.098807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab88049-88dd-4057-9c44-3ecb0e4829b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.099088 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab88049-88dd-4057-9c44-3ecb0e4829b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.099363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab88049-88dd-4057-9c44-3ecb0e4829b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.100015 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab88049-88dd-4057-9c44-3ecb0e4829b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:24.101682 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab88049-88dd-4057-9c44-3ecb0e4829b2 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:24.103721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33c6e7-0bb0-42ed-8050-839b77373e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:24.104508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33c6e7-0bb0-42ed-8050-839b77373e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.104881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33c6e7-0bb0-42ed-8050-839b77373e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.105166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33c6e7-0bb0-42ed-8050-839b77373e77 admin admin] PATH_INFO: `/v3/projects/90c48d0c3b0048a0a9f43f5bcacb17b0/users/3a2e65caf08c4dd59be07f3af0223adc/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.113287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 911/1811] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:24.118436 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a7f60-5895-46b7-bc26-d2f12bb1b84d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.118436 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a7f60-5895-46b7-bc26-d2f12bb1b84d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.118436 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a7f60-5895-46b7-bc26-d2f12bb1b84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.121027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33c6e7-0bb0-42ed-8050-839b77373e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c48d0c3b0048a0a9f43f5bcacb17b0, user_id=3a2e65caf08c4dd59be07f3af0223adc, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:24.124277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33c6e7-0bb0-42ed-8050-839b77373e77 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:24.145096 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-e99a7f60-5895-46b7-bc26-d2f12bb1b84d None None] MFA Rules not processed for user `ea82a743e0a44169a8d1479331a1aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:24.146324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e99a7f60-5895-46b7-bc26-d2f12bb1b84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:24.197976 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 901/1812] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:24 2022] PUT /identity/v3/projects/90c48d0c3b0048a0a9f43f5bcacb17b0/users/3a2e65caf08c4dd59be07f3af0223adc/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:24.198798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33c6e7-0bb0-42ed-8050-839b77373e77 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:24.216722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 912/1813] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:24.217586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a7f60-5895-46b7-bc26-d2f12bb1b84d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:24.231079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a7f60-5895-46b7-bc26-d2f12bb1b84d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:24.265274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33c6e7-0bb0-42ed-8050-839b77373e77 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:24.270278 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422816f4-d34e-4ada-a3f7-245eac350092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:24.270884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422816f4-d34e-4ada-a3f7-245eac350092 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.271164 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422816f4-d34e-4ada-a3f7-245eac350092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.271436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422816f4-d34e-4ada-a3f7-245eac350092 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.272128 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422816f4-d34e-4ada-a3f7-245eac350092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:24.273699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422816f4-d34e-4ada-a3f7-245eac350092 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:24.287123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 902/1814] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:24.288205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422816f4-d34e-4ada-a3f7-245eac350092 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:24.290311 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-422816f4-d34e-4ada-a3f7-245eac350092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:24.303258 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5598e-d152-465f-8de4-a0eb69d760cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:24.303913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5598e-d152-465f-8de4-a0eb69d760cd admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.304231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5598e-d152-465f-8de4-a0eb69d760cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.304542 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5598e-d152-465f-8de4-a0eb69d760cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.305211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5598e-d152-465f-8de4-a0eb69d760cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:24.306856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5598e-d152-465f-8de4-a0eb69d760cd admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:24.320197 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 913/1815] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:24.322754 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5598e-d152-465f-8de4-a0eb69d760cd admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:24.333293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5598e-d152-465f-8de4-a0eb69d760cd admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:24.339180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e85bd-ea92-4cd3-af6d-022836a50cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:24.340160 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e85bd-ea92-4cd3-af6d-022836a50cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.340537 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e85bd-ea92-4cd3-af6d-022836a50cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.340816 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e85bd-ea92-4cd3-af6d-022836a50cf2 admin admin] PATH_INFO: `/v3/projects/9735007753534752b1b5d7a4f295eb0d/users/95ea70aa49a44bdb95bc97cfe9f3cb2c/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.353748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422816f4-d34e-4ada-a3f7-245eac350092 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:24.358069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e85bd-ea92-4cd3-af6d-022836a50cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9735007753534752b1b5d7a4f295eb0d, user_id=95ea70aa49a44bdb95bc97cfe9f3cb2c, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:24.358347 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a36774-704e-4948-901d-621383d1bd72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:24.358968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a36774-704e-4948-901d-621383d1bd72 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.359249 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a36774-704e-4948-901d-621383d1bd72 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.359631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a36774-704e-4948-901d-621383d1bd72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.360927 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e85bd-ea92-4cd3-af6d-022836a50cf2 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:24.437671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a36774-704e-4948-901d-621383d1bd72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:24.439163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a36774-704e-4948-901d-621383d1bd72 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:24.449440 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 903/1816] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:24.450380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a36774-704e-4948-901d-621383d1bd72 service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:24.479246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a36774-704e-4948-901d-621383d1bd72 service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:24.488124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 914/1817] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:24 2022] PUT /identity/v3/projects/9735007753534752b1b5d7a4f295eb0d/users/95ea70aa49a44bdb95bc97cfe9f3cb2c/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:24.492243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e35eea-959c-4fb4-a701-4cc44408fb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:24.493011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35eea-959c-4fb4-a701-4cc44408fb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.493369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35eea-959c-4fb4-a701-4cc44408fb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.493730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35eea-959c-4fb4-a701-4cc44408fb9e admin admin] PATH_INFO: `/v3/projects/90c48d0c3b0048a0a9f43f5bcacb17b0/users/3a2e65caf08c4dd59be07f3af0223adc/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.496444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e35eea-959c-4fb4-a701-4cc44408fb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c48d0c3b0048a0a9f43f5bcacb17b0, user_id=3a2e65caf08c4dd59be07f3af0223adc, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:24.499133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89669c10-784b-4eac-8509-1b12c6cc60ac None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.499620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89669c10-784b-4eac-8509-1b12c6cc60ac None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.499827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89669c10-784b-4eac-8509-1b12c6cc60ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.518131 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e35eea-959c-4fb4-a701-4cc44408fb9e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:24.528169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 904/1818] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:24 2022] PUT /identity/v3/projects/90c48d0c3b0048a0a9f43f5bcacb17b0/users/3a2e65caf08c4dd59be07f3af0223adc/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:24.538669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b18b6-42c7-4bd1-8d26-f15f75e9e6e1 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.538956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b18b6-42c7-4bd1-8d26-f15f75e9e6e1 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.539233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b18b6-42c7-4bd1-8d26-f15f75e9e6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.603724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-89669c10-784b-4eac-8509-1b12c6cc60ac None None] MFA Rules not processed for user `95ea70aa49a44bdb95bc97cfe9f3cb2c`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:24.605075 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-89669c10-784b-4eac-8509-1b12c6cc60ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:24.615546 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-a94b18b6-42c7-4bd1-8d26-f15f75e9e6e1 None None] MFA Rules not processed for user `3a2e65caf08c4dd59be07f3af0223adc`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:24.616970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a94b18b6-42c7-4bd1-8d26-f15f75e9e6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:24.718921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 905/1819] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:24 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:24.719972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b18b6-42c7-4bd1-8d26-f15f75e9e6e1 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:24.725822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 915/1820] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:24.729965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89669c10-784b-4eac-8509-1b12c6cc60ac None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:24.803129 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b18b6-42c7-4bd1-8d26-f15f75e9e6e1 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:24.807528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73ff30-7ccc-4340-9c57-b31c23222d83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:24.808501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73ff30-7ccc-4340-9c57-b31c23222d83 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.808822 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73ff30-7ccc-4340-9c57-b31c23222d83 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.809573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73ff30-7ccc-4340-9c57-b31c23222d83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.811669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5b73ff30-7ccc-4340-9c57-b31c23222d83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:24.812546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:24.875324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89669c10-784b-4eac-8509-1b12c6cc60ac None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:24.881568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314f1ee-5dc9-4bd2-9191-30442e1298ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:24.882470 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314f1ee-5dc9-4bd2-9191-30442e1298ea admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.883290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314f1ee-5dc9-4bd2-9191-30442e1298ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.883947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314f1ee-5dc9-4bd2-9191-30442e1298ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.884826 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314f1ee-5dc9-4bd2-9191-30442e1298ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:24.888468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314f1ee-5dc9-4bd2-9191-30442e1298ea admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:24.932670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73ff30-7ccc-4340-9c57-b31c23222d83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:24.934511 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73ff30-7ccc-4340-9c57-b31c23222d83 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:24.948461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 906/1821] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:24.949429 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73ff30-7ccc-4340-9c57-b31c23222d83 service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:24.952911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5b73ff30-7ccc-4340-9c57-b31c23222d83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:24.977961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73ff30-7ccc-4340-9c57-b31c23222d83 service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:24.983193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bb281-9b57-4a83-82b2-4bc1162076d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:24.984645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bb281-9b57-4a83-82b2-4bc1162076d2 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:24.984935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bb281-9b57-4a83-82b2-4bc1162076d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:24.985215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bb281-9b57-4a83-82b2-4bc1162076d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:24.999064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bb281-9b57-4a83-82b2-4bc1162076d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:25.003192 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bb281-9b57-4a83-82b2-4bc1162076d2 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:25.030782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 907/1822] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:25.031678 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 916/1823] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:24 2022] POST /identity/v3/projects => generated 371 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:50:25.035827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314f1ee-5dc9-4bd2-9191-30442e1298ea admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:25.161681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314f1ee-5dc9-4bd2-9191-30442e1298ea admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:25.168146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d76bf-dc24-4816-8839-994b0387df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:25.168870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d76bf-dc24-4816-8839-994b0387df0b admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:25.169279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d76bf-dc24-4816-8839-994b0387df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:25.169666 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d76bf-dc24-4816-8839-994b0387df0b admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:25.170479 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d76bf-dc24-4816-8839-994b0387df0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:25.174630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d76bf-dc24-4816-8839-994b0387df0b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:25.180136 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bb281-9b57-4a83-82b2-4bc1162076d2 service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:25.189418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bb281-9b57-4a83-82b2-4bc1162076d2 service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:25.238730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c7121-6e38-4d8f-838c-6ae540a5d3fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:25.239353 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c7121-6e38-4d8f-838c-6ae540a5d3fb service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:25.239648 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c7121-6e38-4d8f-838c-6ae540a5d3fb service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:25.239913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c7121-6e38-4d8f-838c-6ae540a5d3fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:25.282015 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 917/1824] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:25 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:25.285515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d76bf-dc24-4816-8839-994b0387df0b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:25.297059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d76bf-dc24-4816-8839-994b0387df0b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:25.303289 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf2105-be03-43f6-aa85-2d107ba1152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:25.303723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c7121-6e38-4d8f-838c-6ae540a5d3fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:25.304414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf2105-be03-43f6-aa85-2d107ba1152e admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:25.304860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf2105-be03-43f6-aa85-2d107ba1152e admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:25.305235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c7121-6e38-4d8f-838c-6ae540a5d3fb service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:25.305509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf2105-be03-43f6-aa85-2d107ba1152e admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:25.306375 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf2105-be03-43f6-aa85-2d107ba1152e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:25.308206 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf2105-be03-43f6-aa85-2d107ba1152e admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:25.315394 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 908/1825] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:50:25.320452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 918/1826] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:25.324368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c7121-6e38-4d8f-838c-6ae540a5d3fb service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:25.342868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c7121-6e38-4d8f-838c-6ae540a5d3fb service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:25.343968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757037f-3d31-4225-9357-31e0eaafb70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:25.344730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757037f-3d31-4225-9357-31e0eaafb70b admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:25.345299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757037f-3d31-4225-9357-31e0eaafb70b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:25.345640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757037f-3d31-4225-9357-31e0eaafb70b admin admin] PATH_INFO: `/v3/projects/5405e75384e842828f7a94232cb3aa79/users/2e13d1c5842f4393b9373ab096981900/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:25.366359 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757037f-3d31-4225-9357-31e0eaafb70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5405e75384e842828f7a94232cb3aa79, user_id=2e13d1c5842f4393b9373ab096981900, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:25.369489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757037f-3d31-4225-9357-31e0eaafb70b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:25.473539 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 909/1827] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:25 2022] PUT /identity/v3/projects/5405e75384e842828f7a94232cb3aa79/users/2e13d1c5842f4393b9373ab096981900/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:50:25.477748 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf2105-be03-43f6-aa85-2d107ba1152e admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:25.479301 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:25.492357 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf2105-be03-43f6-aa85-2d107ba1152e admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:25.569702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813f901-2a60-469d-a26a-7a87d86ec470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:25.570503 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813f901-2a60-469d-a26a-7a87d86ec470 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:25.570887 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813f901-2a60-469d-a26a-7a87d86ec470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:25.571267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813f901-2a60-469d-a26a-7a87d86ec470 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:25.572128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813f901-2a60-469d-a26a-7a87d86ec470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:25.573895 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813f901-2a60-469d-a26a-7a87d86ec470 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:25.593790 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 919/1828] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:25.599947 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757037f-3d31-4225-9357-31e0eaafb70b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:25.612176 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757037f-3d31-4225-9357-31e0eaafb70b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:25.616929 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bcf82-9ba2-4c77-93b7-762c59e22229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:25.617884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bcf82-9ba2-4c77-93b7-762c59e22229 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:25.617884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bcf82-9ba2-4c77-93b7-762c59e22229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:25.618144 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bcf82-9ba2-4c77-93b7-762c59e22229 admin admin] PATH_INFO: `/v3/projects/5405e75384e842828f7a94232cb3aa79/users/2e13d1c5842f4393b9373ab096981900/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:25.620051 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bcf82-9ba2-4c77-93b7-762c59e22229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5405e75384e842828f7a94232cb3aa79, user_id=2e13d1c5842f4393b9373ab096981900, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:25.622706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bcf82-9ba2-4c77-93b7-762c59e22229 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:25.633115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 910/1829] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:25 2022] PUT /identity/v3/projects/5405e75384e842828f7a94232cb3aa79/users/2e13d1c5842f4393b9373ab096981900/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:25.645789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262f5c-8374-4499-b36c-c701fec10ce1 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:25.646178 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262f5c-8374-4499-b36c-c701fec10ce1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:25.646526 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262f5c-8374-4499-b36c-c701fec10ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:25.675979 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-14262f5c-8374-4499-b36c-c701fec10ce1 None None] MFA Rules not processed for user `2e13d1c5842f4393b9373ab096981900`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:25.681244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-14262f5c-8374-4499-b36c-c701fec10ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:25.782136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 920/1830] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:25.835189 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bcf82-9ba2-4c77-93b7-762c59e22229 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:25.937555 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bcf82-9ba2-4c77-93b7-762c59e22229 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:25.941863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea8c9c-7ba4-41c9-8a67-81d9906b37d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:25.942470 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea8c9c-7ba4-41c9-8a67-81d9906b37d1 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:25.942755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea8c9c-7ba4-41c9-8a67-81d9906b37d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:25.943027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea8c9c-7ba4-41c9-8a67-81d9906b37d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:25.953766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea8c9c-7ba4-41c9-8a67-81d9906b37d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:25.957064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea8c9c-7ba4-41c9-8a67-81d9906b37d1 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:25.968308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 911/1831] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:26.230025 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:27.670368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:28.075963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14262f5c-8374-4499-b36c-c701fec10ce1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:28.156463 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14262f5c-8374-4499-b36c-c701fec10ce1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:28.162150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887c0fb-97da-474c-94c1-e639edc55534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:28.162889 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887c0fb-97da-474c-94c1-e639edc55534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:28.163168 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887c0fb-97da-474c-94c1-e639edc55534 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:28.163443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887c0fb-97da-474c-94c1-e639edc55534 admin admin] PATH_INFO: `/v3/users/95ea70aa49a44bdb95bc97cfe9f3cb2c` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:28.164629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887c0fb-97da-474c-94c1-e639edc55534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ea70aa49a44bdb95bc97cfe9f3cb2c)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:28.166694 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887c0fb-97da-474c-94c1-e639edc55534 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:28.370174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3887c0fb-97da-474c-94c1-e639edc55534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ea70aa49a44bdb95bc97cfe9f3cb2c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:28.374265 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3887c0fb-97da-474c-94c1-e639edc55534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ea70aa49a44bdb95bc97cfe9f3cb2c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:28.461310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3887c0fb-97da-474c-94c1-e639edc55534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ea70aa49a44bdb95bc97cfe9f3cb2c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:28.462269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3887c0fb-97da-474c-94c1-e639edc55534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ea70aa49a44bdb95bc97cfe9f3cb2c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:28.491753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3887c0fb-97da-474c-94c1-e639edc55534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ea70aa49a44bdb95bc97cfe9f3cb2c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:28.513656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 921/1832] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:28 2022] DELETE /identity/v3/users/95ea70aa49a44bdb95bc97cfe9f3cb2c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:28.516924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6764c-dcc8-4beb-95aa-6c9e0b52231d None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:28.517379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6764c-dcc8-4beb-95aa-6c9e0b52231d None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:28.517456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6764c-dcc8-4beb-95aa-6c9e0b52231d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:28.539372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:28.558893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-c9f6764c-dcc8-4beb-95aa-6c9e0b52231d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:28.560944 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-c9f6764c-dcc8-4beb-95aa-6c9e0b52231d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:28.655821 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 912/1833] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:28.669961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887c0fb-97da-474c-94c1-e639edc55534 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:28.672400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3887c0fb-97da-474c-94c1-e639edc55534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:28.806955 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887c0fb-97da-474c-94c1-e639edc55534 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:28.813207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852750b-d40a-4364-9964-5f0c6a8e4fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:28.814174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852750b-d40a-4364-9964-5f0c6a8e4fed service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:28.814554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852750b-d40a-4364-9964-5f0c6a8e4fed service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:28.814933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852750b-d40a-4364-9964-5f0c6a8e4fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:28.851080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852750b-d40a-4364-9964-5f0c6a8e4fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:28.853335 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852750b-d40a-4364-9964-5f0c6a8e4fed service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:28.869603 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 922/1834] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:29.568760 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6764c-dcc8-4beb-95aa-6c9e0b52231d None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:29.570223 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-c9f6764c-dcc8-4beb-95aa-6c9e0b52231d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:29.588043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6764c-dcc8-4beb-95aa-6c9e0b52231d None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:29.588043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc2616-c2f8-4821-9a63-a6fad88223d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:29.588043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc2616-c2f8-4821-9a63-a6fad88223d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:29.588826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc2616-c2f8-4821-9a63-a6fad88223d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:29.589178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc2616-c2f8-4821-9a63-a6fad88223d1 admin admin] PATH_INFO: `/v3/projects/9735007753534752b1b5d7a4f295eb0d` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:29.591493 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc2616-c2f8-4821-9a63-a6fad88223d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9735007753534752b1b5d7a4f295eb0d)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:29.593487 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc2616-c2f8-4821-9a63-a6fad88223d1 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:29.670943 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:29.738801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-28fc2616-c2f8-4821-9a63-a6fad88223d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9735007753534752b1b5d7a4f295eb0d', 'request_id': 'req-28fc2616-c2f8-4821-9a63-a6fad88223d1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:29.773293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:29.796499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-28fc2616-c2f8-4821-9a63-a6fad88223d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9735007753534752b1b5d7a4f295eb0d', 'request_id': 'req-28fc2616-c2f8-4821-9a63-a6fad88223d1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:29.803860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-28fc2616-c2f8-4821-9a63-a6fad88223d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9735007753534752b1b5d7a4f295eb0d', 'request_id': 'req-28fc2616-c2f8-4821-9a63-a6fad88223d1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:29.816443 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-28fc2616-c2f8-4821-9a63-a6fad88223d1 admin admin] The token cache is being invalidate because project 9735007753534752b1b5d7a4f295eb0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:29.816735 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-28fc2616-c2f8-4821-9a63-a6fad88223d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:29.817502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-28fc2616-c2f8-4821-9a63-a6fad88223d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:29.819262 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 913/1835] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:29 2022] DELETE /identity/v3/projects/9735007753534752b1b5d7a4f295eb0d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:29.823019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852750b-d40a-4364-9964-5f0c6a8e4fed service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:29.833426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852750b-d40a-4364-9964-5f0c6a8e4fed service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:29.890377 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc2616-c2f8-4821-9a63-a6fad88223d1 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:29.892055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-28fc2616-c2f8-4821-9a63-a6fad88223d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:29.931307 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21755e-46cb-42d7-a978-62f67c510687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:29.936525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21755e-46cb-42d7-a978-62f67c510687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:29.936525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21755e-46cb-42d7-a978-62f67c510687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:29.936525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21755e-46cb-42d7-a978-62f67c510687 admin admin] PATH_INFO: `/v3/users/2e13d1c5842f4393b9373ab096981900` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:29.936525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21755e-46cb-42d7-a978-62f67c510687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e13d1c5842f4393b9373ab096981900)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:29.937027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21755e-46cb-42d7-a978-62f67c510687 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:30.000518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc2616-c2f8-4821-9a63-a6fad88223d1 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:30.006165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff32a82-fe3f-4ce9-b08c-7d17960c5acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:30.006828 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff32a82-fe3f-4ce9-b08c-7d17960c5acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:30.007096 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff32a82-fe3f-4ce9-b08c-7d17960c5acb admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:30.007371 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff32a82-fe3f-4ce9-b08c-7d17960c5acb admin admin] PATH_INFO: `/v3/users/e2b63bc15d754875affbe5343a0ef478` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:30.008615 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff32a82-fe3f-4ce9-b08c-7d17960c5acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b63bc15d754875affbe5343a0ef478)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:30.010482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff32a82-fe3f-4ce9-b08c-7d17960c5acb admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:30.112066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-fc21755e-46cb-42d7-a978-62f67c510687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e13d1c5842f4393b9373ab096981900'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:30.112784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-fc21755e-46cb-42d7-a978-62f67c510687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e13d1c5842f4393b9373ab096981900'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:30.238690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2ff32a82-fe3f-4ce9-b08c-7d17960c5acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b63bc15d754875affbe5343a0ef478'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:30.251023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2ff32a82-fe3f-4ce9-b08c-7d17960c5acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b63bc15d754875affbe5343a0ef478'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:30.252881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-fc21755e-46cb-42d7-a978-62f67c510687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e13d1c5842f4393b9373ab096981900'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:30.253593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-fc21755e-46cb-42d7-a978-62f67c510687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e13d1c5842f4393b9373ab096981900'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:30.267679 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-fc21755e-46cb-42d7-a978-62f67c510687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e13d1c5842f4393b9373ab096981900'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:30.281900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 923/1836] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:29 2022] DELETE /identity/v3/users/2e13d1c5842f4393b9373ab096981900 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:30.361911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2ff32a82-fe3f-4ce9-b08c-7d17960c5acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b63bc15d754875affbe5343a0ef478'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:30.364236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2ff32a82-fe3f-4ce9-b08c-7d17960c5acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b63bc15d754875affbe5343a0ef478'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:30.367996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2ff32a82-fe3f-4ce9-b08c-7d17960c5acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b63bc15d754875affbe5343a0ef478'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:30.393968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 914/1837] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:29 2022] DELETE /identity/v3/users/e2b63bc15d754875affbe5343a0ef478 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:30.401059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd610-9e09-47e6-9ab5-9010d27eac9a None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:30.401059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd610-9e09-47e6-9ab5-9010d27eac9a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:30.401059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd610-9e09-47e6-9ab5-9010d27eac9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:30.424843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-bcddd610-9e09-47e6-9ab5-9010d27eac9a None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:30.426961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-bcddd610-9e09-47e6-9ab5-9010d27eac9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:30.529518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 924/1838] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:30.530550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff32a82-fe3f-4ce9-b08c-7d17960c5acb admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:30.534091 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-2ff32a82-fe3f-4ce9-b08c-7d17960c5acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:30.627809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff32a82-fe3f-4ce9-b08c-7d17960c5acb admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:30.634491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be891ee-066c-412f-8231-a06d401b3a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:30.644887 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be891ee-066c-412f-8231-a06d401b3a30 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:30.644887 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be891ee-066c-412f-8231-a06d401b3a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:30.644887 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be891ee-066c-412f-8231-a06d401b3a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:30.648508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be891ee-066c-412f-8231-a06d401b3a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:30.650227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622ab45-fd59-4109-af93-46e5f1008842 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:30.650474 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be891ee-066c-412f-8231-a06d401b3a30 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:30.651368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622ab45-fd59-4109-af93-46e5f1008842 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:30.651720 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622ab45-fd59-4109-af93-46e5f1008842 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:30.654261 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 925/1839] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 29 22:50:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:50:30.667684 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 915/1840] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:50:30.686054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd0748-fd4d-431e-a36e-38ac36a0a044 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:30.686054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd0748-fd4d-431e-a36e-38ac36a0a044 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:30.686054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd0748-fd4d-431e-a36e-38ac36a0a044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:30.716402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-41bd0748-fd4d-431e-a36e-38ac36a0a044 None None] MFA Rules not processed for user `f06d910badb84c6aa6b48f3b56b91f82`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:30.718071 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-41bd0748-fd4d-431e-a36e-38ac36a0a044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:30.834557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 926/1841] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 29 22:50:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:30.862653 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be891ee-066c-412f-8231-a06d401b3a30 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:30.864864 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-7be891ee-066c-412f-8231-a06d401b3a30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:30.871745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd0748-fd4d-431e-a36e-38ac36a0a044 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:30.875993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-41bd0748-fd4d-431e-a36e-38ac36a0a044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:30.888887 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be891ee-066c-412f-8231-a06d401b3a30 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:30.897186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ec806-c563-41e3-b9d6-a3d242485639 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:30.898691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ec806-c563-41e3-b9d6-a3d242485639 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:30.899233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ec806-c563-41e3-b9d6-a3d242485639 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:30.899723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ec806-c563-41e3-b9d6-a3d242485639 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:30.910000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd0748-fd4d-431e-a36e-38ac36a0a044 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:30.913670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ec806-c563-41e3-b9d6-a3d242485639 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:30.920372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ec806-c563-41e3-b9d6-a3d242485639 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:30.920521 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d265303-d447-4a1f-bc13-5dcde470ada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:30.922397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d265303-d447-4a1f-bc13-5dcde470ada9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:30.924410 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d265303-d447-4a1f-bc13-5dcde470ada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:30.925809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d265303-d447-4a1f-bc13-5dcde470ada9 admin admin] PATH_INFO: `/v3/projects/5405e75384e842828f7a94232cb3aa79` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:30.928172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d265303-d447-4a1f-bc13-5dcde470ada9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5405e75384e842828f7a94232cb3aa79)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:30.931285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d265303-d447-4a1f-bc13-5dcde470ada9 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:30.944344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 916/1842] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:31.110874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:31.131481 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8d265303-d447-4a1f-bc13-5dcde470ada9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5405e75384e842828f7a94232cb3aa79', 'request_id': 'req-8d265303-d447-4a1f-bc13-5dcde470ada9'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:31.142383 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8d265303-d447-4a1f-bc13-5dcde470ada9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5405e75384e842828f7a94232cb3aa79', 'request_id': 'req-8d265303-d447-4a1f-bc13-5dcde470ada9'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:31.195720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:31.247853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8d265303-d447-4a1f-bc13-5dcde470ada9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5405e75384e842828f7a94232cb3aa79', 'request_id': 'req-8d265303-d447-4a1f-bc13-5dcde470ada9'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:31.267883 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8d265303-d447-4a1f-bc13-5dcde470ada9 admin admin] The token cache is being invalidate because project 5405e75384e842828f7a94232cb3aa79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:31.268340 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8d265303-d447-4a1f-bc13-5dcde470ada9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:31.272446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8d265303-d447-4a1f-bc13-5dcde470ada9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:31.278505 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 927/1843] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:30 2022] DELETE /identity/v3/projects/5405e75384e842828f7a94232cb3aa79 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:50:31.280727 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e1de9-fb1a-4c95-9e7d-55816158bcf2 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:31.281025 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e1de9-fb1a-4c95-9e7d-55816158bcf2 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:31.281307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e1de9-fb1a-4c95-9e7d-55816158bcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:31.334608 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-1d2e1de9-fb1a-4c95-9e7d-55816158bcf2 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:31.335858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1d2e1de9-fb1a-4c95-9e7d-55816158bcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:31.429181 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 917/1844] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:31.437270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae11d7-2e9b-47d7-bf97-483e2118e4e5 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:31.437761 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae11d7-2e9b-47d7-bf97-483e2118e4e5 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:31.437950 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae11d7-2e9b-47d7-bf97-483e2118e4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:31.463139 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-07ae11d7-2e9b-47d7-bf97-483e2118e4e5 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:31.463139 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-07ae11d7-2e9b-47d7-bf97-483e2118e4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:31.466243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e1de9-fb1a-4c95-9e7d-55816158bcf2 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:31.468669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1d2e1de9-fb1a-4c95-9e7d-55816158bcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:31.478275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 928/1845] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:31.479031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae11d7-2e9b-47d7-bf97-483e2118e4e5 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:31.492857 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e1de9-fb1a-4c95-9e7d-55816158bcf2 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:31.499782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcdcbc-34b7-4aeb-a278-29682452364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:31.500874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcdcbc-34b7-4aeb-a278-29682452364b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:31.501021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcdcbc-34b7-4aeb-a278-29682452364b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:31.501299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcdcbc-34b7-4aeb-a278-29682452364b admin admin] PATH_INFO: `/v3/projects/2e0cc679f7824953974fda39b4eb2cda` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:31.501577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae11d7-2e9b-47d7-bf97-483e2118e4e5 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:31.502573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcdcbc-34b7-4aeb-a278-29682452364b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e0cc679f7824953974fda39b4eb2cda)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:31.505370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcdcbc-34b7-4aeb-a278-29682452364b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:31.506701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac22e20-8d97-4432-9ed5-fa81654df452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:31.507313 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac22e20-8d97-4432-9ed5-fa81654df452 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:31.507596 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac22e20-8d97-4432-9ed5-fa81654df452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:31.507920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac22e20-8d97-4432-9ed5-fa81654df452 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:31.508613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac22e20-8d97-4432-9ed5-fa81654df452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:31.509457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac22e20-8d97-4432-9ed5-fa81654df452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:31.511115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac22e20-8d97-4432-9ed5-fa81654df452 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:31.524172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 929/1846] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:50:31.528675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac22e20-8d97-4432-9ed5-fa81654df452 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:31.541214 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac22e20-8d97-4432-9ed5-fa81654df452 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:31.547536 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f560a7-e20c-47d8-8809-d390c7c5afef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:31.548211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f560a7-e20c-47d8-8809-d390c7c5afef admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:31.554954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f560a7-e20c-47d8-8809-d390c7c5afef admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:31.554954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f560a7-e20c-47d8-8809-d390c7c5afef admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:31.554954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f560a7-e20c-47d8-8809-d390c7c5afef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:31.554954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f560a7-e20c-47d8-8809-d390c7c5afef admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:31.672741 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 930/1847] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:31 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:50:31.677309 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f560a7-e20c-47d8-8809-d390c7c5afef admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:31.684231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-62bcdcbc-34b7-4aeb-a278-29682452364b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e0cc679f7824953974fda39b4eb2cda', 'request_id': 'req-62bcdcbc-34b7-4aeb-a278-29682452364b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:31.740275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f560a7-e20c-47d8-8809-d390c7c5afef admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:31.745065 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21822ad2-03cf-450b-9076-fd8adca51c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:31.745677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21822ad2-03cf-450b-9076-fd8adca51c79 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:31.745964 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21822ad2-03cf-450b-9076-fd8adca51c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:31.746243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21822ad2-03cf-450b-9076-fd8adca51c79 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:31.746878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21822ad2-03cf-450b-9076-fd8adca51c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:31.748932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21822ad2-03cf-450b-9076-fd8adca51c79 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:31.750647 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-62bcdcbc-34b7-4aeb-a278-29682452364b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e0cc679f7824953974fda39b4eb2cda', 'request_id': 'req-62bcdcbc-34b7-4aeb-a278-29682452364b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:31.766127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-62bcdcbc-34b7-4aeb-a278-29682452364b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e0cc679f7824953974fda39b4eb2cda', 'request_id': 'req-62bcdcbc-34b7-4aeb-a278-29682452364b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:31.778613 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-62bcdcbc-34b7-4aeb-a278-29682452364b admin admin] The token cache is being invalidate because project 2e0cc679f7824953974fda39b4eb2cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:31.778906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-62bcdcbc-34b7-4aeb-a278-29682452364b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:31.780329 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-62bcdcbc-34b7-4aeb-a278-29682452364b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:31.781884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 918/1848] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:31 2022] DELETE /identity/v3/projects/2e0cc679f7824953974fda39b4eb2cda => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:50:31.786193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcdcbc-34b7-4aeb-a278-29682452364b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:31.787575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-62bcdcbc-34b7-4aeb-a278-29682452364b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:31.852393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcdcbc-34b7-4aeb-a278-29682452364b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:31.857075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff1d93-8066-4c4b-a2c1-a8c513b0bcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:31.857777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff1d93-8066-4c4b-a2c1-a8c513b0bcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:31.858048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff1d93-8066-4c4b-a2c1-a8c513b0bcde admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:31.858325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff1d93-8066-4c4b-a2c1-a8c513b0bcde admin admin] PATH_INFO: `/v3/users/ea82a743e0a44169a8d1479331a1aca2` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:31.859476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff1d93-8066-4c4b-a2c1-a8c513b0bcde admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea82a743e0a44169a8d1479331a1aca2)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:31.861708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff1d93-8066-4c4b-a2c1-a8c513b0bcde admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:31.894778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 931/1849] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:31 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:50:31.899173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21822ad2-03cf-450b-9076-fd8adca51c79 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:31.901320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-21822ad2-03cf-450b-9076-fd8adca51c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:31.915916 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21822ad2-03cf-450b-9076-fd8adca51c79 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:31.921432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a9b9b-709a-4665-8dc6-0b45d6f428c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:31.922359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a9b9b-709a-4665-8dc6-0b45d6f428c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:31.922846 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a9b9b-709a-4665-8dc6-0b45d6f428c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:31.923320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a9b9b-709a-4665-8dc6-0b45d6f428c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:31.924600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a9b9b-709a-4665-8dc6-0b45d6f428c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:31.926445 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a9b9b-709a-4665-8dc6-0b45d6f428c5 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:31.938228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 932/1850] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:50:31.942960 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a9b9b-709a-4665-8dc6-0b45d6f428c5 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:31.954117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a9b9b-709a-4665-8dc6-0b45d6f428c5 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:31.960381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e299a-dc84-45b8-aae7-c323f1142bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:31.961078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e299a-dc84-45b8-aae7-c323f1142bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:31.965803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e299a-dc84-45b8-aae7-c323f1142bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:31.965803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e299a-dc84-45b8-aae7-c323f1142bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:31.965803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e299a-dc84-45b8-aae7-c323f1142bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:31.965803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e299a-dc84-45b8-aae7-c323f1142bf2 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:31.979921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 933/1851] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:31.984890 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e299a-dc84-45b8-aae7-c323f1142bf2 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:31.995069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e299a-dc84-45b8-aae7-c323f1142bf2 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:32.007599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78506bb7-cc4d-41ca-a6f1-37157e08444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:32.008338 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78506bb7-cc4d-41ca-a6f1-37157e08444e admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:32.008617 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78506bb7-cc4d-41ca-a6f1-37157e08444e admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:32.009154 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78506bb7-cc4d-41ca-a6f1-37157e08444e admin admin] PATH_INFO: `/v3/projects/231b1c05e33647e9af7856eb0b46697c/users/3aca3623fcd44ccd816f5854d530fa69/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:32.035720 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78506bb7-cc4d-41ca-a6f1-37157e08444e admin admin] RBAC: Authorizing `identity:create_grant(project_id=231b1c05e33647e9af7856eb0b46697c, user_id=3aca3623fcd44ccd816f5854d530fa69, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:32.038401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78506bb7-cc4d-41ca-a6f1-37157e08444e admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:32.097946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9cff1d93-8066-4c4b-a2c1-a8c513b0bcde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea82a743e0a44169a8d1479331a1aca2'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:32.121757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9cff1d93-8066-4c4b-a2c1-a8c513b0bcde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea82a743e0a44169a8d1479331a1aca2'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:32.131259 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 934/1852] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:31 2022] PUT /identity/v3/projects/231b1c05e33647e9af7856eb0b46697c/users/3aca3623fcd44ccd816f5854d530fa69/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:32.132451 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78506bb7-cc4d-41ca-a6f1-37157e08444e admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:32.134487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-78506bb7-cc4d-41ca-a6f1-37157e08444e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:32.215184 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78506bb7-cc4d-41ca-a6f1-37157e08444e admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:32.220196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd18863-16ef-448c-9c09-7bc5d543afff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:32.220841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd18863-16ef-448c-9c09-7bc5d543afff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:32.221127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd18863-16ef-448c-9c09-7bc5d543afff admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:32.221401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd18863-16ef-448c-9c09-7bc5d543afff admin admin] PATH_INFO: `/v3/users/ef2e23a07f6d43158cc6187dc3e27f50` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:32.222590 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd18863-16ef-448c-9c09-7bc5d543afff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef2e23a07f6d43158cc6187dc3e27f50)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:32.224557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd18863-16ef-448c-9c09-7bc5d543afff admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:32.229560 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9cff1d93-8066-4c4b-a2c1-a8c513b0bcde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea82a743e0a44169a8d1479331a1aca2'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:32.230124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9cff1d93-8066-4c4b-a2c1-a8c513b0bcde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea82a743e0a44169a8d1479331a1aca2'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:32.230770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9cff1d93-8066-4c4b-a2c1-a8c513b0bcde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea82a743e0a44169a8d1479331a1aca2'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:32.244058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:32.254393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 919/1853] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:31 2022] DELETE /identity/v3/users/ea82a743e0a44169a8d1479331a1aca2 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:32.255923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9234e97-53eb-4021-bd02-fa3616446444 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:32.256251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9234e97-53eb-4021-bd02-fa3616446444 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:32.256524 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9234e97-53eb-4021-bd02-fa3616446444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:32.289119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-b9234e97-53eb-4021-bd02-fa3616446444 None None] MFA Rules not processed for user `3aca3623fcd44ccd816f5854d530fa69`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:32.290413 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b9234e97-53eb-4021-bd02-fa3616446444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:32.424292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 920/1854] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:32.428904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9234e97-53eb-4021-bd02-fa3616446444 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:32.430222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b9234e97-53eb-4021-bd02-fa3616446444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:32.462392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-fbd18863-16ef-448c-9c09-7bc5d543afff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef2e23a07f6d43158cc6187dc3e27f50'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:32.464484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-fbd18863-16ef-448c-9c09-7bc5d543afff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef2e23a07f6d43158cc6187dc3e27f50'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:32.511562 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9234e97-53eb-4021-bd02-fa3616446444 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:32.519465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc928a5b-5e08-4dad-9cf4-6390adc07d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:32.519563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc928a5b-5e08-4dad-9cf4-6390adc07d73 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:32.520357 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc928a5b-5e08-4dad-9cf4-6390adc07d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:32.520623 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc928a5b-5e08-4dad-9cf4-6390adc07d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:32.521345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc928a5b-5e08-4dad-9cf4-6390adc07d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:32.524556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc928a5b-5e08-4dad-9cf4-6390adc07d73 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:32.567030 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-fbd18863-16ef-448c-9c09-7bc5d543afff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef2e23a07f6d43158cc6187dc3e27f50'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:32.568075 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-fbd18863-16ef-448c-9c09-7bc5d543afff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef2e23a07f6d43158cc6187dc3e27f50'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:32.613159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-fbd18863-16ef-448c-9c09-7bc5d543afff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef2e23a07f6d43158cc6187dc3e27f50'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:32.628606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 935/1855] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:32 2022] DELETE /identity/v3/users/ef2e23a07f6d43158cc6187dc3e27f50 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:32.632925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 921/1856] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:32 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:50:32.636693 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bad51-7c32-41a1-8fa7-5cc1b3c27335 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:32.637334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bad51-7c32-41a1-8fa7-5cc1b3c27335 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:32.637665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc928a5b-5e08-4dad-9cf4-6390adc07d73 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:32.637990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bad51-7c32-41a1-8fa7-5cc1b3c27335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:32.641509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-dc928a5b-5e08-4dad-9cf4-6390adc07d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:32.687305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-f97bad51-7c32-41a1-8fa7-5cc1b3c27335 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:32.689939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f97bad51-7c32-41a1-8fa7-5cc1b3c27335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:32.762354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc928a5b-5e08-4dad-9cf4-6390adc07d73 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:32.768079 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1f712-5a9b-46f3-a300-517f1e6e84a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:32.768731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1f712-5a9b-46f3-a300-517f1e6e84a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:32.769016 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1f712-5a9b-46f3-a300-517f1e6e84a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:32.769294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1f712-5a9b-46f3-a300-517f1e6e84a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:32.769935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1f712-5a9b-46f3-a300-517f1e6e84a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:32.772158 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1f712-5a9b-46f3-a300-517f1e6e84a5 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:32.798243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 936/1857] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:32.810974 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bad51-7c32-41a1-8fa7-5cc1b3c27335 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:32.812627 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f97bad51-7c32-41a1-8fa7-5cc1b3c27335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:32.871671 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bad51-7c32-41a1-8fa7-5cc1b3c27335 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:32.875997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7490e4-d135-4c66-88b1-21dd51d3af3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:32.876672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7490e4-d135-4c66-88b1-21dd51d3af3d service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:32.876963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7490e4-d135-4c66-88b1-21dd51d3af3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:32.877989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7490e4-d135-4c66-88b1-21dd51d3af3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:32.889757 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7490e4-d135-4c66-88b1-21dd51d3af3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:32.891242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7490e4-d135-4c66-88b1-21dd51d3af3d service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:32.904337 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 937/1858] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:50:32.909292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7490e4-d135-4c66-88b1-21dd51d3af3d service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:32.910919 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4c7490e4-d135-4c66-88b1-21dd51d3af3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:32.919002 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 922/1859] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:32 2022] POST /identity/v3/users => generated 296 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:32.924499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1f712-5a9b-46f3-a300-517f1e6e84a5 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:32.936780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7490e4-d135-4c66-88b1-21dd51d3af3d service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:32.942232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15655ff3-e4ff-436e-988d-6e8d15b9f171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:32.943174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15655ff3-e4ff-436e-988d-6e8d15b9f171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:32.943921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15655ff3-e4ff-436e-988d-6e8d15b9f171 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:32.944441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15655ff3-e4ff-436e-988d-6e8d15b9f171 admin admin] PATH_INFO: `/v3/projects/f27ad4cb5f514ac293b801b9b368cae9` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:32.946160 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15655ff3-e4ff-436e-988d-6e8d15b9f171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27ad4cb5f514ac293b801b9b368cae9)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:32.947943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1f712-5a9b-46f3-a300-517f1e6e84a5 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:32.948838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15655ff3-e4ff-436e-988d-6e8d15b9f171 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:32.972511 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75425604-4fd7-4868-8bd4-8a5b134b0f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:32.973146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75425604-4fd7-4868-8bd4-8a5b134b0f85 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:32.973441 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75425604-4fd7-4868-8bd4-8a5b134b0f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:32.973713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75425604-4fd7-4868-8bd4-8a5b134b0f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:32.974654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75425604-4fd7-4868-8bd4-8a5b134b0f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:32.976302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75425604-4fd7-4868-8bd4-8a5b134b0f85 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:32.993067 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 923/1860] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:32.998308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75425604-4fd7-4868-8bd4-8a5b134b0f85 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:33.013326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75425604-4fd7-4868-8bd4-8a5b134b0f85 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:33.017368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bf37b-8554-412f-ae3d-18605d676cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:33.018236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bf37b-8554-412f-ae3d-18605d676cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:33.018697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bf37b-8554-412f-ae3d-18605d676cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:33.019401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bf37b-8554-412f-ae3d-18605d676cf1 admin admin] PATH_INFO: `/v3/projects/1ef981fcacba4b5a94fc0a26498cd3b7/users/2d2c0428fa68419bb56b8154c4761c92/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:33.036622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bf37b-8554-412f-ae3d-18605d676cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef981fcacba4b5a94fc0a26498cd3b7, user_id=2d2c0428fa68419bb56b8154c4761c92, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:33.039474 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bf37b-8554-412f-ae3d-18605d676cf1 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:33.093694 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:33.099425 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 924/1861] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:32 2022] PUT /identity/v3/projects/1ef981fcacba4b5a94fc0a26498cd3b7/users/2d2c0428fa68419bb56b8154c4761c92/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:33.104000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bf37b-8554-412f-ae3d-18605d676cf1 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:33.122165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-15655ff3-e4ff-436e-988d-6e8d15b9f171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27ad4cb5f514ac293b801b9b368cae9', 'request_id': 'req-15655ff3-e4ff-436e-988d-6e8d15b9f171'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:33.130994 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-15655ff3-e4ff-436e-988d-6e8d15b9f171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27ad4cb5f514ac293b801b9b368cae9', 'request_id': 'req-15655ff3-e4ff-436e-988d-6e8d15b9f171'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:33.211591 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-15655ff3-e4ff-436e-988d-6e8d15b9f171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27ad4cb5f514ac293b801b9b368cae9', 'request_id': 'req-15655ff3-e4ff-436e-988d-6e8d15b9f171'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:33.226416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-15655ff3-e4ff-436e-988d-6e8d15b9f171 admin admin] The token cache is being invalidate because project f27ad4cb5f514ac293b801b9b368cae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:33.226614 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-15655ff3-e4ff-436e-988d-6e8d15b9f171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:33.227305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-15655ff3-e4ff-436e-988d-6e8d15b9f171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:33.229264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 938/1862] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:32 2022] DELETE /identity/v3/projects/f27ad4cb5f514ac293b801b9b368cae9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:33.230170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15655ff3-e4ff-436e-988d-6e8d15b9f171 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:33.234267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-15655ff3-e4ff-436e-988d-6e8d15b9f171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:33.254766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bf37b-8554-412f-ae3d-18605d676cf1 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:33.318971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15655ff3-e4ff-436e-988d-6e8d15b9f171 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:33.324143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64541f4a-594f-454c-84f3-bc0576152a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:33.324970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64541f4a-594f-454c-84f3-bc0576152a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:33.325400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64541f4a-594f-454c-84f3-bc0576152a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:33.325878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64541f4a-594f-454c-84f3-bc0576152a52 admin admin] PATH_INFO: `/v3/users/61bf4c3fe10a434eadd7702c015ba618` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:33.327044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64541f4a-594f-454c-84f3-bc0576152a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61bf4c3fe10a434eadd7702c015ba618)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:33.329042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64541f4a-594f-454c-84f3-bc0576152a52 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:33.363895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91073321-cc69-40bc-9a37-81db52a22a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:33.364576 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91073321-cc69-40bc-9a37-81db52a22a67 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:33.365388 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91073321-cc69-40bc-9a37-81db52a22a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:33.365810 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91073321-cc69-40bc-9a37-81db52a22a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:33.366480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91073321-cc69-40bc-9a37-81db52a22a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:33.368273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91073321-cc69-40bc-9a37-81db52a22a67 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:33.383583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 925/1863] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:33.383583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc042e-0545-4c3d-b5a3-fa54ac85b258 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:33.383583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc042e-0545-4c3d-b5a3-fa54ac85b258 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:33.383583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc042e-0545-4c3d-b5a3-fa54ac85b258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:33.405629 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-e0bc042e-0545-4c3d-b5a3-fa54ac85b258 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:33.406886 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e0bc042e-0545-4c3d-b5a3-fa54ac85b258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:33.416724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 926/1864] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:33.417411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc042e-0545-4c3d-b5a3-fa54ac85b258 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:33.433436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e0bc042e-0545-4c3d-b5a3-fa54ac85b258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:33.456623 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc042e-0545-4c3d-b5a3-fa54ac85b258 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:33.461450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2436c-8858-4f37-b7b8-6eb3a0702873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:33.462117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2436c-8858-4f37-b7b8-6eb3a0702873 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:33.462401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2436c-8858-4f37-b7b8-6eb3a0702873 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:33.462691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2436c-8858-4f37-b7b8-6eb3a0702873 admin admin] PATH_INFO: `/v3/projects/1ef981fcacba4b5a94fc0a26498cd3b7/users/2d2c0428fa68419bb56b8154c4761c92/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:33.464751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2436c-8858-4f37-b7b8-6eb3a0702873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef981fcacba4b5a94fc0a26498cd3b7, user_id=2d2c0428fa68419bb56b8154c4761c92, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:33.468340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2436c-8858-4f37-b7b8-6eb3a0702873 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:33.478735 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 927/1865] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:33 2022] PUT /identity/v3/projects/1ef981fcacba4b5a94fc0a26498cd3b7/users/2d2c0428fa68419bb56b8154c4761c92/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:33.479939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7028f4-15a5-4e5d-b4e1-a756c043bbcd None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:33.480253 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7028f4-15a5-4e5d-b4e1-a756c043bbcd None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:33.484345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7028f4-15a5-4e5d-b4e1-a756c043bbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:33.501245 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-de7028f4-15a5-4e5d-b4e1-a756c043bbcd None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:33.502452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-de7028f4-15a5-4e5d-b4e1-a756c043bbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:33.527304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-64541f4a-594f-454c-84f3-bc0576152a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61bf4c3fe10a434eadd7702c015ba618'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:33.528047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-64541f4a-594f-454c-84f3-bc0576152a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61bf4c3fe10a434eadd7702c015ba618'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:33.566162 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 928/1866] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:33.569188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73be97-3030-47a9-8ac6-936c05beb316 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:33.569188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73be97-3030-47a9-8ac6-936c05beb316 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:33.569188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73be97-3030-47a9-8ac6-936c05beb316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:33.600257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-1e73be97-3030-47a9-8ac6-936c05beb316 None None] MFA Rules not processed for user `2d2c0428fa68419bb56b8154c4761c92`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:33.601472 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1e73be97-3030-47a9-8ac6-936c05beb316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:33.638106 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-64541f4a-594f-454c-84f3-bc0576152a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61bf4c3fe10a434eadd7702c015ba618'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:33.638106 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-64541f4a-594f-454c-84f3-bc0576152a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61bf4c3fe10a434eadd7702c015ba618'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:33.655816 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-64541f4a-594f-454c-84f3-bc0576152a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61bf4c3fe10a434eadd7702c015ba618'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:33.674027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 939/1867] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:33 2022] DELETE /identity/v3/users/61bf4c3fe10a434eadd7702c015ba618 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:33.674873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64541f4a-594f-454c-84f3-bc0576152a52 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:33.676253 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-64541f4a-594f-454c-84f3-bc0576152a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:33.695608 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 929/1868] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:33.697314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73be97-3030-47a9-8ac6-936c05beb316 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:33.721308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73be97-3030-47a9-8ac6-936c05beb316 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:33.793208 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64541f4a-594f-454c-84f3-bc0576152a52 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:33.799408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8cd20-6130-4af0-9a77-9d05f7d5d258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:33.800121 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8cd20-6130-4af0-9a77-9d05f7d5d258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:33.800421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8cd20-6130-4af0-9a77-9d05f7d5d258 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:33.800852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8cd20-6130-4af0-9a77-9d05f7d5d258 admin admin] PATH_INFO: `/v3/projects/de1bc1793dfa4ea49bc4323088deb41d` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:33.802215 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8cd20-6130-4af0-9a77-9d05f7d5d258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de1bc1793dfa4ea49bc4323088deb41d)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:33.804254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8cd20-6130-4af0-9a77-9d05f7d5d258 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:33.811695 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfe855-85ad-487c-adc7-c5fba01d5870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:33.812639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfe855-85ad-487c-adc7-c5fba01d5870 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:33.812926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfe855-85ad-487c-adc7-c5fba01d5870 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:33.813257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfe855-85ad-487c-adc7-c5fba01d5870 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:33.813932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfe855-85ad-487c-adc7-c5fba01d5870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:33.814286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfe855-85ad-487c-adc7-c5fba01d5870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:33.816352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfe855-85ad-487c-adc7-c5fba01d5870 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:33.829945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 930/1869] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:50:33.832444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bc01c-8e0b-491c-ac39-ee600f4c66fc None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:33.832444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bc01c-8e0b-491c-ac39-ee600f4c66fc None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:33.832444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bc01c-8e0b-491c-ac39-ee600f4c66fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:33.853844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-4a7bc01c-8e0b-491c-ac39-ee600f4c66fc None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:33.855748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-4a7bc01c-8e0b-491c-ac39-ee600f4c66fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:33.864319 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 931/1870] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:33.868251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bc01c-8e0b-491c-ac39-ee600f4c66fc None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:33.869673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-4a7bc01c-8e0b-491c-ac39-ee600f4c66fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:33.927901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bc01c-8e0b-491c-ac39-ee600f4c66fc None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:33.931549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01ed26-80a6-4fb5-bbd1-f02619b81e51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:33.932187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01ed26-80a6-4fb5-bbd1-f02619b81e51 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:33.932478 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01ed26-80a6-4fb5-bbd1-f02619b81e51 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:33.932755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01ed26-80a6-4fb5-bbd1-f02619b81e51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:33.956336 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-66f8cd20-6130-4af0-9a77-9d05f7d5d258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de1bc1793dfa4ea49bc4323088deb41d', 'request_id': 'req-66f8cd20-6130-4af0-9a77-9d05f7d5d258'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:33.962603 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-66f8cd20-6130-4af0-9a77-9d05f7d5d258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de1bc1793dfa4ea49bc4323088deb41d', 'request_id': 'req-66f8cd20-6130-4af0-9a77-9d05f7d5d258'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:33.993314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01ed26-80a6-4fb5-bbd1-f02619b81e51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:33.997171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01ed26-80a6-4fb5-bbd1-f02619b81e51 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:34.008783 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 932/1871] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:34.010510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01ed26-80a6-4fb5-bbd1-f02619b81e51 service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:34.029177 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01ed26-80a6-4fb5-bbd1-f02619b81e51 service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:34.052627 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-66f8cd20-6130-4af0-9a77-9d05f7d5d258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de1bc1793dfa4ea49bc4323088deb41d', 'request_id': 'req-66f8cd20-6130-4af0-9a77-9d05f7d5d258'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:34.077743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-66f8cd20-6130-4af0-9a77-9d05f7d5d258 admin admin] The token cache is being invalidate because project de1bc1793dfa4ea49bc4323088deb41d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:34.078284 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-66f8cd20-6130-4af0-9a77-9d05f7d5d258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:34.079155 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-66f8cd20-6130-4af0-9a77-9d05f7d5d258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:34.080907 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 940/1872] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:33 2022] DELETE /identity/v3/projects/de1bc1793dfa4ea49bc4323088deb41d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:34.084657 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8cd20-6130-4af0-9a77-9d05f7d5d258 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:34.086340 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-66f8cd20-6130-4af0-9a77-9d05f7d5d258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:34.096897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b07a08-0600-4bb3-8c61-90f0bcc2d390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:34.098007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b07a08-0600-4bb3-8c61-90f0bcc2d390 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:34.098520 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b07a08-0600-4bb3-8c61-90f0bcc2d390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:34.098995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b07a08-0600-4bb3-8c61-90f0bcc2d390 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:34.099829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b07a08-0600-4bb3-8c61-90f0bcc2d390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:34.101980 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b07a08-0600-4bb3-8c61-90f0bcc2d390 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:34.167878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8cd20-6130-4af0-9a77-9d05f7d5d258 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:34.177016 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a46010-6a6e-46ab-bbde-f29feb64b9b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:34.178930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a46010-6a6e-46ab-bbde-f29feb64b9b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:34.178930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a46010-6a6e-46ab-bbde-f29feb64b9b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:34.179943 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a46010-6a6e-46ab-bbde-f29feb64b9b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:34.182715 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-17a46010-6a6e-46ab-bbde-f29feb64b9b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:34.198583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a46010-6a6e-46ab-bbde-f29feb64b9b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:34.200291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a46010-6a6e-46ab-bbde-f29feb64b9b5 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:34.212437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 941/1873] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:34.213531 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a46010-6a6e-46ab-bbde-f29feb64b9b5 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:34.214929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-17a46010-6a6e-46ab-bbde-f29feb64b9b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:34.227752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a46010-6a6e-46ab-bbde-f29feb64b9b5 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:34.233960 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2bd01-3888-402e-8858-7c032a0e5a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:34.234746 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2bd01-3888-402e-8858-7c032a0e5a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:34.243662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2bd01-3888-402e-8858-7c032a0e5a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:34.243662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2bd01-3888-402e-8858-7c032a0e5a0b admin admin] PATH_INFO: `/v3/users/3a2e65caf08c4dd59be07f3af0223adc` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:34.243662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2bd01-3888-402e-8858-7c032a0e5a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2e65caf08c4dd59be07f3af0223adc)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:34.243662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2bd01-3888-402e-8858-7c032a0e5a0b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:34.244019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 933/1874] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:34 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:34.244019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b07a08-0600-4bb3-8c61-90f0bcc2d390 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:34.244019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a2b07a08-0600-4bb3-8c61-90f0bcc2d390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:34.356003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b07a08-0600-4bb3-8c61-90f0bcc2d390 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:34.363157 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658856e-c5d6-46f1-a6db-da62a4786f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:34.363829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658856e-c5d6-46f1-a6db-da62a4786f31 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:34.364137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658856e-c5d6-46f1-a6db-da62a4786f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:34.366310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658856e-c5d6-46f1-a6db-da62a4786f31 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:34.366310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658856e-c5d6-46f1-a6db-da62a4786f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:34.367523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658856e-c5d6-46f1-a6db-da62a4786f31 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:34.435978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d9c2bd01-3888-402e-8858-7c032a0e5a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2e65caf08c4dd59be07f3af0223adc'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:34.436945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d9c2bd01-3888-402e-8858-7c032a0e5a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2e65caf08c4dd59be07f3af0223adc'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:34.490870 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 934/1875] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:34 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:34.497159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658856e-c5d6-46f1-a6db-da62a4786f31 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:34.501051 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-2658856e-c5d6-46f1-a6db-da62a4786f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:34.509742 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d9c2bd01-3888-402e-8858-7c032a0e5a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2e65caf08c4dd59be07f3af0223adc'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:34.510477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d9c2bd01-3888-402e-8858-7c032a0e5a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2e65caf08c4dd59be07f3af0223adc'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:34.531762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d9c2bd01-3888-402e-8858-7c032a0e5a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2e65caf08c4dd59be07f3af0223adc'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:34.531973 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658856e-c5d6-46f1-a6db-da62a4786f31 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:34.551715 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da599c-6a8b-4bd0-8c62-d05cf3ffb809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:34.552116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da599c-6a8b-4bd0-8c62-d05cf3ffb809 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:34.552409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da599c-6a8b-4bd0-8c62-d05cf3ffb809 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:34.552689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da599c-6a8b-4bd0-8c62-d05cf3ffb809 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:34.553346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da599c-6a8b-4bd0-8c62-d05cf3ffb809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:34.556559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da599c-6a8b-4bd0-8c62-d05cf3ffb809 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:34.558145 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 942/1876] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:34 2022] DELETE /identity/v3/users/3a2e65caf08c4dd59be07f3af0223adc => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:34.590722 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 935/1877] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:34.596235 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2bd01-3888-402e-8858-7c032a0e5a0b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:34.693064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2bd01-3888-402e-8858-7c032a0e5a0b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:34.698643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4392fbf-fb8b-40f0-a557-d802d8942339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:34.699270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4392fbf-fb8b-40f0-a557-d802d8942339 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:34.699553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4392fbf-fb8b-40f0-a557-d802d8942339 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:34.699830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4392fbf-fb8b-40f0-a557-d802d8942339 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:34.700555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4392fbf-fb8b-40f0-a557-d802d8942339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:34.702369 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4392fbf-fb8b-40f0-a557-d802d8942339 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:34.713098 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 943/1878] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:34.717720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da599c-6a8b-4bd0-8c62-d05cf3ffb809 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:34.743362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da599c-6a8b-4bd0-8c62-d05cf3ffb809 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:34.751297 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967bbda-8968-4c95-bb0c-c0c10d268845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:34.753158 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967bbda-8968-4c95-bb0c-c0c10d268845 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:34.753158 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967bbda-8968-4c95-bb0c-c0c10d268845 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:34.753158 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967bbda-8968-4c95-bb0c-c0c10d268845 admin admin] PATH_INFO: `/v3/projects/3b581fcfb8314fd1b827a56cb6b73b38/users/d1dfe5d44cc14eabaf9a9219a496f4e3/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:34.766108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4392fbf-fb8b-40f0-a557-d802d8942339 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:34.771672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f4392fbf-fb8b-40f0-a557-d802d8942339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:34.773471 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967bbda-8968-4c95-bb0c-c0c10d268845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b581fcfb8314fd1b827a56cb6b73b38, user_id=d1dfe5d44cc14eabaf9a9219a496f4e3, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:34.777772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967bbda-8968-4c95-bb0c-c0c10d268845 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:34.797548 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4392fbf-fb8b-40f0-a557-d802d8942339 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:34.803406 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef334-0294-435b-95f0-50c8c1cb7a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:34.804063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef334-0294-435b-95f0-50c8c1cb7a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:34.804393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef334-0294-435b-95f0-50c8c1cb7a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:34.804671 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef334-0294-435b-95f0-50c8c1cb7a77 admin admin] PATH_INFO: `/v3/users/3aca3623fcd44ccd816f5854d530fa69` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:34.805897 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ef334-0294-435b-95f0-50c8c1cb7a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aca3623fcd44ccd816f5854d530fa69)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:34.807846 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ef334-0294-435b-95f0-50c8c1cb7a77 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:34.847482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 936/1879] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:34 2022] PUT /identity/v3/projects/3b581fcfb8314fd1b827a56cb6b73b38/users/d1dfe5d44cc14eabaf9a9219a496f4e3/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:34.858880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73715c-c18e-4ac0-9cc1-5d151ac44895 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:34.859171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73715c-c18e-4ac0-9cc1-5d151ac44895 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:34.859380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73715c-c18e-4ac0-9cc1-5d151ac44895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:34.876458 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:34.911221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-7a73715c-c18e-4ac0-9cc1-5d151ac44895 None None] MFA Rules not processed for user `d1dfe5d44cc14eabaf9a9219a496f4e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:34.913036 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-7a73715c-c18e-4ac0-9cc1-5d151ac44895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:34.949119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:34.987617 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-933ef334-0294-435b-95f0-50c8c1cb7a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aca3623fcd44ccd816f5854d530fa69'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:34.988930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-933ef334-0294-435b-95f0-50c8c1cb7a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aca3623fcd44ccd816f5854d530fa69'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:35.009259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 937/1880] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:35.010611 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73715c-c18e-4ac0-9cc1-5d151ac44895 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:35.081765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-933ef334-0294-435b-95f0-50c8c1cb7a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aca3623fcd44ccd816f5854d530fa69'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:35.085095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-933ef334-0294-435b-95f0-50c8c1cb7a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aca3623fcd44ccd816f5854d530fa69'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:35.095849 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73715c-c18e-4ac0-9cc1-5d151ac44895 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:35.101682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ada71b-0073-43e9-9cf2-caa65f863b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:35.102437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ada71b-0073-43e9-9cf2-caa65f863b78 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:35.102722 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ada71b-0073-43e9-9cf2-caa65f863b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:35.103038 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ada71b-0073-43e9-9cf2-caa65f863b78 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:35.103693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ada71b-0073-43e9-9cf2-caa65f863b78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:35.108131 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ada71b-0073-43e9-9cf2-caa65f863b78 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:35.132175 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-933ef334-0294-435b-95f0-50c8c1cb7a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aca3623fcd44ccd816f5854d530fa69'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:35.146074 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 944/1881] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:34 2022] DELETE /identity/v3/users/3aca3623fcd44ccd816f5854d530fa69 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:35.147111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef334-0294-435b-95f0-50c8c1cb7a77 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:35.148579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-933ef334-0294-435b-95f0-50c8c1cb7a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:35.212705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef334-0294-435b-95f0-50c8c1cb7a77 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:35.218369 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556b33a-37d6-4a56-9671-088b0add3e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:35.218993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556b33a-37d6-4a56-9671-088b0add3e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:35.219274 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556b33a-37d6-4a56-9671-088b0add3e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:35.219548 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556b33a-37d6-4a56-9671-088b0add3e2a admin admin] PATH_INFO: `/v3/projects/674ec1eb54804fb4b8ac32359d07a57d` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:35.220696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556b33a-37d6-4a56-9671-088b0add3e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=674ec1eb54804fb4b8ac32359d07a57d)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:35.222605 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556b33a-37d6-4a56-9671-088b0add3e2a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:35.255743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 938/1882] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:35 2022] POST /identity/v3/projects => generated 379 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:50:35.255743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9fe5f-5433-400d-8f96-ca213c15f0c1 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:35.255743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9fe5f-5433-400d-8f96-ca213c15f0c1 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:35.255743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9fe5f-5433-400d-8f96-ca213c15f0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:35.273528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-9de9fe5f-5433-400d-8f96-ca213c15f0c1 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:35.274733 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9de9fe5f-5433-400d-8f96-ca213c15f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:35.332309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 939/1883] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:35.341166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9fe5f-5433-400d-8f96-ca213c15f0c1 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:35.343290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9de9fe5f-5433-400d-8f96-ca213c15f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:35.356476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9fe5f-5433-400d-8f96-ca213c15f0c1 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:35.366041 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d556b33a-37d6-4a56-9671-088b0add3e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674ec1eb54804fb4b8ac32359d07a57d', 'request_id': 'req-d556b33a-37d6-4a56-9671-088b0add3e2a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:35.372647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d556b33a-37d6-4a56-9671-088b0add3e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674ec1eb54804fb4b8ac32359d07a57d', 'request_id': 'req-d556b33a-37d6-4a56-9671-088b0add3e2a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:35.415053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793cd0a-c7e8-42ad-935c-4dd4b710982f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:35.415689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793cd0a-c7e8-42ad-935c-4dd4b710982f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:35.415974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793cd0a-c7e8-42ad-935c-4dd4b710982f admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:35.416286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793cd0a-c7e8-42ad-935c-4dd4b710982f admin admin] PATH_INFO: `/v3/projects/90c48d0c3b0048a0a9f43f5bcacb17b0` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:35.417439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793cd0a-c7e8-42ad-935c-4dd4b710982f admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c48d0c3b0048a0a9f43f5bcacb17b0)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:35.419341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793cd0a-c7e8-42ad-935c-4dd4b710982f admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:35.464476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d556b33a-37d6-4a56-9671-088b0add3e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674ec1eb54804fb4b8ac32359d07a57d', 'request_id': 'req-d556b33a-37d6-4a56-9671-088b0add3e2a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:35.480017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d556b33a-37d6-4a56-9671-088b0add3e2a admin admin] The token cache is being invalidate because project 674ec1eb54804fb4b8ac32359d07a57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:35.480344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d556b33a-37d6-4a56-9671-088b0add3e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:35.481018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d556b33a-37d6-4a56-9671-088b0add3e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:35.482533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 945/1884] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:35 2022] DELETE /identity/v3/projects/674ec1eb54804fb4b8ac32359d07a57d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:35.483274 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556b33a-37d6-4a56-9671-088b0add3e2a admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:35.484610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d556b33a-37d6-4a56-9671-088b0add3e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:35.497012 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556b33a-37d6-4a56-9671-088b0add3e2a admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:35.502555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2ccfb-2fb9-4127-aa41-9b547b6299f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:35.505494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2ccfb-2fb9-4127-aa41-9b547b6299f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:35.505494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2ccfb-2fb9-4127-aa41-9b547b6299f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:35.505494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2ccfb-2fb9-4127-aa41-9b547b6299f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:35.505494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2ccfb-2fb9-4127-aa41-9b547b6299f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:35.506404 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2ccfb-2fb9-4127-aa41-9b547b6299f3 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:35.538637 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-f793cd0a-c7e8-42ad-935c-4dd4b710982f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c48d0c3b0048a0a9f43f5bcacb17b0', 'request_id': 'req-f793cd0a-c7e8-42ad-935c-4dd4b710982f'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:35.594468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 946/1885] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:35 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:35.595628 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2ccfb-2fb9-4127-aa41-9b547b6299f3 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:35.597735 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-60d2ccfb-2fb9-4127-aa41-9b547b6299f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:35.607489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-f793cd0a-c7e8-42ad-935c-4dd4b710982f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c48d0c3b0048a0a9f43f5bcacb17b0', 'request_id': 'req-f793cd0a-c7e8-42ad-935c-4dd4b710982f'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:35.617808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-f793cd0a-c7e8-42ad-935c-4dd4b710982f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c48d0c3b0048a0a9f43f5bcacb17b0', 'request_id': 'req-f793cd0a-c7e8-42ad-935c-4dd4b710982f'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:35.645939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-f793cd0a-c7e8-42ad-935c-4dd4b710982f admin admin] The token cache is being invalidate because project 90c48d0c3b0048a0a9f43f5bcacb17b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:35.646384 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-f793cd0a-c7e8-42ad-935c-4dd4b710982f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:35.649447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-f793cd0a-c7e8-42ad-935c-4dd4b710982f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:35.649806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 940/1886] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:35 2022] DELETE /identity/v3/projects/90c48d0c3b0048a0a9f43f5bcacb17b0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:35.650892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793cd0a-c7e8-42ad-935c-4dd4b710982f admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:35.653094 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-f793cd0a-c7e8-42ad-935c-4dd4b710982f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:35.666003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2ccfb-2fb9-4127-aa41-9b547b6299f3 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:35.721134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e45cf-f9e6-46f6-a2dd-b6d56cc80fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:35.721700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e45cf-f9e6-46f6-a2dd-b6d56cc80fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:35.722054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e45cf-f9e6-46f6-a2dd-b6d56cc80fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:35.722650 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e45cf-f9e6-46f6-a2dd-b6d56cc80fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:35.725063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-909e45cf-f9e6-46f6-a2dd-b6d56cc80fd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:35.740649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793cd0a-c7e8-42ad-935c-4dd4b710982f admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:35.740738 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e45cf-f9e6-46f6-a2dd-b6d56cc80fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:35.741734 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e45cf-f9e6-46f6-a2dd-b6d56cc80fd5 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:35.744769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff2996-0d26-4fe6-84a9-477be4f3ea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:35.745473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff2996-0d26-4fe6-84a9-477be4f3ea59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:35.745756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff2996-0d26-4fe6-84a9-477be4f3ea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:35.746034 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff2996-0d26-4fe6-84a9-477be4f3ea59 admin admin] PATH_INFO: `/v3/users/e8a03d67e4e0435eb11b1359006ae41a` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:35.747266 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff2996-0d26-4fe6-84a9-477be4f3ea59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a03d67e4e0435eb11b1359006ae41a)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:35.750571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff2996-0d26-4fe6-84a9-477be4f3ea59 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:35.755988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 947/1887] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:35.765701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e45cf-f9e6-46f6-a2dd-b6d56cc80fd5 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:35.767231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-909e45cf-f9e6-46f6-a2dd-b6d56cc80fd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:35.782208 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e45cf-f9e6-46f6-a2dd-b6d56cc80fd5 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:35.787513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79772d-2bd3-4a51-b7bc-6da3f1546c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:35.788257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79772d-2bd3-4a51-b7bc-6da3f1546c2c admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:35.788537 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79772d-2bd3-4a51-b7bc-6da3f1546c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:35.789110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79772d-2bd3-4a51-b7bc-6da3f1546c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:35.789518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79772d-2bd3-4a51-b7bc-6da3f1546c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:35.791582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79772d-2bd3-4a51-b7bc-6da3f1546c2c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:35.804190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 948/1888] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:35.804190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c6e63-e45b-4a33-bc47-d08237423136 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:35.805136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c6e63-e45b-4a33-bc47-d08237423136 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:35.805136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c6e63-e45b-4a33-bc47-d08237423136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:35.825784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-df9c6e63-e45b-4a33-bc47-d08237423136 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:35.827493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-df9c6e63-e45b-4a33-bc47-d08237423136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:35.836184 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 949/1889] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:35.837221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c6e63-e45b-4a33-bc47-d08237423136 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:35.847385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c6e63-e45b-4a33-bc47-d08237423136 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:35.853313 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04858d81-91cc-4305-af9d-7c0c2831a08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:35.853946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04858d81-91cc-4305-af9d-7c0c2831a08e admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:35.854217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04858d81-91cc-4305-af9d-7c0c2831a08e admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:35.854489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04858d81-91cc-4305-af9d-7c0c2831a08e admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:35.855138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04858d81-91cc-4305-af9d-7c0c2831a08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:35.856785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04858d81-91cc-4305-af9d-7c0c2831a08e admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:35.867711 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 950/1890] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:35.869068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946ed40-34c2-41b6-931f-910e541a0004 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:35.869472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946ed40-34c2-41b6-931f-910e541a0004 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:35.869848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946ed40-34c2-41b6-931f-910e541a0004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:35.890255 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-e946ed40-34c2-41b6-931f-910e541a0004 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:35.891513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e946ed40-34c2-41b6-931f-910e541a0004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:35.899482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 951/1891] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:35.900245 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946ed40-34c2-41b6-931f-910e541a0004 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:35.909409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946ed40-34c2-41b6-931f-910e541a0004 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:35.914131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a56f5-2bad-462e-8c26-b4eedda19823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:35.914735 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a56f5-2bad-462e-8c26-b4eedda19823 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:35.915010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a56f5-2bad-462e-8c26-b4eedda19823 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:35.915477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a56f5-2bad-462e-8c26-b4eedda19823 admin admin] PATH_INFO: `/v3/projects/f4fc1b67a12e446e99954e86c52cae23/users/ca4203a91e424ee8badd1be5615f741a/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:35.930482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a56f5-2bad-462e-8c26-b4eedda19823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4fc1b67a12e446e99954e86c52cae23, user_id=ca4203a91e424ee8badd1be5615f741a, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:35.933459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a56f5-2bad-462e-8c26-b4eedda19823 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:36.002264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 952/1892] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:35 2022] PUT /identity/v3/projects/f4fc1b67a12e446e99954e86c52cae23/users/ca4203a91e424ee8badd1be5615f741a/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:36.003490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a56f5-2bad-462e-8c26-b4eedda19823 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:36.056708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-e4ff2996-0d26-4fe6-84a9-477be4f3ea59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a03d67e4e0435eb11b1359006ae41a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:36.078698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-e4ff2996-0d26-4fe6-84a9-477be4f3ea59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a03d67e4e0435eb11b1359006ae41a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:36.119936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a56f5-2bad-462e-8c26-b4eedda19823 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:36.126066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c96fc-28d1-499a-9395-afcf17fdf45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:36.126874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c96fc-28d1-499a-9395-afcf17fdf45c admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:36.127690 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c96fc-28d1-499a-9395-afcf17fdf45c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:36.127974 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c96fc-28d1-499a-9395-afcf17fdf45c admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:36.128693 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c96fc-28d1-499a-9395-afcf17fdf45c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:36.129000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c96fc-28d1-499a-9395-afcf17fdf45c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:36.130650 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c96fc-28d1-499a-9395-afcf17fdf45c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:36.142734 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 953/1893] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:50:36.143786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a60609-41b8-4bf9-8941-f2e98107c62e None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:36.144074 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a60609-41b8-4bf9-8941-f2e98107c62e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:36.144377 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a60609-41b8-4bf9-8941-f2e98107c62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:36.177421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-46a60609-41b8-4bf9-8941-f2e98107c62e None None] MFA Rules not processed for user `ca4203a91e424ee8badd1be5615f741a`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:36.178646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-46a60609-41b8-4bf9-8941-f2e98107c62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:36.186364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-e4ff2996-0d26-4fe6-84a9-477be4f3ea59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a03d67e4e0435eb11b1359006ae41a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:36.187186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-e4ff2996-0d26-4fe6-84a9-477be4f3ea59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a03d67e4e0435eb11b1359006ae41a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:36.188307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-e4ff2996-0d26-4fe6-84a9-477be4f3ea59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a03d67e4e0435eb11b1359006ae41a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:36.208741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 941/1894] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:35 2022] DELETE /identity/v3/users/e8a03d67e4e0435eb11b1359006ae41a => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:36.210156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff2996-0d26-4fe6-84a9-477be4f3ea59 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:36.217371 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e4ff2996-0d26-4fe6-84a9-477be4f3ea59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:36.260181 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 954/1895] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:36.261891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a60609-41b8-4bf9-8941-f2e98107c62e None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:36.265130 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-46a60609-41b8-4bf9-8941-f2e98107c62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:36.276608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:36.284079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a60609-41b8-4bf9-8941-f2e98107c62e None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:36.336508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff2996-0d26-4fe6-84a9-477be4f3ea59 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:36.346194 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc03dd4-7d7c-430e-bd13-c9ac026c19d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:36.346642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc03dd4-7d7c-430e-bd13-c9ac026c19d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:36.346927 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc03dd4-7d7c-430e-bd13-c9ac026c19d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:36.347200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc03dd4-7d7c-430e-bd13-c9ac026c19d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:36.348676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc03dd4-7d7c-430e-bd13-c9ac026c19d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:36.350710 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc03dd4-7d7c-430e-bd13-c9ac026c19d9 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:36.395551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa83e37-8993-42b9-ac86-c07766c64ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:36.396362 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83e37-8993-42b9-ac86-c07766c64ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:36.396710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83e37-8993-42b9-ac86-c07766c64ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:36.397058 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83e37-8993-42b9-ac86-c07766c64ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:36.397757 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa83e37-8993-42b9-ac86-c07766c64ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:36.399961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa83e37-8993-42b9-ac86-c07766c64ce2 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:36.472830 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 942/1896] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:36 2022] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:36.473535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc03dd4-7d7c-430e-bd13-c9ac026c19d9 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:36.477665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-4bc03dd4-7d7c-430e-bd13-c9ac026c19d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:36.519108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 955/1897] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:36 2022] POST /identity/v3/projects => generated 379 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:50:36.519108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa83e37-8993-42b9-ac86-c07766c64ce2 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:36.577713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc03dd4-7d7c-430e-bd13-c9ac026c19d9 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:36.630827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa83e37-8993-42b9-ac86-c07766c64ce2 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:36.636323 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0d04c-2187-46bf-bf08-6aacf3618271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:36.636931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0d04c-2187-46bf-bf08-6aacf3618271 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:36.637373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0d04c-2187-46bf-bf08-6aacf3618271 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:36.637654 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0d04c-2187-46bf-bf08-6aacf3618271 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:36.638920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0d04c-2187-46bf-bf08-6aacf3618271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:36.640976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0d04c-2187-46bf-bf08-6aacf3618271 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:36.652977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce300df0-64f8-409a-9423-d404507641d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:36.653535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce300df0-64f8-409a-9423-d404507641d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:36.653848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce300df0-64f8-409a-9423-d404507641d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:36.654130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce300df0-64f8-409a-9423-d404507641d8 admin admin] PATH_INFO: `/v3/projects/231b1c05e33647e9af7856eb0b46697c` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:36.655314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce300df0-64f8-409a-9423-d404507641d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=231b1c05e33647e9af7856eb0b46697c)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:36.657416 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce300df0-64f8-409a-9423-d404507641d8 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:36.804808 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 956/1898] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:36 2022] POST /identity/v3/users => generated 294 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:36.805871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0d04c-2187-46bf-bf08-6aacf3618271 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:36.817043 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0d04c-2187-46bf-bf08-6aacf3618271 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:36.822108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138fa17-0629-4169-894e-6456de040842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:36.822323 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138fa17-0629-4169-894e-6456de040842 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:36.822518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138fa17-0629-4169-894e-6456de040842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:36.822796 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138fa17-0629-4169-894e-6456de040842 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:36.823430 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138fa17-0629-4169-894e-6456de040842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:36.825390 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138fa17-0629-4169-894e-6456de040842 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:36.865837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ce300df0-64f8-409a-9423-d404507641d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231b1c05e33647e9af7856eb0b46697c', 'request_id': 'req-ce300df0-64f8-409a-9423-d404507641d8'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:36.929002 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 957/1899] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:36 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:36.929989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138fa17-0629-4169-894e-6456de040842 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:36.940699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138fa17-0629-4169-894e-6456de040842 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:36.944158 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ce300df0-64f8-409a-9423-d404507641d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231b1c05e33647e9af7856eb0b46697c', 'request_id': 'req-ce300df0-64f8-409a-9423-d404507641d8'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:36.951583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ce300df0-64f8-409a-9423-d404507641d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231b1c05e33647e9af7856eb0b46697c', 'request_id': 'req-ce300df0-64f8-409a-9423-d404507641d8'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:36.964336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ce300df0-64f8-409a-9423-d404507641d8 admin admin] The token cache is being invalidate because project 231b1c05e33647e9af7856eb0b46697c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:36.964628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ce300df0-64f8-409a-9423-d404507641d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:36.965310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ce300df0-64f8-409a-9423-d404507641d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:36.966895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 943/1900] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:36 2022] DELETE /identity/v3/projects/231b1c05e33647e9af7856eb0b46697c => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:36.970514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce300df0-64f8-409a-9423-d404507641d8 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:36.971873 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ce300df0-64f8-409a-9423-d404507641d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:37.011382 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1797d05-7f23-4f8c-a562-c5bc8baa51be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:37.012080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1797d05-7f23-4f8c-a562-c5bc8baa51be admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:37.012515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1797d05-7f23-4f8c-a562-c5bc8baa51be admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:37.013838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1797d05-7f23-4f8c-a562-c5bc8baa51be admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:37.014643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1797d05-7f23-4f8c-a562-c5bc8baa51be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:37.017174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1797d05-7f23-4f8c-a562-c5bc8baa51be admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:37.029376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 958/1901] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:37.030483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1797d05-7f23-4f8c-a562-c5bc8baa51be admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:37.030737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:37.033552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e1797d05-7f23-4f8c-a562-c5bc8baa51be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:37.046952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1797d05-7f23-4f8c-a562-c5bc8baa51be admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:37.050554 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce300df0-64f8-409a-9423-d404507641d8 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:37.052035 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed31777-9746-466c-8997-c7792d379c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:37.052759 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed31777-9746-466c-8997-c7792d379c5d admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:37.053127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed31777-9746-466c-8997-c7792d379c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:37.053500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed31777-9746-466c-8997-c7792d379c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:37.054213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed31777-9746-466c-8997-c7792d379c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:37.055803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed31777-9746-466c-8997-c7792d379c5d admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:37.057444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef8317-776f-4bbc-8784-2cf2c482ec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:37.063542 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef8317-776f-4bbc-8784-2cf2c482ec82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:37.063542 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef8317-776f-4bbc-8784-2cf2c482ec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:37.063542 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef8317-776f-4bbc-8784-2cf2c482ec82 admin admin] PATH_INFO: `/v3/projects/db0414b405344b26925374acb608f81a` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:37.063542 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef8317-776f-4bbc-8784-2cf2c482ec82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0414b405344b26925374acb608f81a)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:37.063542 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef8317-776f-4bbc-8784-2cf2c482ec82 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:37.067277 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 959/1902] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:37.068157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed31777-9746-466c-8997-c7792d379c5d admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:37.071498 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-7ed31777-9746-466c-8997-c7792d379c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:37.084737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed31777-9746-466c-8997-c7792d379c5d admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:37.091181 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08526f8-595f-4840-8efa-c8b175b27b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:37.091841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08526f8-595f-4840-8efa-c8b175b27b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:37.092146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08526f8-595f-4840-8efa-c8b175b27b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:37.092441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08526f8-595f-4840-8efa-c8b175b27b69 admin admin] PATH_INFO: `/v3/users/2d2c0428fa68419bb56b8154c4761c92` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:37.093622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08526f8-595f-4840-8efa-c8b175b27b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d2c0428fa68419bb56b8154c4761c92)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:37.095530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08526f8-595f-4840-8efa-c8b175b27b69 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:37.181193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-30ef8317-776f-4bbc-8784-2cf2c482ec82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0414b405344b26925374acb608f81a', 'request_id': 'req-30ef8317-776f-4bbc-8784-2cf2c482ec82'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:37.275625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-30ef8317-776f-4bbc-8784-2cf2c482ec82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0414b405344b26925374acb608f81a', 'request_id': 'req-30ef8317-776f-4bbc-8784-2cf2c482ec82'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:37.282682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-30ef8317-776f-4bbc-8784-2cf2c482ec82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0414b405344b26925374acb608f81a', 'request_id': 'req-30ef8317-776f-4bbc-8784-2cf2c482ec82'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:37.290477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f08526f8-595f-4840-8efa-c8b175b27b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d2c0428fa68419bb56b8154c4761c92'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:37.291263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f08526f8-595f-4840-8efa-c8b175b27b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d2c0428fa68419bb56b8154c4761c92'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:37.295124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-30ef8317-776f-4bbc-8784-2cf2c482ec82 admin admin] The token cache is being invalidate because project db0414b405344b26925374acb608f81a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:37.295490 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-30ef8317-776f-4bbc-8784-2cf2c482ec82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:37.296247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-30ef8317-776f-4bbc-8784-2cf2c482ec82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:37.297994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 944/1903] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:36 2022] DELETE /identity/v3/projects/db0414b405344b26925374acb608f81a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:37.298971 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef8317-776f-4bbc-8784-2cf2c482ec82 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:37.300296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-30ef8317-776f-4bbc-8784-2cf2c482ec82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:37.361571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f08526f8-595f-4840-8efa-c8b175b27b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d2c0428fa68419bb56b8154c4761c92'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:37.362242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f08526f8-595f-4840-8efa-c8b175b27b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d2c0428fa68419bb56b8154c4761c92'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:37.368403 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef8317-776f-4bbc-8784-2cf2c482ec82 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:37.374109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c76e24-eb54-469a-bf7d-979cee16d427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:37.374726 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c76e24-eb54-469a-bf7d-979cee16d427 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:37.375010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c76e24-eb54-469a-bf7d-979cee16d427 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:37.375290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c76e24-eb54-469a-bf7d-979cee16d427 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:37.375943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c76e24-eb54-469a-bf7d-979cee16d427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:37.377767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c76e24-eb54-469a-bf7d-979cee16d427 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:37.379071 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f08526f8-595f-4840-8efa-c8b175b27b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d2c0428fa68419bb56b8154c4761c92'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:37.388718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 945/1904] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:37.389683 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c76e24-eb54-469a-bf7d-979cee16d427 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:37.393193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d8c76e24-eb54-469a-bf7d-979cee16d427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:37.397539 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 960/1905] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:37 2022] DELETE /identity/v3/users/2d2c0428fa68419bb56b8154c4761c92 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:37.398875 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbe094-fd8a-44b7-9015-7ee1231e1a63 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:37.399168 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbe094-fd8a-44b7-9015-7ee1231e1a63 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:37.399450 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbe094-fd8a-44b7-9015-7ee1231e1a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:37.418268 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c76e24-eb54-469a-bf7d-979cee16d427 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:37.426255 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-8adbe094-fd8a-44b7-9015-7ee1231e1a63 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:37.428314 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8adbe094-fd8a-44b7-9015-7ee1231e1a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:37.516168 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 961/1906] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:37.517061 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbe094-fd8a-44b7-9015-7ee1231e1a63 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:37.527710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbe094-fd8a-44b7-9015-7ee1231e1a63 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:37.532639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98645f-35a3-4bd7-a99b-55a5b294934b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:37.533257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a57f48-7c43-497d-b9c2-ff21da49a65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:37.533491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98645f-35a3-4bd7-a99b-55a5b294934b admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:37.533778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98645f-35a3-4bd7-a99b-55a5b294934b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:37.534059 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98645f-35a3-4bd7-a99b-55a5b294934b admin admin] PATH_INFO: `/v3/projects/a591d8d3f0874473bce9458dfdc5f732/users/ed2de94ba38c4d6285396f14d95678bb/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:37.534166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a57f48-7c43-497d-b9c2-ff21da49a65a admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:37.534459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a57f48-7c43-497d-b9c2-ff21da49a65a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:37.534798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a57f48-7c43-497d-b9c2-ff21da49a65a admin admin] PATH_INFO: `/v3/projects/ab3055ecae1648d7a66cdc16997dbe37/users/6575d7111a9b4dd8b444b11c2f7a6a9c/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:37.552071 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98645f-35a3-4bd7-a99b-55a5b294934b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a591d8d3f0874473bce9458dfdc5f732, user_id=ed2de94ba38c4d6285396f14d95678bb, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:37.552518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a57f48-7c43-497d-b9c2-ff21da49a65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3055ecae1648d7a66cdc16997dbe37, user_id=6575d7111a9b4dd8b444b11c2f7a6a9c, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:37.555046 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98645f-35a3-4bd7-a99b-55a5b294934b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:37.555975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a57f48-7c43-497d-b9c2-ff21da49a65a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:37.643017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 962/1907] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:37 2022] PUT /identity/v3/projects/ab3055ecae1648d7a66cdc16997dbe37/users/6575d7111a9b4dd8b444b11c2f7a6a9c/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:37.644586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767d8d7-e308-4ce8-a85f-fb4e4de2ed31 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:37.644877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767d8d7-e308-4ce8-a85f-fb4e4de2ed31 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:37.645333 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767d8d7-e308-4ce8-a85f-fb4e4de2ed31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:37.653363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 946/1908] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:37 2022] PUT /identity/v3/projects/a591d8d3f0874473bce9458dfdc5f732/users/ed2de94ba38c4d6285396f14d95678bb/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:37.656904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0234d2-e174-45e9-bc2b-cfb8803cfde6 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:37.656904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0234d2-e174-45e9-bc2b-cfb8803cfde6 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:37.656904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0234d2-e174-45e9-bc2b-cfb8803cfde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:37.691355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-e767d8d7-e308-4ce8-a85f-fb4e4de2ed31 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:37.692989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e767d8d7-e308-4ce8-a85f-fb4e4de2ed31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:37.708000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-2f0234d2-e174-45e9-bc2b-cfb8803cfde6 None None] MFA Rules not processed for user `6575d7111a9b4dd8b444b11c2f7a6a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:37.709238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-2f0234d2-e174-45e9-bc2b-cfb8803cfde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:37.782823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 963/1909] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:37.782823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767d8d7-e308-4ce8-a85f-fb4e4de2ed31 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:37.792049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767d8d7-e308-4ce8-a85f-fb4e4de2ed31 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:37.801392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd494f-5179-4e4d-9ca9-567e07501b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:37.802019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd494f-5179-4e4d-9ca9-567e07501b34 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:37.802359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd494f-5179-4e4d-9ca9-567e07501b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:37.802572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd494f-5179-4e4d-9ca9-567e07501b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:37.803225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd494f-5179-4e4d-9ca9-567e07501b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:37.804952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd494f-5179-4e4d-9ca9-567e07501b34 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:37.821484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 964/1910] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:37.822616 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd494f-5179-4e4d-9ca9-567e07501b34 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:37.844151 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd494f-5179-4e4d-9ca9-567e07501b34 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:37.854410 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887614f3-ceae-4102-bdbb-96a276f9ad6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:37.855348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887614f3-ceae-4102-bdbb-96a276f9ad6e admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:37.856369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 947/1911] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:37.856629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887614f3-ceae-4102-bdbb-96a276f9ad6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:37.857131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887614f3-ceae-4102-bdbb-96a276f9ad6e admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:37.857731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0234d2-e174-45e9-bc2b-cfb8803cfde6 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:37.859496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887614f3-ceae-4102-bdbb-96a276f9ad6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:37.860025 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887614f3-ceae-4102-bdbb-96a276f9ad6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:37.865180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887614f3-ceae-4102-bdbb-96a276f9ad6e admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:37.869646 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0234d2-e174-45e9-bc2b-cfb8803cfde6 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:37.873170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:37.876895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bddbd-8f54-4570-8212-4a5a4631fbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:37.883196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bddbd-8f54-4570-8212-4a5a4631fbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:37.884020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bddbd-8f54-4570-8212-4a5a4631fbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:37.884020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bddbd-8f54-4570-8212-4a5a4631fbaf admin admin] PATH_INFO: `/v3/projects/a591d8d3f0874473bce9458dfdc5f732/users/ed2de94ba38c4d6285396f14d95678bb/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:37.885794 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 965/1912] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:50:37.886983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887614f3-ceae-4102-bdbb-96a276f9ad6e admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:37.890127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bddbd-8f54-4570-8212-4a5a4631fbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a591d8d3f0874473bce9458dfdc5f732, user_id=ed2de94ba38c4d6285396f14d95678bb, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:37.894461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bddbd-8f54-4570-8212-4a5a4631fbaf admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:37.902026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887614f3-ceae-4102-bdbb-96a276f9ad6e admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:37.908355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 948/1913] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:37 2022] PUT /identity/v3/projects/a591d8d3f0874473bce9458dfdc5f732/users/ed2de94ba38c4d6285396f14d95678bb/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:37.909737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bddbd-8f54-4570-8212-4a5a4631fbaf admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:37.971459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64365f-88ae-4e8d-bef5-96f6b985e5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:37.972211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64365f-88ae-4e8d-bef5-96f6b985e5db admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:37.972428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64365f-88ae-4e8d-bef5-96f6b985e5db admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:37.973040 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64365f-88ae-4e8d-bef5-96f6b985e5db admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:37.973701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64365f-88ae-4e8d-bef5-96f6b985e5db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:37.975623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64365f-88ae-4e8d-bef5-96f6b985e5db admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:38.018836 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bddbd-8f54-4570-8212-4a5a4631fbaf admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:38.021829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385ab0c-47d8-4c68-a824-43cfe4a93fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:38.022499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385ab0c-47d8-4c68-a824-43cfe4a93fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:38.024423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385ab0c-47d8-4c68-a824-43cfe4a93fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:38.024423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385ab0c-47d8-4c68-a824-43cfe4a93fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:38.024423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385ab0c-47d8-4c68-a824-43cfe4a93fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:38.026206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385ab0c-47d8-4c68-a824-43cfe4a93fc2 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:38.103182 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 966/1914] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:37 2022] POST /identity/v3/projects => generated 389 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:38.103182 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc417c-096f-47d9-852e-5af0bf419b65 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:38.103182 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc417c-096f-47d9-852e-5af0bf419b65 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:38.109104 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc417c-096f-47d9-852e-5af0bf419b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:38.136599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-44fc417c-096f-47d9-852e-5af0bf419b65 None None] MFA Rules not processed for user `ed2de94ba38c4d6285396f14d95678bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:38.141190 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 949/1915] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:37 2022] POST /identity/v3/projects => generated 365 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:38.141771 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-44fc417c-096f-47d9-852e-5af0bf419b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:38.141894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385ab0c-47d8-4c68-a824-43cfe4a93fc2 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:38.142294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8385ab0c-47d8-4c68-a824-43cfe4a93fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:38.248680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 967/1916] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:38.255161 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc417c-096f-47d9-852e-5af0bf419b65 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:38.269129 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc417c-096f-47d9-852e-5af0bf419b65 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:38.269499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385ab0c-47d8-4c68-a824-43cfe4a93fc2 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:38.274553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d2d52-250f-4dd6-aba2-49215aed51fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:38.274745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabcb19-daad-4238-a8fe-59273e6d5d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:38.275363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2d52-250f-4dd6-aba2-49215aed51fc admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:38.275495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabcb19-daad-4238-a8fe-59273e6d5d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:38.275648 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabcb19-daad-4238-a8fe-59273e6d5d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:38.275923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2d52-250f-4dd6-aba2-49215aed51fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:38.276027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabcb19-daad-4238-a8fe-59273e6d5d0e admin admin] PATH_INFO: `/v3/projects/1ef981fcacba4b5a94fc0a26498cd3b7` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:38.276485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2d52-250f-4dd6-aba2-49215aed51fc admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:38.277084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabcb19-daad-4238-a8fe-59273e6d5d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef981fcacba4b5a94fc0a26498cd3b7)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:38.277320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d2d52-250f-4dd6-aba2-49215aed51fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:38.279414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d2d52-250f-4dd6-aba2-49215aed51fc admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:38.279639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabcb19-daad-4238-a8fe-59273e6d5d0e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:38.384547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 968/1917] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:38 2022] POST /identity/v3/users => generated 301 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:38.384547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d2d52-250f-4dd6-aba2-49215aed51fc admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:38.393878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d2d52-250f-4dd6-aba2-49215aed51fc admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:38.398639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8097f88-4458-4747-a9fd-624e9beb00a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:38.399419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8097f88-4458-4747-a9fd-624e9beb00a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:38.399703 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8097f88-4458-4747-a9fd-624e9beb00a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:38.400000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8097f88-4458-4747-a9fd-624e9beb00a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:38.400673 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8097f88-4458-4747-a9fd-624e9beb00a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:38.402624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8097f88-4458-4747-a9fd-624e9beb00a3 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:38.419905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:38.440288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6cabcb19-daad-4238-a8fe-59273e6d5d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef981fcacba4b5a94fc0a26498cd3b7', 'request_id': 'req-6cabcb19-daad-4238-a8fe-59273e6d5d0e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:38.483045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 969/1918] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:38 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:38.483846 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8097f88-4458-4747-a9fd-624e9beb00a3 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:38.488010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d8097f88-4458-4747-a9fd-624e9beb00a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:38.503951 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6cabcb19-daad-4238-a8fe-59273e6d5d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef981fcacba4b5a94fc0a26498cd3b7', 'request_id': 'req-6cabcb19-daad-4238-a8fe-59273e6d5d0e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:38.512509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6cabcb19-daad-4238-a8fe-59273e6d5d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef981fcacba4b5a94fc0a26498cd3b7', 'request_id': 'req-6cabcb19-daad-4238-a8fe-59273e6d5d0e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:38.536957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6cabcb19-daad-4238-a8fe-59273e6d5d0e admin admin] The token cache is being invalidate because project 1ef981fcacba4b5a94fc0a26498cd3b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:38.537377 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6cabcb19-daad-4238-a8fe-59273e6d5d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:38.538144 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6cabcb19-daad-4238-a8fe-59273e6d5d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:38.540843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 950/1919] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:38 2022] DELETE /identity/v3/projects/1ef981fcacba4b5a94fc0a26498cd3b7 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:38.541894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabcb19-daad-4238-a8fe-59273e6d5d0e admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:38.543654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6cabcb19-daad-4238-a8fe-59273e6d5d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:38.602718 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8097f88-4458-4747-a9fd-624e9beb00a3 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:38.633770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabcb19-daad-4238-a8fe-59273e6d5d0e admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:38.639098 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8bdd5-7bb6-4649-9a31-23df23002209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:38.639987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8bdd5-7bb6-4649-9a31-23df23002209 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:38.640363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8bdd5-7bb6-4649-9a31-23df23002209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:38.640693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8bdd5-7bb6-4649-9a31-23df23002209 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:38.641454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8bdd5-7bb6-4649-9a31-23df23002209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:38.643553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8bdd5-7bb6-4649-9a31-23df23002209 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:38.668671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 951/1920] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:38.672958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8bdd5-7bb6-4649-9a31-23df23002209 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:38.678604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-adb8bdd5-7bb6-4649-9a31-23df23002209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:38.678772 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002da9-85c1-4172-8723-c5a07e941870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:38.679307 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002da9-85c1-4172-8723-c5a07e941870 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:38.679640 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002da9-85c1-4172-8723-c5a07e941870 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:38.679917 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002da9-85c1-4172-8723-c5a07e941870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:38.681726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e0002da9-85c1-4172-8723-c5a07e941870 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:38.711867 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8bdd5-7bb6-4649-9a31-23df23002209 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:38.721391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632e56b-6855-41a8-a855-f5dda9f84298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:38.722017 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e56b-6855-41a8-a855-f5dda9f84298 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:38.722346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e56b-6855-41a8-a855-f5dda9f84298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:38.722670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e56b-6855-41a8-a855-f5dda9f84298 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:38.723382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632e56b-6855-41a8-a855-f5dda9f84298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:38.725298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632e56b-6855-41a8-a855-f5dda9f84298 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:38.742161 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 952/1921] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:38.743539 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e5bc3-1190-42eb-8f24-235152ebc9af None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:38.743824 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e5bc3-1190-42eb-8f24-235152ebc9af None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:38.744114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e5bc3-1190-42eb-8f24-235152ebc9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:38.769097 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-ac6e5bc3-1190-42eb-8f24-235152ebc9af None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:38.771829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0002da9-85c1-4172-8723-c5a07e941870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:38.772033 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ac6e5bc3-1190-42eb-8f24-235152ebc9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:38.773621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0002da9-85c1-4172-8723-c5a07e941870 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:38.782290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 953/1922] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:38.784003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e5bc3-1190-42eb-8f24-235152ebc9af None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:38.788756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 970/1923] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:38.794439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002da9-85c1-4172-8723-c5a07e941870 service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:38.797673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e5bc3-1190-42eb-8f24-235152ebc9af None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:38.803162 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7d93c-987c-41b9-82bc-64a33c1e89df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:38.803846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7d93c-987c-41b9-82bc-64a33c1e89df admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:38.804167 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7d93c-987c-41b9-82bc-64a33c1e89df admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:38.804449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7d93c-987c-41b9-82bc-64a33c1e89df admin admin] PATH_INFO: `/v3/projects/9bc0a7f50f6c439da3ec4f4eb41417e7/users/50bf717ac8d746a9825bb326b4e2e744/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:38.807975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002da9-85c1-4172-8723-c5a07e941870 service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:38.813856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef388a-1ccb-4a3e-9903-689c98633dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:38.814468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef388a-1ccb-4a3e-9903-689c98633dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:38.814769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef388a-1ccb-4a3e-9903-689c98633dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:38.815046 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef388a-1ccb-4a3e-9903-689c98633dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:38.815874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef388a-1ccb-4a3e-9903-689c98633dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:38.818626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef388a-1ccb-4a3e-9903-689c98633dd4 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:38.834592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 971/1924] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:38.834592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534486b-add5-4582-8055-60339543489f None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:38.834838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534486b-add5-4582-8055-60339543489f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:38.836487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534486b-add5-4582-8055-60339543489f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:38.838737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7d93c-987c-41b9-82bc-64a33c1e89df admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc0a7f50f6c439da3ec4f4eb41417e7, user_id=50bf717ac8d746a9825bb326b4e2e744, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:38.841797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7d93c-987c-41b9-82bc-64a33c1e89df admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:38.857771 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-b534486b-add5-4582-8055-60339543489f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:38.858960 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b534486b-add5-4582-8055-60339543489f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:38.867349 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 972/1925] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:38.868239 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534486b-add5-4582-8055-60339543489f None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:38.879456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534486b-add5-4582-8055-60339543489f None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:38.884816 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6318ac-4cfd-46cf-98d5-98fb64e27a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:38.885773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6318ac-4cfd-46cf-98d5-98fb64e27a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:38.885773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6318ac-4cfd-46cf-98d5-98fb64e27a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:38.885967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6318ac-4cfd-46cf-98d5-98fb64e27a7f admin admin] PATH_INFO: `/v3/projects/d523d9be2d0c43e8943ba841a4beac55/users/65c6981a7fab453fb482cecd9986b9ae/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:38.914624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6318ac-4cfd-46cf-98d5-98fb64e27a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d523d9be2d0c43e8943ba841a4beac55, user_id=65c6981a7fab453fb482cecd9986b9ae, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:38.918515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6318ac-4cfd-46cf-98d5-98fb64e27a7f admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:38.961078 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 954/1926] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:38 2022] PUT /identity/v3/projects/9bc0a7f50f6c439da3ec4f4eb41417e7/users/50bf717ac8d746a9825bb326b4e2e744/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:38.961078 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7d93c-987c-41b9-82bc-64a33c1e89df admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:39.007840 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 973/1927] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:38 2022] PUT /identity/v3/projects/d523d9be2d0c43e8943ba841a4beac55/users/65c6981a7fab453fb482cecd9986b9ae/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:39.009179 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6318ac-4cfd-46cf-98d5-98fb64e27a7f admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:39.011269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8c6318ac-4cfd-46cf-98d5-98fb64e27a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:39.033901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7d93c-987c-41b9-82bc-64a33c1e89df admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:39.104597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6318ac-4cfd-46cf-98d5-98fb64e27a7f admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:39.109694 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f6663-ecf3-4d3c-9860-32cf7342e8da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:39.110716 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f6663-ecf3-4d3c-9860-32cf7342e8da service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.111205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f6663-ecf3-4d3c-9860-32cf7342e8da service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.111686 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f6663-ecf3-4d3c-9860-32cf7342e8da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:39.113784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-923f6663-ecf3-4d3c-9860-32cf7342e8da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:39.123865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81c1eb-a6a6-4381-8f66-11f2acf6bd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:39.124556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81c1eb-a6a6-4381-8f66-11f2acf6bd3d admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.124835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81c1eb-a6a6-4381-8f66-11f2acf6bd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.125107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81c1eb-a6a6-4381-8f66-11f2acf6bd3d admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:39.125832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81c1eb-a6a6-4381-8f66-11f2acf6bd3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:39.126284 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81c1eb-a6a6-4381-8f66-11f2acf6bd3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:39.136215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81c1eb-a6a6-4381-8f66-11f2acf6bd3d admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:39.141618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 955/1928] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:50:39.145575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81c1eb-a6a6-4381-8f66-11f2acf6bd3d admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:39.157945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81c1eb-a6a6-4381-8f66-11f2acf6bd3d admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:39.163405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:39.171272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7b2e0-6250-4e46-a499-d14d24e6ded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:39.173202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7b2e0-6250-4e46-a499-d14d24e6ded3 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.173202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7b2e0-6250-4e46-a499-d14d24e6ded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.173202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7b2e0-6250-4e46-a499-d14d24e6ded3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:39.173202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7b2e0-6250-4e46-a499-d14d24e6ded3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:39.175834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7b2e0-6250-4e46-a499-d14d24e6ded3 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:39.192265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 956/1929] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:39.194442 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96dd56-4e5a-4cd0-92fc-e49ddd0a256c None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.194802 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96dd56-4e5a-4cd0-92fc-e49ddd0a256c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.195029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96dd56-4e5a-4cd0-92fc-e49ddd0a256c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:39.212381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f6663-ecf3-4d3c-9860-32cf7342e8da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:39.213927 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f6663-ecf3-4d3c-9860-32cf7342e8da service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:39.227925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 974/1930] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:39.229118 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f6663-ecf3-4d3c-9860-32cf7342e8da service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:39.244401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-9a96dd56-4e5a-4cd0-92fc-e49ddd0a256c None None] MFA Rules not processed for user `65c6981a7fab453fb482cecd9986b9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:39.248981 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9a96dd56-4e5a-4cd0-92fc-e49ddd0a256c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:39.280658 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f6663-ecf3-4d3c-9860-32cf7342e8da service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:39.285995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fd9f3-27d3-45d0-ad68-785b78116f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:39.286623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fd9f3-27d3-45d0-ad68-785b78116f31 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.286909 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fd9f3-27d3-45d0-ad68-785b78116f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.287187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fd9f3-27d3-45d0-ad68-785b78116f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:39.288452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fd9f3-27d3-45d0-ad68-785b78116f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:39.291024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fd9f3-27d3-45d0-ad68-785b78116f31 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:39.336804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 957/1931] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:39.338307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96dd56-4e5a-4cd0-92fc-e49ddd0a256c None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:39.350829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96dd56-4e5a-4cd0-92fc-e49ddd0a256c None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:39.361610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e590eb-84c9-48ca-bf8c-6f5d53f05ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:39.362816 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e590eb-84c9-48ca-bf8c-6f5d53f05ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.363283 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e590eb-84c9-48ca-bf8c-6f5d53f05ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.363739 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e590eb-84c9-48ca-bf8c-6f5d53f05ddd admin admin] PATH_INFO: `/v3/projects/9bc0a7f50f6c439da3ec4f4eb41417e7/users/50bf717ac8d746a9825bb326b4e2e744/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:39.366115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e590eb-84c9-48ca-bf8c-6f5d53f05ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc0a7f50f6c439da3ec4f4eb41417e7, user_id=50bf717ac8d746a9825bb326b4e2e744, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:39.369077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e590eb-84c9-48ca-bf8c-6f5d53f05ddd admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:39.383841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 958/1932] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:39 2022] PUT /identity/v3/projects/9bc0a7f50f6c439da3ec4f4eb41417e7/users/50bf717ac8d746a9825bb326b4e2e744/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:39.384702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e590eb-84c9-48ca-bf8c-6f5d53f05ddd admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:39.435536 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 975/1933] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:39 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:39.436886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e63e35-e1d8-44e2-9b7f-ae215aca6577 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.437179 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e63e35-e1d8-44e2-9b7f-ae215aca6577 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.437458 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e63e35-e1d8-44e2-9b7f-ae215aca6577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:39.498270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e590eb-84c9-48ca-bf8c-6f5d53f05ddd admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:39.499356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-97e63e35-e1d8-44e2-9b7f-ae215aca6577 None None] MFA Rules not processed for user `50bf717ac8d746a9825bb326b4e2e744`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:39.501655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-97e63e35-e1d8-44e2-9b7f-ae215aca6577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:39.615346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f98d04-1ada-499b-b63b-11de5bd3d358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:39.615978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f98d04-1ada-499b-b63b-11de5bd3d358 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.616292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f98d04-1ada-499b-b63b-11de5bd3d358 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.616829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f98d04-1ada-499b-b63b-11de5bd3d358 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:39.618986 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f98d04-1ada-499b-b63b-11de5bd3d358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:39.621857 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f98d04-1ada-499b-b63b-11de5bd3d358 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:39.656745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 976/1934] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:39 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:39.660956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e63e35-e1d8-44e2-9b7f-ae215aca6577 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:39.674790 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e63e35-e1d8-44e2-9b7f-ae215aca6577 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:39.680833 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a2a54-385f-4d75-bcc4-c4993966d7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:39.681601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a2a54-385f-4d75-bcc4-c4993966d7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.681881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a2a54-385f-4d75-bcc4-c4993966d7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.682203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a2a54-385f-4d75-bcc4-c4993966d7a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:39.682849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a2a54-385f-4d75-bcc4-c4993966d7a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:39.685849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a2a54-385f-4d75-bcc4-c4993966d7a0 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:39.792390 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 959/1935] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:39 2022] POST /identity/v3/projects => generated 365 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:39.797508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f98d04-1ada-499b-b63b-11de5bd3d358 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:39.836009 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:39.855155 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 977/1936] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:39 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:39.857920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a2a54-385f-4d75-bcc4-c4993966d7a0 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:39.962073 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a2a54-385f-4d75-bcc4-c4993966d7a0 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:39.970297 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f98d04-1ada-499b-b63b-11de5bd3d358 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:39.983114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a44d4-2935-4c99-b5f4-8e5f9cceac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:39.983750 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a44d4-2935-4c99-b5f4-8e5f9cceac62 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:39.984029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a44d4-2935-4c99-b5f4-8e5f9cceac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:39.984345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a44d4-2935-4c99-b5f4-8e5f9cceac62 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:39.984999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a44d4-2935-4c99-b5f4-8e5f9cceac62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:39.989275 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a44d4-2935-4c99-b5f4-8e5f9cceac62 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:40.058679 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd07fa-7f29-45f6-aeba-976654467133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:40.059310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd07fa-7f29-45f6-aeba-976654467133 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:40.059658 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd07fa-7f29-45f6-aeba-976654467133 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:40.060568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd07fa-7f29-45f6-aeba-976654467133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:40.141589 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd07fa-7f29-45f6-aeba-976654467133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:40.145662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd07fa-7f29-45f6-aeba-976654467133 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:40.176710 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 960/1937] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:39 2022] POST /identity/v3/users => generated 289 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:40.176710 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a44d4-2935-4c99-b5f4-8e5f9cceac62 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:40.185651 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 978/1938] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:39 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:40.189523 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd07fa-7f29-45f6-aeba-976654467133 service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:40.216671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a44d4-2935-4c99-b5f4-8e5f9cceac62 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:40.222822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd07fa-7f29-45f6-aeba-976654467133 service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:40.231621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5988f9-df17-4762-b4ae-9512b6222a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:40.234739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5988f9-df17-4762-b4ae-9512b6222a15 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:40.235211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5988f9-df17-4762-b4ae-9512b6222a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:40.235491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5988f9-df17-4762-b4ae-9512b6222a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:40.236289 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5988f9-df17-4762-b4ae-9512b6222a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:40.239974 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5988f9-df17-4762-b4ae-9512b6222a15 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:40.244390 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ca845-30f2-4c5f-9593-5cb2baae647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:40.245237 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ca845-30f2-4c5f-9593-5cb2baae647b admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:40.245682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ca845-30f2-4c5f-9593-5cb2baae647b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:40.247131 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ca845-30f2-4c5f-9593-5cb2baae647b admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:40.248034 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ca845-30f2-4c5f-9593-5cb2baae647b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:40.251799 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ca845-30f2-4c5f-9593-5cb2baae647b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:40.257386 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 979/1939] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:40.258477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5988f9-df17-4762-b4ae-9512b6222a15 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:40.274291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5988f9-df17-4762-b4ae-9512b6222a15 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:40.281137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc411ddd-9508-43c9-a659-7fe1b346a19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:40.281795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc411ddd-9508-43c9-a659-7fe1b346a19c admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:40.282083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc411ddd-9508-43c9-a659-7fe1b346a19c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:40.282411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc411ddd-9508-43c9-a659-7fe1b346a19c admin admin] PATH_INFO: `/v3/projects/20fe306c9f1142899a5a3aa3d5196be7/users/1e1a19550ba64253b1849758a54501ec/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:40.301866 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 961/1940] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:40.303014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ca845-30f2-4c5f-9593-5cb2baae647b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:40.320920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc411ddd-9508-43c9-a659-7fe1b346a19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=20fe306c9f1142899a5a3aa3d5196be7, user_id=1e1a19550ba64253b1849758a54501ec, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:40.323944 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc411ddd-9508-43c9-a659-7fe1b346a19c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:40.327804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ca845-30f2-4c5f-9593-5cb2baae647b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:40.345937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb8834-bf54-47b3-9f80-5fd8406ba82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:40.346783 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb8834-bf54-47b3-9f80-5fd8406ba82c admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:40.347213 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb8834-bf54-47b3-9f80-5fd8406ba82c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:40.347648 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb8834-bf54-47b3-9f80-5fd8406ba82c admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:40.348634 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb8834-bf54-47b3-9f80-5fd8406ba82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:40.350975 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb8834-bf54-47b3-9f80-5fd8406ba82c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:40.376017 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 962/1941] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:40.380521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb8834-bf54-47b3-9f80-5fd8406ba82c admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:40.401793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb8834-bf54-47b3-9f80-5fd8406ba82c admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:40.423299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 980/1942] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:40 2022] PUT /identity/v3/projects/20fe306c9f1142899a5a3aa3d5196be7/users/1e1a19550ba64253b1849758a54501ec/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:40.426887 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc411ddd-9508-43c9-a659-7fe1b346a19c admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:40.657219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc411ddd-9508-43c9-a659-7fe1b346a19c admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:40.666470 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aad4b7-0b4a-4480-b660-5b9fccc971b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:40.667329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef5217-c07a-4fb8-a03d-59e31d859504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:40.668731 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef5217-c07a-4fb8-a03d-59e31d859504 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:40.669052 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aad4b7-0b4a-4480-b660-5b9fccc971b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:40.669193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef5217-c07a-4fb8-a03d-59e31d859504 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:40.669723 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef5217-c07a-4fb8-a03d-59e31d859504 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:40.670492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef5217-c07a-4fb8-a03d-59e31d859504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:40.670774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aad4b7-0b4a-4480-b660-5b9fccc971b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:40.671074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aad4b7-0b4a-4480-b660-5b9fccc971b2 admin admin] PATH_INFO: `/v3/projects/bbd1e3bf7ec74659862c45b908a94d8c/users/a7184395237a433db53c0fd6402c6aaf/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:40.675344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef5217-c07a-4fb8-a03d-59e31d859504 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:40.693679 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 981/1943] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:40.694680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef5217-c07a-4fb8-a03d-59e31d859504 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:40.710945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef5217-c07a-4fb8-a03d-59e31d859504 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:40.718429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff79e9-0307-4cb8-b358-00639771d378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:40.719880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff79e9-0307-4cb8-b358-00639771d378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:40.720301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff79e9-0307-4cb8-b358-00639771d378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:40.720753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff79e9-0307-4cb8-b358-00639771d378 admin admin] PATH_INFO: `/v3/users/6575d7111a9b4dd8b444b11c2f7a6a9c` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:40.721071 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aad4b7-0b4a-4480-b660-5b9fccc971b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd1e3bf7ec74659862c45b908a94d8c, user_id=a7184395237a433db53c0fd6402c6aaf, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:40.722262 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff79e9-0307-4cb8-b358-00639771d378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6575d7111a9b4dd8b444b11c2f7a6a9c)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:40.724293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff79e9-0307-4cb8-b358-00639771d378 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:40.729540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aad4b7-0b4a-4480-b660-5b9fccc971b2 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:40.855130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 963/1944] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:40 2022] PUT /identity/v3/projects/bbd1e3bf7ec74659862c45b908a94d8c/users/a7184395237a433db53c0fd6402c6aaf/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:40.856709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aad4b7-0b4a-4480-b660-5b9fccc971b2 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:40.870401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:41.005582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aad4b7-0b4a-4480-b660-5b9fccc971b2 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:41.006966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3cff79e9-0307-4cb8-b358-00639771d378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6575d7111a9b4dd8b444b11c2f7a6a9c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:41.008019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3cff79e9-0307-4cb8-b358-00639771d378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6575d7111a9b4dd8b444b11c2f7a6a9c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:41.018660 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb235c-8759-4083-9e8e-5f5d244ffc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:41.019118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb235c-8759-4083-9e8e-5f5d244ffc62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:41.019407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb235c-8759-4083-9e8e-5f5d244ffc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:41.019679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb235c-8759-4083-9e8e-5f5d244ffc62 admin admin] PATH_INFO: `/v3/projects/20fe306c9f1142899a5a3aa3d5196be7/users/1e1a19550ba64253b1849758a54501ec/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:41.021857 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb235c-8759-4083-9e8e-5f5d244ffc62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20fe306c9f1142899a5a3aa3d5196be7, user_id=1e1a19550ba64253b1849758a54501ec, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:41.025216 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb235c-8759-4083-9e8e-5f5d244ffc62 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:41.039458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 964/1945] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:40 2022] PUT /identity/v3/projects/20fe306c9f1142899a5a3aa3d5196be7/users/1e1a19550ba64253b1849758a54501ec/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:41.040842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c554985-2936-469f-80b3-008739da62b0 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:41.041128 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c554985-2936-469f-80b3-008739da62b0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:41.041404 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c554985-2936-469f-80b3-008739da62b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:41.083342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-0c554985-2936-469f-80b3-008739da62b0 None None] MFA Rules not processed for user `a7184395237a433db53c0fd6402c6aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:41.085092 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-0c554985-2936-469f-80b3-008739da62b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:41.086669 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3cff79e9-0307-4cb8-b358-00639771d378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6575d7111a9b4dd8b444b11c2f7a6a9c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:41.087364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3cff79e9-0307-4cb8-b358-00639771d378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6575d7111a9b4dd8b444b11c2f7a6a9c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:41.104621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3cff79e9-0307-4cb8-b358-00639771d378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6575d7111a9b4dd8b444b11c2f7a6a9c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:41.121300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 982/1946] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:40 2022] DELETE /identity/v3/users/6575d7111a9b4dd8b444b11c2f7a6a9c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:41.123245 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f32f6-99d7-4720-b190-32273df3dfb4 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:41.123539 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f32f6-99d7-4720-b190-32273df3dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:41.123817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f32f6-99d7-4720-b190-32273df3dfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:41.192478 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-8c0f32f6-99d7-4720-b190-32273df3dfb4 None None] MFA Rules not processed for user `1e1a19550ba64253b1849758a54501ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:41.193751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8c0f32f6-99d7-4720-b190-32273df3dfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:41.252028 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 965/1947] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:41.253365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e3f3a-f0ff-4472-951d-882407968521 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:41.253755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e3f3a-f0ff-4472-951d-882407968521 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:41.254035 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e3f3a-f0ff-4472-951d-882407968521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:41.298733 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-589e3f3a-f0ff-4472-951d-882407968521 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:41.306913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-589e3f3a-f0ff-4472-951d-882407968521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:41.327428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:41.330307 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 983/1948] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:41.331205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f32f6-99d7-4720-b190-32273df3dfb4 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:41.335889 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8c0f32f6-99d7-4720-b190-32273df3dfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:41.411591 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f32f6-99d7-4720-b190-32273df3dfb4 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:41.415620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54be8f9-468c-4be4-ac74-ca399ff568e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:41.417497 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54be8f9-468c-4be4-ac74-ca399ff568e1 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:41.418178 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54be8f9-468c-4be4-ac74-ca399ff568e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:41.418178 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54be8f9-468c-4be4-ac74-ca399ff568e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:41.449208 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 966/1949] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:41.457276 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e3f3a-f0ff-4472-951d-882407968521 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:41.459042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-589e3f3a-f0ff-4472-951d-882407968521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:41.524324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54be8f9-468c-4be4-ac74-ca399ff568e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:41.525833 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54be8f9-468c-4be4-ac74-ca399ff568e1 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:41.539743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 984/1950] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:41.540715 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54be8f9-468c-4be4-ac74-ca399ff568e1 service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:41.542310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b54be8f9-468c-4be4-ac74-ca399ff568e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:41.561624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54be8f9-468c-4be4-ac74-ca399ff568e1 service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:41.571793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489cd07-a2d4-455a-ab2e-33667e125ec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:41.574551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489cd07-a2d4-455a-ab2e-33667e125ec9 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:41.574551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489cd07-a2d4-455a-ab2e-33667e125ec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:41.574551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489cd07-a2d4-455a-ab2e-33667e125ec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:41.583521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e3f3a-f0ff-4472-951d-882407968521 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:41.598220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c1784-85a3-4cd9-bdfc-1fe4ee2f4634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:41.599174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c1784-85a3-4cd9-bdfc-1fe4ee2f4634 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:41.600529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c1784-85a3-4cd9-bdfc-1fe4ee2f4634 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:41.602704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c1784-85a3-4cd9-bdfc-1fe4ee2f4634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:41.614319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489cd07-a2d4-455a-ab2e-33667e125ec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:41.615782 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489cd07-a2d4-455a-ab2e-33667e125ec9 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:41.628052 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c1784-85a3-4cd9-bdfc-1fe4ee2f4634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:41.631136 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c1784-85a3-4cd9-bdfc-1fe4ee2f4634 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:41.651637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 985/1951] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:41.652744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489cd07-a2d4-455a-ab2e-33667e125ec9 service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:41.657688 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0489cd07-a2d4-455a-ab2e-33667e125ec9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:41.663868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 967/1952] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:50:41.680806 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489cd07-a2d4-455a-ab2e-33667e125ec9 service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:41.704803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdac8e7-7c73-4d5b-bceb-4b2a06e66f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:41.705610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdac8e7-7c73-4d5b-bceb-4b2a06e66f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:41.705903 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdac8e7-7c73-4d5b-bceb-4b2a06e66f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:41.706185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdac8e7-7c73-4d5b-bceb-4b2a06e66f71 admin admin] PATH_INFO: `/v3/users/a7184395237a433db53c0fd6402c6aaf` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:41.707613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdac8e7-7c73-4d5b-bceb-4b2a06e66f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7184395237a433db53c0fd6402c6aaf)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:41.710744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdac8e7-7c73-4d5b-bceb-4b2a06e66f71 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:41.955508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-abdac8e7-7c73-4d5b-bceb-4b2a06e66f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7184395237a433db53c0fd6402c6aaf'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:41.956389 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-abdac8e7-7c73-4d5b-bceb-4b2a06e66f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7184395237a433db53c0fd6402c6aaf'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:42.007840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c1784-85a3-4cd9-bdfc-1fe4ee2f4634 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:42.028240 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c1784-85a3-4cd9-bdfc-1fe4ee2f4634 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:42.046054 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef60d67-a818-4942-9266-e5410a93bb26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:42.047433 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60d67-a818-4942-9266-e5410a93bb26 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:42.047852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60d67-a818-4942-9266-e5410a93bb26 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:42.048196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60d67-a818-4942-9266-e5410a93bb26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:42.056593 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-0ef60d67-a818-4942-9266-e5410a93bb26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:42.098431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-abdac8e7-7c73-4d5b-bceb-4b2a06e66f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7184395237a433db53c0fd6402c6aaf'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:42.099074 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-abdac8e7-7c73-4d5b-bceb-4b2a06e66f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7184395237a433db53c0fd6402c6aaf'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:42.114037 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-abdac8e7-7c73-4d5b-bceb-4b2a06e66f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7184395237a433db53c0fd6402c6aaf'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:42.129244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 986/1953] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:41 2022] DELETE /identity/v3/users/a7184395237a433db53c0fd6402c6aaf => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:42.133221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:42.135548 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51559106-0d09-4078-892d-6928cb1ef2ae None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:42.135548 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51559106-0d09-4078-892d-6928cb1ef2ae None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:42.136352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51559106-0d09-4078-892d-6928cb1ef2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:42.164755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef60d67-a818-4942-9266-e5410a93bb26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:42.166183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef60d67-a818-4942-9266-e5410a93bb26 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:42.168824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-51559106-0d09-4078-892d-6928cb1ef2ae None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:42.170735 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-51559106-0d09-4078-892d-6928cb1ef2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:42.176544 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 968/1954] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:50:42.261294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 987/1955] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:42.272001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef60d67-a818-4942-9266-e5410a93bb26 service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:42.273452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-0ef60d67-a818-4942-9266-e5410a93bb26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:42.286852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef60d67-a818-4942-9266-e5410a93bb26 service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:42.337272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e28bf8-2b8a-4e3f-b0c9-3ea185a49553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:42.337890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e28bf8-2b8a-4e3f-b0c9-3ea185a49553 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:42.338171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e28bf8-2b8a-4e3f-b0c9-3ea185a49553 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:42.338446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e28bf8-2b8a-4e3f-b0c9-3ea185a49553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:42.346634 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51559106-0d09-4078-892d-6928cb1ef2ae None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:42.350378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-51559106-0d09-4078-892d-6928cb1ef2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:42.352121 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e28bf8-2b8a-4e3f-b0c9-3ea185a49553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:42.354022 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e28bf8-2b8a-4e3f-b0c9-3ea185a49553 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:42.369115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 969/1956] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:42.369348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51559106-0d09-4078-892d-6928cb1ef2ae None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:42.390046 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:42.390934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:42.391019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:42.391295 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780 admin admin] PATH_INFO: `/v3/projects/ab3055ecae1648d7a66cdc16997dbe37` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:42.392501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3055ecae1648d7a66cdc16997dbe37)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:42.394615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:42.517172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3055ecae1648d7a66cdc16997dbe37', 'request_id': 'req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:42.524487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3055ecae1648d7a66cdc16997dbe37', 'request_id': 'req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:42.636608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3055ecae1648d7a66cdc16997dbe37', 'request_id': 'req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:42.652422 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780 admin admin] The token cache is being invalidate because project ab3055ecae1648d7a66cdc16997dbe37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:42.654868 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:42.658425 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:42.660270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 988/1957] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:42 2022] DELETE /identity/v3/projects/ab3055ecae1648d7a66cdc16997dbe37 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:50:42.666830 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e28bf8-2b8a-4e3f-b0c9-3ea185a49553 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:42.683275 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e28bf8-2b8a-4e3f-b0c9-3ea185a49553 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:42.752741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc9670-4459-41bc-839e-f7aac91a77a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:42.753474 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9670-4459-41bc-839e-f7aac91a77a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:42.753863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9670-4459-41bc-839e-f7aac91a77a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:42.754148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9670-4459-41bc-839e-f7aac91a77a7 admin admin] PATH_INFO: `/v3/users/50bf717ac8d746a9825bb326b4e2e744` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:42.755304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc9670-4459-41bc-839e-f7aac91a77a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50bf717ac8d746a9825bb326b4e2e744)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:42.757331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc9670-4459-41bc-839e-f7aac91a77a7 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:42.853885 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:42.861376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:42.862972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:42.876497 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7ba30-8426-42bd-a7ee-5e39f24d8780 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:42.881294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d00a00-5a67-49e8-bef9-33403db5a3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:42.882368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d00a00-5a67-49e8-bef9-33403db5a3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:42.882655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d00a00-5a67-49e8-bef9-33403db5a3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:42.882931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d00a00-5a67-49e8-bef9-33403db5a3ce admin admin] PATH_INFO: `/v3/projects/bbd1e3bf7ec74659862c45b908a94d8c` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:42.884479 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d00a00-5a67-49e8-bef9-33403db5a3ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd1e3bf7ec74659862c45b908a94d8c)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:42.886496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d00a00-5a67-49e8-bef9-33403db5a3ce admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:42.925190 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-94bc9670-4459-41bc-839e-f7aac91a77a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50bf717ac8d746a9825bb326b4e2e744'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:42.937831 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-94bc9670-4459-41bc-839e-f7aac91a77a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50bf717ac8d746a9825bb326b4e2e744'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:43.007484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-94bc9670-4459-41bc-839e-f7aac91a77a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50bf717ac8d746a9825bb326b4e2e744'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:43.008603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-94bc9670-4459-41bc-839e-f7aac91a77a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50bf717ac8d746a9825bb326b4e2e744'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:43.009721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-94bc9670-4459-41bc-839e-f7aac91a77a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50bf717ac8d746a9825bb326b4e2e744'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:43.026856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-17d00a00-5a67-49e8-bef9-33403db5a3ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd1e3bf7ec74659862c45b908a94d8c', 'request_id': 'req-17d00a00-5a67-49e8-bef9-33403db5a3ce'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:43.030880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 970/1958] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:42 2022] DELETE /identity/v3/users/50bf717ac8d746a9825bb326b4e2e744 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:43.042489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-17d00a00-5a67-49e8-bef9-33403db5a3ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd1e3bf7ec74659862c45b908a94d8c', 'request_id': 'req-17d00a00-5a67-49e8-bef9-33403db5a3ce'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:43.103117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-17d00a00-5a67-49e8-bef9-33403db5a3ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd1e3bf7ec74659862c45b908a94d8c', 'request_id': 'req-17d00a00-5a67-49e8-bef9-33403db5a3ce'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:43.117940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-17d00a00-5a67-49e8-bef9-33403db5a3ce admin admin] The token cache is being invalidate because project bbd1e3bf7ec74659862c45b908a94d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:43.118325 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-17d00a00-5a67-49e8-bef9-33403db5a3ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:43.119128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-17d00a00-5a67-49e8-bef9-33403db5a3ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:43.121227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 989/1959] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:42 2022] DELETE /identity/v3/projects/bbd1e3bf7ec74659862c45b908a94d8c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:50:43.124897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:43.126892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664e0c2-dedb-4898-9375-283d6e162bdb None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.127248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664e0c2-dedb-4898-9375-283d6e162bdb None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.127530 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664e0c2-dedb-4898-9375-283d6e162bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.147431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-4664e0c2-dedb-4898-9375-283d6e162bdb None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:43.148752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-4664e0c2-dedb-4898-9375-283d6e162bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:43.218036 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 971/1960] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:43.226853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ca98f-2e75-4929-a7a3-ba04593ab2f1 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.227142 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ca98f-2e75-4929-a7a3-ba04593ab2f1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.227464 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ca98f-2e75-4929-a7a3-ba04593ab2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.250997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-a83ca98f-2e75-4929-a7a3-ba04593ab2f1 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:43.252251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a83ca98f-2e75-4929-a7a3-ba04593ab2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:43.261021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 990/1961] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:43.269982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664e0c2-dedb-4898-9375-283d6e162bdb None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:43.275925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664e0c2-dedb-4898-9375-283d6e162bdb None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:43.281233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62c6f2-4a47-4c4e-93d3-bb863873a111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:43.281889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62c6f2-4a47-4c4e-93d3-bb863873a111 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.282140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62c6f2-4a47-4c4e-93d3-bb863873a111 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.282413 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62c6f2-4a47-4c4e-93d3-bb863873a111 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.283069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62c6f2-4a47-4c4e-93d3-bb863873a111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:43.283375 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62c6f2-4a47-4c4e-93d3-bb863873a111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:43.285016 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62c6f2-4a47-4c4e-93d3-bb863873a111 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:43.297591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 972/1962] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:50:43.302248 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ca98f-2e75-4929-a7a3-ba04593ab2f1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:43.311381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ca98f-2e75-4929-a7a3-ba04593ab2f1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:43.316623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956095d6-4fb0-48dc-83a6-ea246a731d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:43.317230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956095d6-4fb0-48dc-83a6-ea246a731d36 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.317507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956095d6-4fb0-48dc-83a6-ea246a731d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.317781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956095d6-4fb0-48dc-83a6-ea246a731d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.318418 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956095d6-4fb0-48dc-83a6-ea246a731d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:43.320347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956095d6-4fb0-48dc-83a6-ea246a731d36 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:43.430959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 991/1963] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:43 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:43.435297 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62c6f2-4a47-4c4e-93d3-bb863873a111 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:43.445229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62c6f2-4a47-4c4e-93d3-bb863873a111 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:43.499999 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956095d6-4fb0-48dc-83a6-ea246a731d36 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:43.501072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c991f6-afee-4ec4-8944-44211451fbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:43.505353 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c991f6-afee-4ec4-8944-44211451fbc8 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.505652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-956095d6-4fb0-48dc-83a6-ea246a731d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:43.505748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c991f6-afee-4ec4-8944-44211451fbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.505748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c991f6-afee-4ec4-8944-44211451fbc8 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.505748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c991f6-afee-4ec4-8944-44211451fbc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:43.505748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c991f6-afee-4ec4-8944-44211451fbc8 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:43.525650 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956095d6-4fb0-48dc-83a6-ea246a731d36 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:43.531169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76702913-363f-476d-9023-34c15e14d359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:43.531809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76702913-363f-476d-9023-34c15e14d359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.532145 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76702913-363f-476d-9023-34c15e14d359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.532388 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76702913-363f-476d-9023-34c15e14d359 admin admin] PATH_INFO: `/v3/projects/9bc0a7f50f6c439da3ec4f4eb41417e7` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.533555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76702913-363f-476d-9023-34c15e14d359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc0a7f50f6c439da3ec4f4eb41417e7)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:43.535472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76702913-363f-476d-9023-34c15e14d359 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:43.624204 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 973/1964] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:43 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:43.628246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c991f6-afee-4ec4-8944-44211451fbc8 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:43.638424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c991f6-afee-4ec4-8944-44211451fbc8 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:43.643095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342707a8-3e5c-4634-af66-09c2badbc39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:43.643678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342707a8-3e5c-4634-af66-09c2badbc39e admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.643962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342707a8-3e5c-4634-af66-09c2badbc39e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.644262 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342707a8-3e5c-4634-af66-09c2badbc39e admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.644891 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342707a8-3e5c-4634-af66-09c2badbc39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:43.646574 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342707a8-3e5c-4634-af66-09c2badbc39e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:43.658137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 974/1965] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:50:43.665816 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342707a8-3e5c-4634-af66-09c2badbc39e admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:43.674133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-76702913-363f-476d-9023-34c15e14d359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc0a7f50f6c439da3ec4f4eb41417e7', 'request_id': 'req-76702913-363f-476d-9023-34c15e14d359'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:43.675844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342707a8-3e5c-4634-af66-09c2badbc39e admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:43.680818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-76702913-363f-476d-9023-34c15e14d359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc0a7f50f6c439da3ec4f4eb41417e7', 'request_id': 'req-76702913-363f-476d-9023-34c15e14d359'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:43.736746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8a585-5509-4429-bd5f-93e7f73716b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:43.737462 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8a585-5509-4429-bd5f-93e7f73716b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.737948 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8a585-5509-4429-bd5f-93e7f73716b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.738431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8a585-5509-4429-bd5f-93e7f73716b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.739410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8a585-5509-4429-bd5f-93e7f73716b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:43.741116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8a585-5509-4429-bd5f-93e7f73716b3 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:43.751340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 975/1966] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:50:43.755720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8a585-5509-4429-bd5f-93e7f73716b3 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:43.766379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8a585-5509-4429-bd5f-93e7f73716b3 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:43.772168 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76736539-37d5-46e0-82d6-ec33f78733b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:43.775437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-76702913-363f-476d-9023-34c15e14d359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc0a7f50f6c439da3ec4f4eb41417e7', 'request_id': 'req-76702913-363f-476d-9023-34c15e14d359'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:43.775659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76736539-37d5-46e0-82d6-ec33f78733b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.775659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76736539-37d5-46e0-82d6-ec33f78733b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.775659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76736539-37d5-46e0-82d6-ec33f78733b6 admin admin] PATH_INFO: `/v3/projects/1338760ea2b349aabe8198a0a9eb44ee/users/67e5a967ad664c25a42e9c7fc38f417c/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.787949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-76702913-363f-476d-9023-34c15e14d359 admin admin] The token cache is being invalidate because project 9bc0a7f50f6c439da3ec4f4eb41417e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:43.788286 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-76702913-363f-476d-9023-34c15e14d359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:43.788963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-76702913-363f-476d-9023-34c15e14d359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:43.790739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 992/1967] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:43 2022] DELETE /identity/v3/projects/9bc0a7f50f6c439da3ec4f4eb41417e7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:43.791761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76736539-37d5-46e0-82d6-ec33f78733b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1338760ea2b349aabe8198a0a9eb44ee, user_id=67e5a967ad664c25a42e9c7fc38f417c, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:43.794774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76736539-37d5-46e0-82d6-ec33f78733b6 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:43.795716 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822482f3-e613-4a11-826b-ef868cd0b62a None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.796018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822482f3-e613-4a11-826b-ef868cd0b62a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.796306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822482f3-e613-4a11-826b-ef868cd0b62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.819190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-822482f3-e613-4a11-826b-ef868cd0b62a None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:43.820753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-822482f3-e613-4a11-826b-ef868cd0b62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:43.840730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 993/1968] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:43.845497 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0cc38-6f63-429a-8c7b-9d20ffed32da None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.845670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0cc38-6f63-429a-8c7b-9d20ffed32da None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.845955 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0cc38-6f63-429a-8c7b-9d20ffed32da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.882747 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 976/1969] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:43 2022] PUT /identity/v3/projects/1338760ea2b349aabe8198a0a9eb44ee/users/67e5a967ad664c25a42e9c7fc38f417c/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:50:43.884509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-acb0cc38-6f63-429a-8c7b-9d20ffed32da None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:43.885911 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-acb0cc38-6f63-429a-8c7b-9d20ffed32da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:43.900371 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abceb9-a103-4b70-8a75-be708e06e1e3 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.905049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abceb9-a103-4b70-8a75-be708e06e1e3 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.905342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abceb9-a103-4b70-8a75-be708e06e1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.940104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-b0abceb9-a103-4b70-8a75-be708e06e1e3 None None] MFA Rules not processed for user `67e5a967ad664c25a42e9c7fc38f417c`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:43.942873 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b0abceb9-a103-4b70-8a75-be708e06e1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:43.962337 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 994/1970] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:43.968642 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0cc38-6f63-429a-8c7b-9d20ffed32da None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:43.978469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0cc38-6f63-429a-8c7b-9d20ffed32da None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:43.984986 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da301b97-6421-4302-9021-c30479adfd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:43.985685 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da301b97-6421-4302-9021-c30479adfd84 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.986044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da301b97-6421-4302-9021-c30479adfd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.987864 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da301b97-6421-4302-9021-c30479adfd84 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.987864 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da301b97-6421-4302-9021-c30479adfd84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:43.987864 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da301b97-6421-4302-9021-c30479adfd84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:44.003394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da301b97-6421-4302-9021-c30479adfd84 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:44.016164 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 995/1971] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:50:44.020501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da301b97-6421-4302-9021-c30479adfd84 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:44.027501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 977/1972] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:44.030485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da301b97-6421-4302-9021-c30479adfd84 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:44.035719 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2250358-b02c-4aea-8fff-785778646e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:44.036483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2250358-b02c-4aea-8fff-785778646e79 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:44.036835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2250358-b02c-4aea-8fff-785778646e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:44.037207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2250358-b02c-4aea-8fff-785778646e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:44.037980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2250358-b02c-4aea-8fff-785778646e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:44.038937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abceb9-a103-4b70-8a75-be708e06e1e3 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:44.040045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2250358-b02c-4aea-8fff-785778646e79 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:44.040391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b0abceb9-a103-4b70-8a75-be708e06e1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:44.096907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abceb9-a103-4b70-8a75-be708e06e1e3 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:44.100633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a385ed2-79fc-42f4-90af-b79a4d40006d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:44.101288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a385ed2-79fc-42f4-90af-b79a4d40006d service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:44.101569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a385ed2-79fc-42f4-90af-b79a4d40006d service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:44.101845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a385ed2-79fc-42f4-90af-b79a4d40006d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:44.110148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a385ed2-79fc-42f4-90af-b79a4d40006d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:44.111565 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a385ed2-79fc-42f4-90af-b79a4d40006d service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:44.121954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 978/1973] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:50:44.160688 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 996/1974] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:44 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:50:44.165944 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a385ed2-79fc-42f4-90af-b79a4d40006d service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:44.167332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2250358-b02c-4aea-8fff-785778646e79 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:44.168131 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1a385ed2-79fc-42f4-90af-b79a4d40006d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:44.190283 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a385ed2-79fc-42f4-90af-b79a4d40006d service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:44.271989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2250358-b02c-4aea-8fff-785778646e79 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:44.280046 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b1ab3-ff3c-40d2-8fc1-1b1082e685c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:44.282308 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b1ab3-ff3c-40d2-8fc1-1b1082e685c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:44.283558 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b1ab3-ff3c-40d2-8fc1-1b1082e685c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:44.283888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b1ab3-ff3c-40d2-8fc1-1b1082e685c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:44.285087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b1ab3-ff3c-40d2-8fc1-1b1082e685c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:44.288634 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b1ab3-ff3c-40d2-8fc1-1b1082e685c2 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:44.302137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bdaf0-b94d-4fe9-8ea9-d396b6b86f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:44.302922 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bdaf0-b94d-4fe9-8ea9-d396b6b86f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:44.303266 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bdaf0-b94d-4fe9-8ea9-d396b6b86f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:44.303651 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bdaf0-b94d-4fe9-8ea9-d396b6b86f31 admin admin] PATH_INFO: `/v3/users/67e5a967ad664c25a42e9c7fc38f417c` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:44.305097 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bdaf0-b94d-4fe9-8ea9-d396b6b86f31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e5a967ad664c25a42e9c7fc38f417c)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:44.310914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bdaf0-b94d-4fe9-8ea9-d396b6b86f31 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:44.394817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 997/1975] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:44 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:44.399194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b1ab3-ff3c-40d2-8fc1-1b1082e685c2 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:44.413920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b1ab3-ff3c-40d2-8fc1-1b1082e685c2 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:44.419227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c9402-1473-47f3-b8db-c92c1d433f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:44.419914 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c9402-1473-47f3-b8db-c92c1d433f4d admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:44.420309 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c9402-1473-47f3-b8db-c92c1d433f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:44.420714 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c9402-1473-47f3-b8db-c92c1d433f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:44.421512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c9402-1473-47f3-b8db-c92c1d433f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:44.423300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c9402-1473-47f3-b8db-c92c1d433f4d admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:44.434643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 998/1976] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:44.441595 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c9402-1473-47f3-b8db-c92c1d433f4d admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:44.443933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-5b5c9402-1473-47f3-b8db-c92c1d433f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:44.458788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:44.464910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c9402-1473-47f3-b8db-c92c1d433f4d admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:44.473241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3100a44-a213-4333-9dfe-dee50b1f0dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:44.474435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3100a44-a213-4333-9dfe-dee50b1f0dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:44.475019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3100a44-a213-4333-9dfe-dee50b1f0dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:44.475496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3100a44-a213-4333-9dfe-dee50b1f0dbb admin admin] PATH_INFO: `/v3/users/d1dfe5d44cc14eabaf9a9219a496f4e3` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:44.477062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3100a44-a213-4333-9dfe-dee50b1f0dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1dfe5d44cc14eabaf9a9219a496f4e3)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:44.479120 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3100a44-a213-4333-9dfe-dee50b1f0dbb admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:44.550878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-da0bdaf0-b94d-4fe9-8ea9-d396b6b86f31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e5a967ad664c25a42e9c7fc38f417c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:44.563997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-da0bdaf0-b94d-4fe9-8ea9-d396b6b86f31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e5a967ad664c25a42e9c7fc38f417c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:44.669040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-da0bdaf0-b94d-4fe9-8ea9-d396b6b86f31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e5a967ad664c25a42e9c7fc38f417c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:44.669695 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-da0bdaf0-b94d-4fe9-8ea9-d396b6b86f31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e5a967ad664c25a42e9c7fc38f417c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:44.670309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-da0bdaf0-b94d-4fe9-8ea9-d396b6b86f31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e5a967ad664c25a42e9c7fc38f417c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:44.683297 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 979/1977] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:44 2022] DELETE /identity/v3/users/67e5a967ad664c25a42e9c7fc38f417c => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:50:44.684109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bdaf0-b94d-4fe9-8ea9-d396b6b86f31 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:44.685976 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-da0bdaf0-b94d-4fe9-8ea9-d396b6b86f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:44.711726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d3100a44-a213-4333-9dfe-dee50b1f0dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1dfe5d44cc14eabaf9a9219a496f4e3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:44.712517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d3100a44-a213-4333-9dfe-dee50b1f0dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1dfe5d44cc14eabaf9a9219a496f4e3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:44.748530 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bdaf0-b94d-4fe9-8ea9-d396b6b86f31 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:44.750115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:44.753247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b1bf0-5d2d-49b4-ade0-1880f444ffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:44.753873 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b1bf0-5d2d-49b4-ade0-1880f444ffb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:44.754151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b1bf0-5d2d-49b4-ade0-1880f444ffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:44.754430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b1bf0-5d2d-49b4-ade0-1880f444ffb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:44.755078 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b1bf0-5d2d-49b4-ade0-1880f444ffb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:44.756785 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b1bf0-5d2d-49b4-ade0-1880f444ffb8 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:44.767766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 980/1978] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:44.769033 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f9bbc-9f56-4cf8-a9cb-f6e193cd0997 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:44.769321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f9bbc-9f56-4cf8-a9cb-f6e193cd0997 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:44.769598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f9bbc-9f56-4cf8-a9cb-f6e193cd0997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:44.773058 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d3100a44-a213-4333-9dfe-dee50b1f0dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1dfe5d44cc14eabaf9a9219a496f4e3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:44.774345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d3100a44-a213-4333-9dfe-dee50b1f0dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1dfe5d44cc14eabaf9a9219a496f4e3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:44.787261 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d3100a44-a213-4333-9dfe-dee50b1f0dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1dfe5d44cc14eabaf9a9219a496f4e3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:44.788480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-a53f9bbc-9f56-4cf8-a9cb-f6e193cd0997 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:44.789694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a53f9bbc-9f56-4cf8-a9cb-f6e193cd0997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:44.797317 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 981/1979] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:44.799456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f9bbc-9f56-4cf8-a9cb-f6e193cd0997 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:44.799734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a53f9bbc-9f56-4cf8-a9cb-f6e193cd0997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:44.807716 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 999/1980] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:44 2022] DELETE /identity/v3/users/d1dfe5d44cc14eabaf9a9219a496f4e3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:44.808698 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3100a44-a213-4333-9dfe-dee50b1f0dbb admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:44.810476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d3100a44-a213-4333-9dfe-dee50b1f0dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:44.811605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f9bbc-9f56-4cf8-a9cb-f6e193cd0997 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:44.867582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3100a44-a213-4333-9dfe-dee50b1f0dbb admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:44.868273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b4f0f-d0fd-4e05-ba5f-0f980ac96303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:44.868970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4f0f-d0fd-4e05-ba5f-0f980ac96303 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:44.869221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4f0f-d0fd-4e05-ba5f-0f980ac96303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:44.869498 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4f0f-d0fd-4e05-ba5f-0f980ac96303 admin admin] PATH_INFO: `/v3/projects/8ced50dfdfe74f6f99dd8b8d845ac37f/users/9593804af7f94f6b821b67bfb67c3edc/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:44.871216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938715e-a4e1-4ffb-a5ed-c2d8d4c782bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:44.871826 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938715e-a4e1-4ffb-a5ed-c2d8d4c782bc service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:44.872124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938715e-a4e1-4ffb-a5ed-c2d8d4c782bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:44.872925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938715e-a4e1-4ffb-a5ed-c2d8d4c782bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:44.882193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938715e-a4e1-4ffb-a5ed-c2d8d4c782bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:44.883675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938715e-a4e1-4ffb-a5ed-c2d8d4c782bc service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:44.885978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b4f0f-d0fd-4e05-ba5f-0f980ac96303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ced50dfdfe74f6f99dd8b8d845ac37f, user_id=9593804af7f94f6b821b67bfb67c3edc, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:44.887574 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b4f0f-d0fd-4e05-ba5f-0f980ac96303 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:44.894225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1000/1981] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:44.895479 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd80d6-6fb7-4a2d-8950-d28ba20ebfe1 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:44.895820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd80d6-6fb7-4a2d-8950-d28ba20ebfe1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:44.896127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd80d6-6fb7-4a2d-8950-d28ba20ebfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:44.914709 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-38cd80d6-6fb7-4a2d-8950-d28ba20ebfe1 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:44.915912 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-38cd80d6-6fb7-4a2d-8950-d28ba20ebfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:44.924201 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1001/1982] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:44.934475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd80d6-6fb7-4a2d-8950-d28ba20ebfe1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:44.936377 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-38cd80d6-6fb7-4a2d-8950-d28ba20ebfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:44.948492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd80d6-6fb7-4a2d-8950-d28ba20ebfe1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:44.952726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b2c70-d864-419a-b1ee-a22e93b12ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:44.953354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b2c70-d864-419a-b1ee-a22e93b12ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:44.953716 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b2c70-d864-419a-b1ee-a22e93b12ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:44.953965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b2c70-d864-419a-b1ee-a22e93b12ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:44.962094 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 982/1983] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:44 2022] PUT /identity/v3/projects/8ced50dfdfe74f6f99dd8b8d845ac37f/users/9593804af7f94f6b821b67bfb67c3edc/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:44.963933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b2c70-d864-419a-b1ee-a22e93b12ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:44.965609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b2c70-d864-419a-b1ee-a22e93b12ac8 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:44.972286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908c114-c971-43e3-a8b3-b3c377d03424 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:44.980153 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908c114-c971-43e3-a8b3-b3c377d03424 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:44.980153 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908c114-c971-43e3-a8b3-b3c377d03424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:44.980365 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1002/1984] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:50:45.004731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-8908c114-c971-43e3-a8b3-b3c377d03424 None None] MFA Rules not processed for user `9593804af7f94f6b821b67bfb67c3edc`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:45.005978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8908c114-c971-43e3-a8b3-b3c377d03424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:45.075917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 983/1985] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:45.080424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b2c70-d864-419a-b1ee-a22e93b12ac8 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:45.090302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b2c70-d864-419a-b1ee-a22e93b12ac8 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:45.166412 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d8f9b-ddde-402a-8480-cc7534d08392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:45.167898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d8f9b-ddde-402a-8480-cc7534d08392 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:45.168421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d8f9b-ddde-402a-8480-cc7534d08392 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:45.168698 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d8f9b-ddde-402a-8480-cc7534d08392 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:45.169920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d8f9b-ddde-402a-8480-cc7534d08392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:45.171853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d8f9b-ddde-402a-8480-cc7534d08392 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:45.268268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1003/1986] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:45 2022] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:45.269564 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908c114-c971-43e3-a8b3-b3c377d03424 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:45.281653 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908c114-c971-43e3-a8b3-b3c377d03424 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:45.339095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19525ca-d99b-4428-bbc2-20ad1c9ac442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:45.339738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19525ca-d99b-4428-bbc2-20ad1c9ac442 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:45.339982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19525ca-d99b-4428-bbc2-20ad1c9ac442 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:45.340304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19525ca-d99b-4428-bbc2-20ad1c9ac442 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:45.340959 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19525ca-d99b-4428-bbc2-20ad1c9ac442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:45.342892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19525ca-d99b-4428-bbc2-20ad1c9ac442 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:45.379918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d8f9b-ddde-402a-8480-cc7534d08392 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:45.381680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8e8d8f9b-ddde-402a-8480-cc7534d08392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:45.394540 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d8f9b-ddde-402a-8480-cc7534d08392 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:45.399334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac4ac9-0499-4e09-89f1-df19a434ffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:45.399974 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac4ac9-0499-4e09-89f1-df19a434ffe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:45.400292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac4ac9-0499-4e09-89f1-df19a434ffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:45.401135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac4ac9-0499-4e09-89f1-df19a434ffe7 admin admin] PATH_INFO: `/v3/projects/1338760ea2b349aabe8198a0a9eb44ee` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:45.401790 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac4ac9-0499-4e09-89f1-df19a434ffe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1338760ea2b349aabe8198a0a9eb44ee)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:45.403743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac4ac9-0499-4e09-89f1-df19a434ffe7 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:45.463348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 984/1987] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:45 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:45.469506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19525ca-d99b-4428-bbc2-20ad1c9ac442 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:45.469506 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-f19525ca-d99b-4428-bbc2-20ad1c9ac442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:45.478059 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19525ca-d99b-4428-bbc2-20ad1c9ac442 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:45.483257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa96a-ea94-4885-82dc-335afb84f00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:45.483857 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa96a-ea94-4885-82dc-335afb84f00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:45.484164 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa96a-ea94-4885-82dc-335afb84f00e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:45.484438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa96a-ea94-4885-82dc-335afb84f00e admin admin] PATH_INFO: `/v3/projects/3b581fcfb8314fd1b827a56cb6b73b38` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:45.485638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa96a-ea94-4885-82dc-335afb84f00e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b581fcfb8314fd1b827a56cb6b73b38)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:45.487494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa96a-ea94-4885-82dc-335afb84f00e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:45.556257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9eac4ac9-0499-4e09-89f1-df19a434ffe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1338760ea2b349aabe8198a0a9eb44ee', 'request_id': 'req-9eac4ac9-0499-4e09-89f1-df19a434ffe7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:45.563610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9eac4ac9-0499-4e09-89f1-df19a434ffe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1338760ea2b349aabe8198a0a9eb44ee', 'request_id': 'req-9eac4ac9-0499-4e09-89f1-df19a434ffe7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:45.628261 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0c1aa96a-ea94-4885-82dc-335afb84f00e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b581fcfb8314fd1b827a56cb6b73b38', 'request_id': 'req-0c1aa96a-ea94-4885-82dc-335afb84f00e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:45.642164 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9eac4ac9-0499-4e09-89f1-df19a434ffe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1338760ea2b349aabe8198a0a9eb44ee', 'request_id': 'req-9eac4ac9-0499-4e09-89f1-df19a434ffe7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:45.657800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9eac4ac9-0499-4e09-89f1-df19a434ffe7 admin admin] The token cache is being invalidate because project 1338760ea2b349aabe8198a0a9eb44ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:45.660942 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9eac4ac9-0499-4e09-89f1-df19a434ffe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:45.660942 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9eac4ac9-0499-4e09-89f1-df19a434ffe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:45.670049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1004/1988] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:45 2022] DELETE /identity/v3/projects/1338760ea2b349aabe8198a0a9eb44ee => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:50:45.670049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac4ac9-0499-4e09-89f1-df19a434ffe7 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:45.670049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9eac4ac9-0499-4e09-89f1-df19a434ffe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:45.744796 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac4ac9-0499-4e09-89f1-df19a434ffe7 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:45.783227 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0c1aa96a-ea94-4885-82dc-335afb84f00e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b581fcfb8314fd1b827a56cb6b73b38', 'request_id': 'req-0c1aa96a-ea94-4885-82dc-335afb84f00e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:45.790930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0c1aa96a-ea94-4885-82dc-335afb84f00e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b581fcfb8314fd1b827a56cb6b73b38', 'request_id': 'req-0c1aa96a-ea94-4885-82dc-335afb84f00e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:45.806234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d7909-89c5-421d-8fc5-acccc3397ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:45.809582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0c1aa96a-ea94-4885-82dc-335afb84f00e admin admin] The token cache is being invalidate because project 3b581fcfb8314fd1b827a56cb6b73b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:45.809733 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d7909-89c5-421d-8fc5-acccc3397ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:45.809850 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0c1aa96a-ea94-4885-82dc-335afb84f00e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:45.809953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d7909-89c5-421d-8fc5-acccc3397ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:45.809953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d7909-89c5-421d-8fc5-acccc3397ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:45.810086 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0c1aa96a-ea94-4885-82dc-335afb84f00e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:45.810156 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d7909-89c5-421d-8fc5-acccc3397ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:45.810156 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d7909-89c5-421d-8fc5-acccc3397ee8 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:45.810299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 985/1989] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:45 2022] DELETE /identity/v3/projects/3b581fcfb8314fd1b827a56cb6b73b38 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:45.811798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef36534-1b50-4cd4-8e4c-da8ce62c7f95 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:45.812336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef36534-1b50-4cd4-8e4c-da8ce62c7f95 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:45.812487 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef36534-1b50-4cd4-8e4c-da8ce62c7f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:45.831956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1005/1990] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:45.831956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d7909-89c5-421d-8fc5-acccc3397ee8 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:45.831956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0a6d7909-89c5-421d-8fc5-acccc3397ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:45.838287 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-cef36534-1b50-4cd4-8e4c-da8ce62c7f95 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:45.839585 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-cef36534-1b50-4cd4-8e4c-da8ce62c7f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:45.840264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d7909-89c5-421d-8fc5-acccc3397ee8 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:45.846097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c79fa-072c-42f8-9b0b-8966170ff612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:45.846730 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c79fa-072c-42f8-9b0b-8966170ff612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:45.847015 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c79fa-072c-42f8-9b0b-8966170ff612 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:45.847294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c79fa-072c-42f8-9b0b-8966170ff612 admin admin] PATH_INFO: `/v3/users/ca4203a91e424ee8badd1be5615f741a` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:45.848554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c79fa-072c-42f8-9b0b-8966170ff612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4203a91e424ee8badd1be5615f741a)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:45.848868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 986/1991] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:45.849702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef36534-1b50-4cd4-8e4c-da8ce62c7f95 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:45.851023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-cef36534-1b50-4cd4-8e4c-da8ce62c7f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:45.858056 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c79fa-072c-42f8-9b0b-8966170ff612 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:45.863541 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef36534-1b50-4cd4-8e4c-da8ce62c7f95 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:45.869752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92763d31-e99f-4be0-8661-7b592bbcfe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:45.870572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92763d31-e99f-4be0-8661-7b592bbcfe96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:45.871015 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92763d31-e99f-4be0-8661-7b592bbcfe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:45.871387 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92763d31-e99f-4be0-8661-7b592bbcfe96 admin admin] PATH_INFO: `/v3/projects/6ca1e0045fb54a9390ccbfc3ba65d81d/users/60b7f73259a3418690c0fc2b55fefe7e/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:45.887402 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:45.891082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92763d31-e99f-4be0-8661-7b592bbcfe96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca1e0045fb54a9390ccbfc3ba65d81d, user_id=60b7f73259a3418690c0fc2b55fefe7e, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:45.893840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92763d31-e99f-4be0-8661-7b592bbcfe96 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:46.008782 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:46.012689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 987/1992] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:45 2022] PUT /identity/v3/projects/6ca1e0045fb54a9390ccbfc3ba65d81d/users/60b7f73259a3418690c0fc2b55fefe7e/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:46.014518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3a91-a949-4c51-857c-48f5a4ef9339 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:46.014803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3a91-a949-4c51-857c-48f5a4ef9339 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:46.015076 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3a91-a949-4c51-857c-48f5a4ef9339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:46.035138 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-152a3a91-a949-4c51-857c-48f5a4ef9339 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:46.036407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-152a3a91-a949-4c51-857c-48f5a4ef9339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:46.100426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 988/1993] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:46.101278 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a3a91-a949-4c51-857c-48f5a4ef9339 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:46.110781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a3a91-a949-4c51-857c-48f5a4ef9339 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:46.115728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f6024-e026-4a4c-a2c4-23eb32187570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:46.116369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f6024-e026-4a4c-a2c4-23eb32187570 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:46.116657 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f6024-e026-4a4c-a2c4-23eb32187570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:46.119943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f6024-e026-4a4c-a2c4-23eb32187570 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:46.119943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f6024-e026-4a4c-a2c4-23eb32187570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:46.119943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f6024-e026-4a4c-a2c4-23eb32187570 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:46.130524 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 989/1994] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:46.131469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f6024-e026-4a4c-a2c4-23eb32187570 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:46.141689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f6024-e026-4a4c-a2c4-23eb32187570 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:46.150364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064d528-8025-41c6-99e0-8d177e5a2488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:46.151422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064d528-8025-41c6-99e0-8d177e5a2488 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:46.151963 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064d528-8025-41c6-99e0-8d177e5a2488 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:46.160380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064d528-8025-41c6-99e0-8d177e5a2488 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:46.160380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064d528-8025-41c6-99e0-8d177e5a2488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:46.160380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064d528-8025-41c6-99e0-8d177e5a2488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:46.160380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064d528-8025-41c6-99e0-8d177e5a2488 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:46.160671 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-941c79fa-072c-42f8-9b0b-8966170ff612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4203a91e424ee8badd1be5615f741a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:46.161161 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-941c79fa-072c-42f8-9b0b-8966170ff612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4203a91e424ee8badd1be5615f741a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:46.173348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 990/1995] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:50:46.173348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064d528-8025-41c6-99e0-8d177e5a2488 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:46.173348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5064d528-8025-41c6-99e0-8d177e5a2488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:46.186091 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064d528-8025-41c6-99e0-8d177e5a2488 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:46.190730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be27632-297e-4e1d-b5ac-4f82bedc63dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:46.191389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be27632-297e-4e1d-b5ac-4f82bedc63dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:46.191672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be27632-297e-4e1d-b5ac-4f82bedc63dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:46.191978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be27632-297e-4e1d-b5ac-4f82bedc63dc admin admin] PATH_INFO: `/v3/projects/6ca1e0045fb54a9390ccbfc3ba65d81d/users/60b7f73259a3418690c0fc2b55fefe7e/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:46.194058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be27632-297e-4e1d-b5ac-4f82bedc63dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca1e0045fb54a9390ccbfc3ba65d81d, user_id=60b7f73259a3418690c0fc2b55fefe7e, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:46.196747 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be27632-297e-4e1d-b5ac-4f82bedc63dc admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:46.208156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 991/1996] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:46 2022] PUT /identity/v3/projects/6ca1e0045fb54a9390ccbfc3ba65d81d/users/60b7f73259a3418690c0fc2b55fefe7e/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:46.209034 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be27632-297e-4e1d-b5ac-4f82bedc63dc admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:46.210586 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3be27632-297e-4e1d-b5ac-4f82bedc63dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:46.246237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-941c79fa-072c-42f8-9b0b-8966170ff612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4203a91e424ee8badd1be5615f741a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:46.246881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-941c79fa-072c-42f8-9b0b-8966170ff612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4203a91e424ee8badd1be5615f741a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:46.259818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-941c79fa-072c-42f8-9b0b-8966170ff612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4203a91e424ee8badd1be5615f741a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:46.273202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1006/1997] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:45 2022] DELETE /identity/v3/users/ca4203a91e424ee8badd1be5615f741a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:46.274717 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdbb1b-e31e-45cb-9a00-255bfd01b750 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:46.275172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdbb1b-e31e-45cb-9a00-255bfd01b750 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:46.275604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdbb1b-e31e-45cb-9a00-255bfd01b750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:46.275709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be27632-297e-4e1d-b5ac-4f82bedc63dc admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:46.306988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-fdfdbb1b-e31e-45cb-9a00-255bfd01b750 None None] MFA Rules not processed for user `60b7f73259a3418690c0fc2b55fefe7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:46.308262 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-fdfdbb1b-e31e-45cb-9a00-255bfd01b750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:46.342908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0c1bb-2f03-474d-b7ae-07e5f6f2e3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:46.343721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0c1bb-2f03-474d-b7ae-07e5f6f2e3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:46.344531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0c1bb-2f03-474d-b7ae-07e5f6f2e3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:46.344820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0c1bb-2f03-474d-b7ae-07e5f6f2e3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:46.345867 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0c1bb-2f03-474d-b7ae-07e5f6f2e3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:46.350417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0c1bb-2f03-474d-b7ae-07e5f6f2e3e7 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:46.408153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1007/1998] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:46.427741 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdbb1b-e31e-45cb-9a00-255bfd01b750 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:46.428451 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-fdfdbb1b-e31e-45cb-9a00-255bfd01b750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:46.474940 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 992/1999] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:46 2022] POST /identity/v3/projects => generated 389 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:46.477500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0c1bb-2f03-474d-b7ae-07e5f6f2e3e7 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:46.504214 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdbb1b-e31e-45cb-9a00-255bfd01b750 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:46.576901 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19a90b-c374-49f4-9420-87225d8948f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:46.577581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19a90b-c374-49f4-9420-87225d8948f7 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:46.577802 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19a90b-c374-49f4-9420-87225d8948f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:46.578077 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19a90b-c374-49f4-9420-87225d8948f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:46.583217 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0c1bb-2f03-474d-b7ae-07e5f6f2e3e7 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:46.599728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f2ead-2a09-40a6-9498-31850538baf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:46.600621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f2ead-2a09-40a6-9498-31850538baf5 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:46.600996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f2ead-2a09-40a6-9498-31850538baf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:46.601960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f2ead-2a09-40a6-9498-31850538baf5 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:46.602701 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f2ead-2a09-40a6-9498-31850538baf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:46.607664 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f2ead-2a09-40a6-9498-31850538baf5 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:46.665720 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19a90b-c374-49f4-9420-87225d8948f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:46.667299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19a90b-c374-49f4-9420-87225d8948f7 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:46.678292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1008/2000] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:46.775729 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19a90b-c374-49f4-9420-87225d8948f7 service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:46.776671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 993/2001] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:46 2022] POST /identity/v3/users => generated 295 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:46.780674 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f2ead-2a09-40a6-9498-31850538baf5 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:46.783633 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-6d19a90b-c374-49f4-9420-87225d8948f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:46.807384 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19a90b-c374-49f4-9420-87225d8948f7 service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:46.814290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f2ead-2a09-40a6-9498-31850538baf5 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:46.827902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c5ace-06b3-44c0-b0c6-21ab1c4c2c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:46.833677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c5ace-06b3-44c0-b0c6-21ab1c4c2c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:46.833677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c5ace-06b3-44c0-b0c6-21ab1c4c2c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:46.833677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c5ace-06b3-44c0-b0c6-21ab1c4c2c7c admin admin] PATH_INFO: `/v3/projects/f4fc1b67a12e446e99954e86c52cae23` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:46.833677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c5ace-06b3-44c0-b0c6-21ab1c4c2c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4fc1b67a12e446e99954e86c52cae23)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:46.835235 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c5ace-06b3-44c0-b0c6-21ab1c4c2c7c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:46.842387 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498ad76-abce-4ad3-b07d-cf4e9f1789e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:46.843033 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498ad76-abce-4ad3-b07d-cf4e9f1789e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:46.843315 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498ad76-abce-4ad3-b07d-cf4e9f1789e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:46.845226 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498ad76-abce-4ad3-b07d-cf4e9f1789e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:46.845956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498ad76-abce-4ad3-b07d-cf4e9f1789e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:46.848875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498ad76-abce-4ad3-b07d-cf4e9f1789e3 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:46.864269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 994/2002] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:46.867967 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498ad76-abce-4ad3-b07d-cf4e9f1789e3 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:46.882380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498ad76-abce-4ad3-b07d-cf4e9f1789e3 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:46.888598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f88928-8f4c-4e22-a0f1-e28b7b40ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:46.889536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f88928-8f4c-4e22-a0f1-e28b7b40ce65 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:46.889922 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f88928-8f4c-4e22-a0f1-e28b7b40ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:46.890296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f88928-8f4c-4e22-a0f1-e28b7b40ce65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:46.891199 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f88928-8f4c-4e22-a0f1-e28b7b40ce65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:46.892991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f88928-8f4c-4e22-a0f1-e28b7b40ce65 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:46.908655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 995/2003] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:46.913661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f88928-8f4c-4e22-a0f1-e28b7b40ce65 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:46.930329 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f88928-8f4c-4e22-a0f1-e28b7b40ce65 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:46.935844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814b4c6-c4f7-4966-b4c8-6bd5db991fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:46.942076 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814b4c6-c4f7-4966-b4c8-6bd5db991fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:46.942076 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814b4c6-c4f7-4966-b4c8-6bd5db991fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:46.942076 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814b4c6-c4f7-4966-b4c8-6bd5db991fd5 admin admin] PATH_INFO: `/v3/projects/3a4fab2a43d2484a85877852bd1354d0/users/942f675275924a0383cfe17f88b6b143/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:46.962756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814b4c6-c4f7-4966-b4c8-6bd5db991fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4fab2a43d2484a85877852bd1354d0, user_id=942f675275924a0383cfe17f88b6b143, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:46.965895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814b4c6-c4f7-4966-b4c8-6bd5db991fd5 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:47.065415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 996/2004] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:46 2022] PUT /identity/v3/projects/3a4fab2a43d2484a85877852bd1354d0/users/942f675275924a0383cfe17f88b6b143/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:47.074370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814b4c6-c4f7-4966-b4c8-6bd5db991fd5 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:47.099020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bd9c5ace-06b3-44c0-b0c6-21ab1c4c2c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4fc1b67a12e446e99954e86c52cae23', 'request_id': 'req-bd9c5ace-06b3-44c0-b0c6-21ab1c4c2c7c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:47.106309 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bd9c5ace-06b3-44c0-b0c6-21ab1c4c2c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4fc1b67a12e446e99954e86c52cae23', 'request_id': 'req-bd9c5ace-06b3-44c0-b0c6-21ab1c4c2c7c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:47.154975 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814b4c6-c4f7-4966-b4c8-6bd5db991fd5 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:47.208787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bd9c5ace-06b3-44c0-b0c6-21ab1c4c2c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4fc1b67a12e446e99954e86c52cae23', 'request_id': 'req-bd9c5ace-06b3-44c0-b0c6-21ab1c4c2c7c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:47.220446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3eac3-c589-48c9-a045-7dd595f82ee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:47.221160 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3eac3-c589-48c9-a045-7dd595f82ee0 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:47.221443 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3eac3-c589-48c9-a045-7dd595f82ee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:47.222643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3eac3-c589-48c9-a045-7dd595f82ee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:47.224574 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bd9c5ace-06b3-44c0-b0c6-21ab1c4c2c7c admin admin] The token cache is being invalidate because project f4fc1b67a12e446e99954e86c52cae23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:47.224574 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bd9c5ace-06b3-44c0-b0c6-21ab1c4c2c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:47.224574 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bd9c5ace-06b3-44c0-b0c6-21ab1c4c2c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:47.225994 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1009/2005] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:46 2022] DELETE /identity/v3/projects/f4fc1b67a12e446e99954e86c52cae23 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:50:47.227043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b9e3eac3-c589-48c9-a045-7dd595f82ee0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:47.227581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d8146-38ae-4cd1-93d5-687c7301c36a None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:47.228225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d8146-38ae-4cd1-93d5-687c7301c36a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:47.228660 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d8146-38ae-4cd1-93d5-687c7301c36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:47.262871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-a06d8146-38ae-4cd1-93d5-687c7301c36a None None] MFA Rules not processed for user `942f675275924a0383cfe17f88b6b143`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:47.264851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a06d8146-38ae-4cd1-93d5-687c7301c36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:47.315053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3eac3-c589-48c9-a045-7dd595f82ee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:47.317643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3eac3-c589-48c9-a045-7dd595f82ee0 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:47.330378 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 997/2006] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:47.331743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3eac3-c589-48c9-a045-7dd595f82ee0 service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:47.413727 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1010/2007] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:47.477765 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3eac3-c589-48c9-a045-7dd595f82ee0 service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:47.489018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0aff10-8dde-4eb8-8777-9c6c2a1b6af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:47.490964 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0aff10-8dde-4eb8-8777-9c6c2a1b6af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:47.496066 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0aff10-8dde-4eb8-8777-9c6c2a1b6af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:47.496066 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0aff10-8dde-4eb8-8777-9c6c2a1b6af0 admin admin] PATH_INFO: `/v3/users/ed2de94ba38c4d6285396f14d95678bb` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:47.496066 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0aff10-8dde-4eb8-8777-9c6c2a1b6af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2de94ba38c4d6285396f14d95678bb)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:47.496066 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0aff10-8dde-4eb8-8777-9c6c2a1b6af0 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:47.711980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d8146-38ae-4cd1-93d5-687c7301c36a None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:47.713473 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a06d8146-38ae-4cd1-93d5-687c7301c36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:47.725909 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d8146-38ae-4cd1-93d5-687c7301c36a None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:47.729501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30b5f5-bddd-4b2c-aa3e-ab496d25942b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:47.731251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30b5f5-bddd-4b2c-aa3e-ab496d25942b service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:47.731251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30b5f5-bddd-4b2c-aa3e-ab496d25942b service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:47.731251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30b5f5-bddd-4b2c-aa3e-ab496d25942b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:47.740813 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30b5f5-bddd-4b2c-aa3e-ab496d25942b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:47.742337 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30b5f5-bddd-4b2c-aa3e-ab496d25942b service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:47.751967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1011/2008] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:50:47.821509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ed0aff10-8dde-4eb8-8777-9c6c2a1b6af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2de94ba38c4d6285396f14d95678bb'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:47.835594 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ed0aff10-8dde-4eb8-8777-9c6c2a1b6af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2de94ba38c4d6285396f14d95678bb'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:47.892851 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ed0aff10-8dde-4eb8-8777-9c6c2a1b6af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2de94ba38c4d6285396f14d95678bb'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:47.893526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ed0aff10-8dde-4eb8-8777-9c6c2a1b6af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2de94ba38c4d6285396f14d95678bb'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:47.894294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ed0aff10-8dde-4eb8-8777-9c6c2a1b6af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2de94ba38c4d6285396f14d95678bb'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:47.912669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 998/2009] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:47 2022] DELETE /identity/v3/users/ed2de94ba38c4d6285396f14d95678bb => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:48.162903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:48.264867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=79,keystone:DELETE=16,keystone:INSERT=5 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:48.448037 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30b5f5-bddd-4b2c-aa3e-ab496d25942b service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:48.449640 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ea30b5f5-bddd-4b2c-aa3e-ab496d25942b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:48.467101 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30b5f5-bddd-4b2c-aa3e-ab496d25942b service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:48.528724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eb8c4-8a10-413b-9294-41d61ff23b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:48.529491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eb8c4-8a10-413b-9294-41d61ff23b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:48.529700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eb8c4-8a10-413b-9294-41d61ff23b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:48.534605 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eb8c4-8a10-413b-9294-41d61ff23b73 admin admin] PATH_INFO: `/v3/projects/a591d8d3f0874473bce9458dfdc5f732` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:48.534605 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eb8c4-8a10-413b-9294-41d61ff23b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a591d8d3f0874473bce9458dfdc5f732)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:48.534605 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eb8c4-8a10-413b-9294-41d61ff23b73 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:48.676816 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-826eb8c4-8a10-413b-9294-41d61ff23b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a591d8d3f0874473bce9458dfdc5f732', 'request_id': 'req-826eb8c4-8a10-413b-9294-41d61ff23b73'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:48.685923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-826eb8c4-8a10-413b-9294-41d61ff23b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a591d8d3f0874473bce9458dfdc5f732', 'request_id': 'req-826eb8c4-8a10-413b-9294-41d61ff23b73'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:48.778192 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-826eb8c4-8a10-413b-9294-41d61ff23b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a591d8d3f0874473bce9458dfdc5f732', 'request_id': 'req-826eb8c4-8a10-413b-9294-41d61ff23b73'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:48.789177 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-826eb8c4-8a10-413b-9294-41d61ff23b73 admin admin] The token cache is being invalidate because project a591d8d3f0874473bce9458dfdc5f732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:48.789469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-826eb8c4-8a10-413b-9294-41d61ff23b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:48.790119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-826eb8c4-8a10-413b-9294-41d61ff23b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:48.791640 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1012/2010] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:48 2022] DELETE /identity/v3/projects/a591d8d3f0874473bce9458dfdc5f732 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:48.798738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0857cd-f316-41cf-b91f-71a9e7876848 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:48.799333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0857cd-f316-41cf-b91f-71a9e7876848 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:48.799433 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0857cd-f316-41cf-b91f-71a9e7876848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:48.819559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-cd0857cd-f316-41cf-b91f-71a9e7876848 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:48.820800 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-cd0857cd-f316-41cf-b91f-71a9e7876848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:48.882936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 999/2011] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:48.892242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4720a86-fb8b-4e22-9a96-252523b4bb51 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:48.892610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4720a86-fb8b-4e22-9a96-252523b4bb51 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:48.892887 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4720a86-fb8b-4e22-9a96-252523b4bb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:48.913403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-c4720a86-fb8b-4e22-9a96-252523b4bb51 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:48.914624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c4720a86-fb8b-4e22-9a96-252523b4bb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:48.923242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1013/2012] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:48.928282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0857cd-f316-41cf-b91f-71a9e7876848 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:48.938042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0857cd-f316-41cf-b91f-71a9e7876848 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:48.942977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f280ab5-830b-4d97-a692-c2e2cdce35df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:48.943585 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f280ab5-830b-4d97-a692-c2e2cdce35df admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:48.943866 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f280ab5-830b-4d97-a692-c2e2cdce35df admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:48.944172 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f280ab5-830b-4d97-a692-c2e2cdce35df admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:48.944889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f280ab5-830b-4d97-a692-c2e2cdce35df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:48.945142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f280ab5-830b-4d97-a692-c2e2cdce35df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:48.946766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f280ab5-830b-4d97-a692-c2e2cdce35df admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:48.959472 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1000/2013] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:50:48.964321 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4720a86-fb8b-4e22-9a96-252523b4bb51 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:48.975159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4720a86-fb8b-4e22-9a96-252523b4bb51 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:48.980422 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e3741-7fb8-409e-921f-e370eb637d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:48.981039 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e3741-7fb8-409e-921f-e370eb637d51 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:48.981326 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e3741-7fb8-409e-921f-e370eb637d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:48.981634 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e3741-7fb8-409e-921f-e370eb637d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:48.982379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e3741-7fb8-409e-921f-e370eb637d51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:48.984341 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e3741-7fb8-409e-921f-e370eb637d51 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:49.083018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1014/2014] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:48 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:49.087460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f280ab5-830b-4d97-a692-c2e2cdce35df admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:49.098245 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f280ab5-830b-4d97-a692-c2e2cdce35df admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:49.154312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27079f9d-22b3-48b3-b2bc-df0a44c9a36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:49.154915 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27079f9d-22b3-48b3-b2bc-df0a44c9a36e admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.155193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27079f9d-22b3-48b3-b2bc-df0a44c9a36e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.155462 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27079f9d-22b3-48b3-b2bc-df0a44c9a36e admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.156119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27079f9d-22b3-48b3-b2bc-df0a44c9a36e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:49.158009 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27079f9d-22b3-48b3-b2bc-df0a44c9a36e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:49.257903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1001/2015] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:49 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:49.262166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e3741-7fb8-409e-921f-e370eb637d51 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:49.273352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e3741-7fb8-409e-921f-e370eb637d51 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:49.278477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a23606-44ae-4403-9c07-1da59e8f02f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:49.279148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a23606-44ae-4403-9c07-1da59e8f02f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.279402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a23606-44ae-4403-9c07-1da59e8f02f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.279672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a23606-44ae-4403-9c07-1da59e8f02f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.280359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a23606-44ae-4403-9c07-1da59e8f02f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:49.281997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a23606-44ae-4403-9c07-1da59e8f02f6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:49.296397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1015/2016] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:49.297715 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27079f9d-22b3-48b3-b2bc-df0a44c9a36e admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:49.318608 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27079f9d-22b3-48b3-b2bc-df0a44c9a36e admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:49.323563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf583847-57a9-4af1-94dd-a5d791d8f0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:49.324211 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf583847-57a9-4af1-94dd-a5d791d8f0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.324494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf583847-57a9-4af1-94dd-a5d791d8f0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.324771 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf583847-57a9-4af1-94dd-a5d791d8f0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.326083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf583847-57a9-4af1-94dd-a5d791d8f0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:49.327687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf583847-57a9-4af1-94dd-a5d791d8f0a1 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:49.339343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1002/2017] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:49.351041 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a23606-44ae-4403-9c07-1da59e8f02f6 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:49.362127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a23606-44ae-4403-9c07-1da59e8f02f6 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:49.367635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133176c5-4272-40e4-adc9-29c1aabcd32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:49.368924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133176c5-4272-40e4-adc9-29c1aabcd32a admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.375285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133176c5-4272-40e4-adc9-29c1aabcd32a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.375285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133176c5-4272-40e4-adc9-29c1aabcd32a admin admin] PATH_INFO: `/v3/projects/e3b090003c5546caa4ecd6cd8dbb7594/users/80a4dbd9c74b4e2dbd3598a375f6d846/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.394136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133176c5-4272-40e4-adc9-29c1aabcd32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b090003c5546caa4ecd6cd8dbb7594, user_id=80a4dbd9c74b4e2dbd3598a375f6d846, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:49.397446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133176c5-4272-40e4-adc9-29c1aabcd32a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:49.509722 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1016/2018] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:49 2022] PUT /identity/v3/projects/e3b090003c5546caa4ecd6cd8dbb7594/users/80a4dbd9c74b4e2dbd3598a375f6d846/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:49.522016 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935daccc-59c2-4f73-a0c4-98e3096c2896 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.522340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935daccc-59c2-4f73-a0c4-98e3096c2896 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.522579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935daccc-59c2-4f73-a0c4-98e3096c2896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.551180 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-935daccc-59c2-4f73-a0c4-98e3096c2896 None None] MFA Rules not processed for user `80a4dbd9c74b4e2dbd3598a375f6d846`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:49.552609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-935daccc-59c2-4f73-a0c4-98e3096c2896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:49.656064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1003/2019] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:49.656863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133176c5-4272-40e4-adc9-29c1aabcd32a admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:49.747138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133176c5-4272-40e4-adc9-29c1aabcd32a admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:49.778959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac2c4a-a6b1-4d30-bbfc-7d8f92539936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:49.779856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac2c4a-a6b1-4d30-bbfc-7d8f92539936 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.780174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac2c4a-a6b1-4d30-bbfc-7d8f92539936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.780460 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac2c4a-a6b1-4d30-bbfc-7d8f92539936 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.781114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac2c4a-a6b1-4d30-bbfc-7d8f92539936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:49.783756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac2c4a-a6b1-4d30-bbfc-7d8f92539936 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:49.848398 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1017/2020] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:49 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:50:49.852499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935daccc-59c2-4f73-a0c4-98e3096c2896 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:49.865077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935daccc-59c2-4f73-a0c4-98e3096c2896 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:49.924708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943fd78-7f08-4bb8-8839-8a21cfbccb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:49.925323 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943fd78-7f08-4bb8-8839-8a21cfbccb0a admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.925606 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943fd78-7f08-4bb8-8839-8a21cfbccb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.925883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943fd78-7f08-4bb8-8839-8a21cfbccb0a admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.926527 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943fd78-7f08-4bb8-8839-8a21cfbccb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:49.928464 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943fd78-7f08-4bb8-8839-8a21cfbccb0a admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:50.024038 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1004/2021] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:49 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:50.028213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac2c4a-a6b1-4d30-bbfc-7d8f92539936 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:50.039205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac2c4a-a6b1-4d30-bbfc-7d8f92539936 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:50.044619 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbec03b-c683-44a1-a705-e92ac0768a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:50.045267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbec03b-c683-44a1-a705-e92ac0768a95 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.045553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbec03b-c683-44a1-a705-e92ac0768a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.045827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbec03b-c683-44a1-a705-e92ac0768a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.046482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbec03b-c683-44a1-a705-e92ac0768a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:50.048116 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbec03b-c683-44a1-a705-e92ac0768a95 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:50.058924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1018/2022] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:50.063422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943fd78-7f08-4bb8-8839-8a21cfbccb0a admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:50.073459 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943fd78-7f08-4bb8-8839-8a21cfbccb0a admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:50.078147 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b765ae7-97a6-4fa1-b02d-3ff7fe48a4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:50.078800 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b765ae7-97a6-4fa1-b02d-3ff7fe48a4b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.079119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b765ae7-97a6-4fa1-b02d-3ff7fe48a4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.079397 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b765ae7-97a6-4fa1-b02d-3ff7fe48a4b7 admin admin] PATH_INFO: `/v3/projects/1e3e1adf03b34fb2b14d039c4f35655b/users/38b42e426e624a78916cbf890d4bb058/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.095094 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b765ae7-97a6-4fa1-b02d-3ff7fe48a4b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3e1adf03b34fb2b14d039c4f35655b, user_id=38b42e426e624a78916cbf890d4bb058, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:50.097881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b765ae7-97a6-4fa1-b02d-3ff7fe48a4b7 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:50.149673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1005/2023] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:50 2022] PUT /identity/v3/projects/1e3e1adf03b34fb2b14d039c4f35655b/users/38b42e426e624a78916cbf890d4bb058/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:50:50.154413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbec03b-c683-44a1-a705-e92ac0768a95 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:50.167240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbec03b-c683-44a1-a705-e92ac0768a95 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:50.213876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:50.234846 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fd274-620a-4d71-b77c-6fd581bc3fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:50.235681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fd274-620a-4d71-b77c-6fd581bc3fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.236009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fd274-620a-4d71-b77c-6fd581bc3fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.236285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fd274-620a-4d71-b77c-6fd581bc3fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.237436 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fd274-620a-4d71-b77c-6fd581bc3fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:50.239740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fd274-620a-4d71-b77c-6fd581bc3fc7 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:50.252449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1019/2024] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:50.257622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b765ae7-97a6-4fa1-b02d-3ff7fe48a4b7 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:50.280334 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b765ae7-97a6-4fa1-b02d-3ff7fe48a4b7 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:50.280522 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:50.280693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4ac28-97fd-419e-8d0e-802e9995a89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:50.280693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4ac28-97fd-419e-8d0e-802e9995a89b admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.280693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4ac28-97fd-419e-8d0e-802e9995a89b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.280693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4ac28-97fd-419e-8d0e-802e9995a89b admin admin] PATH_INFO: `/v3/projects/1e3e1adf03b34fb2b14d039c4f35655b/users/38b42e426e624a78916cbf890d4bb058/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.281659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4ac28-97fd-419e-8d0e-802e9995a89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3e1adf03b34fb2b14d039c4f35655b, user_id=38b42e426e624a78916cbf890d4bb058, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:50.285090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4ac28-97fd-419e-8d0e-802e9995a89b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:50.298694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1006/2025] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:50 2022] PUT /identity/v3/projects/1e3e1adf03b34fb2b14d039c4f35655b/users/38b42e426e624a78916cbf890d4bb058/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:50.316523 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e0519-d037-4c98-8e6d-88e073dfa3d2 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.316523 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e0519-d037-4c98-8e6d-88e073dfa3d2 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.316886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e0519-d037-4c98-8e6d-88e073dfa3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.352975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-447e0519-d037-4c98-8e6d-88e073dfa3d2 None None] MFA Rules not processed for user `38b42e426e624a78916cbf890d4bb058`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:50.354305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-447e0519-d037-4c98-8e6d-88e073dfa3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:50.423263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1020/2026] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:50.434604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4ac28-97fd-419e-8d0e-802e9995a89b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:50.436355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6bc4ac28-97fd-419e-8d0e-802e9995a89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:50.497935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4ac28-97fd-419e-8d0e-802e9995a89b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:50.501632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d1f4f-c982-4fb1-bf55-71f7935f192e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:50.502223 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d1f4f-c982-4fb1-bf55-71f7935f192e service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.502504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d1f4f-c982-4fb1-bf55-71f7935f192e service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.502779 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d1f4f-c982-4fb1-bf55-71f7935f192e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.561719 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d1f4f-c982-4fb1-bf55-71f7935f192e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:50.563260 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d1f4f-c982-4fb1-bf55-71f7935f192e service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:50.574034 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1007/2027] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:51.075232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:51.286694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:51.846909 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:51.871332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e0519-d037-4c98-8e6d-88e073dfa3d2 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:51.872690 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-447e0519-d037-4c98-8e6d-88e073dfa3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:51.943068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e0519-d037-4c98-8e6d-88e073dfa3d2 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:51.947949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e85b85-6e61-45a7-b14d-9b66b2a69901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:51.948671 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e85b85-6e61-45a7-b14d-9b66b2a69901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:51.951776 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e85b85-6e61-45a7-b14d-9b66b2a69901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:51.951776 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e85b85-6e61-45a7-b14d-9b66b2a69901 admin admin] PATH_INFO: `/v3/users/65c6981a7fab453fb482cecd9986b9ae` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:51.951776 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e85b85-6e61-45a7-b14d-9b66b2a69901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c6981a7fab453fb482cecd9986b9ae)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:51.953100 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e85b85-6e61-45a7-b14d-9b66b2a69901 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:52.144312 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a9e85b85-6e61-45a7-b14d-9b66b2a69901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c6981a7fab453fb482cecd9986b9ae'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:52.144312 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a9e85b85-6e61-45a7-b14d-9b66b2a69901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c6981a7fab453fb482cecd9986b9ae'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:52.209094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a9e85b85-6e61-45a7-b14d-9b66b2a69901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c6981a7fab453fb482cecd9986b9ae'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:52.209094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a9e85b85-6e61-45a7-b14d-9b66b2a69901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c6981a7fab453fb482cecd9986b9ae'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:52.220552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a9e85b85-6e61-45a7-b14d-9b66b2a69901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c6981a7fab453fb482cecd9986b9ae'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:52.237468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1021/2028] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:51 2022] DELETE /identity/v3/users/65c6981a7fab453fb482cecd9986b9ae => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:52.242070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32761890-b05b-4c0a-8759-32aa9753f389 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:52.242360 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32761890-b05b-4c0a-8759-32aa9753f389 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:52.242677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32761890-b05b-4c0a-8759-32aa9753f389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:52.263728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-32761890-b05b-4c0a-8759-32aa9753f389 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:52.265523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-32761890-b05b-4c0a-8759-32aa9753f389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:52.334322 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1008/2029] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:52.348874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e85b85-6e61-45a7-b14d-9b66b2a69901 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:52.360284 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a9e85b85-6e61-45a7-b14d-9b66b2a69901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:52.432784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e85b85-6e61-45a7-b14d-9b66b2a69901 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:52.437610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d6d8a-c25b-4f70-84bb-3eb969891c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:52.438273 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d6d8a-c25b-4f70-84bb-3eb969891c0a service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:52.438558 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d6d8a-c25b-4f70-84bb-3eb969891c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:52.438828 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d6d8a-c25b-4f70-84bb-3eb969891c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:52.454547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d6d8a-c25b-4f70-84bb-3eb969891c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:52.456162 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d6d8a-c25b-4f70-84bb-3eb969891c0a service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:52.479568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1022/2030] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:52.544761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:53.330740 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32761890-b05b-4c0a-8759-32aa9753f389 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:53.332245 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-32761890-b05b-4c0a-8759-32aa9753f389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:53.344737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:53.360345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32761890-b05b-4c0a-8759-32aa9753f389 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:53.370754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91917858-1b04-4a49-91e5-5fdcc723a016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:53.371419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91917858-1b04-4a49-91e5-5fdcc723a016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:53.371699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91917858-1b04-4a49-91e5-5fdcc723a016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:53.373817 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91917858-1b04-4a49-91e5-5fdcc723a016 admin admin] PATH_INFO: `/v3/projects/d523d9be2d0c43e8943ba841a4beac55` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:53.388319 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91917858-1b04-4a49-91e5-5fdcc723a016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d523d9be2d0c43e8943ba841a4beac55)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:53.388319 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91917858-1b04-4a49-91e5-5fdcc723a016 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:53.550145 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-91917858-1b04-4a49-91e5-5fdcc723a016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd523d9be2d0c43e8943ba841a4beac55', 'request_id': 'req-91917858-1b04-4a49-91e5-5fdcc723a016'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:53.635291 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-91917858-1b04-4a49-91e5-5fdcc723a016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd523d9be2d0c43e8943ba841a4beac55', 'request_id': 'req-91917858-1b04-4a49-91e5-5fdcc723a016'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:53.643107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-91917858-1b04-4a49-91e5-5fdcc723a016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd523d9be2d0c43e8943ba841a4beac55', 'request_id': 'req-91917858-1b04-4a49-91e5-5fdcc723a016'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:53.655796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-91917858-1b04-4a49-91e5-5fdcc723a016 admin admin] The token cache is being invalidate because project d523d9be2d0c43e8943ba841a4beac55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:53.656108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-91917858-1b04-4a49-91e5-5fdcc723a016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:53.656844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-91917858-1b04-4a49-91e5-5fdcc723a016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:53.658355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1009/2031] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:53 2022] DELETE /identity/v3/projects/d523d9be2d0c43e8943ba841a4beac55 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:53.662384 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d6d8a-c25b-4f70-84bb-3eb969891c0a service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:53.672002 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d6d8a-c25b-4f70-84bb-3eb969891c0a service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:53.732414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745cd48-ef7f-47b7-892f-ad594f6657e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:53.733189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745cd48-ef7f-47b7-892f-ad594f6657e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:53.733473 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745cd48-ef7f-47b7-892f-ad594f6657e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:53.733743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745cd48-ef7f-47b7-892f-ad594f6657e6 admin admin] PATH_INFO: `/v3/users/1e1a19550ba64253b1849758a54501ec` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:53.734866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745cd48-ef7f-47b7-892f-ad594f6657e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e1a19550ba64253b1849758a54501ec)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:53.736893 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745cd48-ef7f-47b7-892f-ad594f6657e6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:53.902143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9745cd48-ef7f-47b7-892f-ad594f6657e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e1a19550ba64253b1849758a54501ec'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:53.902738 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9745cd48-ef7f-47b7-892f-ad594f6657e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e1a19550ba64253b1849758a54501ec'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:53.961440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9745cd48-ef7f-47b7-892f-ad594f6657e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e1a19550ba64253b1849758a54501ec'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:53.962915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9745cd48-ef7f-47b7-892f-ad594f6657e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e1a19550ba64253b1849758a54501ec'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:53.986262 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9745cd48-ef7f-47b7-892f-ad594f6657e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e1a19550ba64253b1849758a54501ec'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:54.000979 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1023/2032] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:53 2022] DELETE /identity/v3/users/1e1a19550ba64253b1849758a54501ec => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:54.144081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:54.332708 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:54.509526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91917858-1b04-4a49-91e5-5fdcc723a016 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:54.511082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-91917858-1b04-4a49-91e5-5fdcc723a016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:54.545629 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91917858-1b04-4a49-91e5-5fdcc723a016 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:54.674713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322824a-2c02-449c-9a93-7f08ccc8730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:54.676338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322824a-2c02-449c-9a93-7f08ccc8730a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:54.676839 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322824a-2c02-449c-9a93-7f08ccc8730a admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:54.677327 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322824a-2c02-449c-9a93-7f08ccc8730a admin admin] PATH_INFO: `/v3/projects/20fe306c9f1142899a5a3aa3d5196be7` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:54.679533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322824a-2c02-449c-9a93-7f08ccc8730a admin admin] RBAC: Authorizing `identity:delete_project(project_id=20fe306c9f1142899a5a3aa3d5196be7)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:54.682421 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322824a-2c02-449c-9a93-7f08ccc8730a admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:54.838237 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2322824a-2c02-449c-9a93-7f08ccc8730a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20fe306c9f1142899a5a3aa3d5196be7', 'request_id': 'req-2322824a-2c02-449c-9a93-7f08ccc8730a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:54.957253 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2322824a-2c02-449c-9a93-7f08ccc8730a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20fe306c9f1142899a5a3aa3d5196be7', 'request_id': 'req-2322824a-2c02-449c-9a93-7f08ccc8730a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:54.962571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2322824a-2c02-449c-9a93-7f08ccc8730a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20fe306c9f1142899a5a3aa3d5196be7', 'request_id': 'req-2322824a-2c02-449c-9a93-7f08ccc8730a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:54.974365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2322824a-2c02-449c-9a93-7f08ccc8730a admin admin] The token cache is being invalidate because project 20fe306c9f1142899a5a3aa3d5196be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:54.974686 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2322824a-2c02-449c-9a93-7f08ccc8730a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:54.975445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2322824a-2c02-449c-9a93-7f08ccc8730a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:54.977160 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1010/2033] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:54 2022] DELETE /identity/v3/projects/20fe306c9f1142899a5a3aa3d5196be7 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:54.982091 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dc2be-5d36-4e1b-a25a-bec023dff8dc None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:54.983066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dc2be-5d36-4e1b-a25a-bec023dff8dc None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:54.983184 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dc2be-5d36-4e1b-a25a-bec023dff8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:55.004827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-377dc2be-5d36-4e1b-a25a-bec023dff8dc None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:55.006039 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-377dc2be-5d36-4e1b-a25a-bec023dff8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:55.083531 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1024/2034] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:55.091230 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d59f1b-4c5c-4ee2-9483-979cd254840e None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:55.091610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d59f1b-4c5c-4ee2-9483-979cd254840e None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:55.091925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d59f1b-4c5c-4ee2-9483-979cd254840e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:55.114068 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-13d59f1b-4c5c-4ee2-9483-979cd254840e None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:55.115283 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-13d59f1b-4c5c-4ee2-9483-979cd254840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:55.124390 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1011/2035] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:55.129558 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dc2be-5d36-4e1b-a25a-bec023dff8dc None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:55.139895 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dc2be-5d36-4e1b-a25a-bec023dff8dc None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:55.145580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c81168-9485-425c-a1c7-d40d7839e155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:55.146199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c81168-9485-425c-a1c7-d40d7839e155 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:55.146488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c81168-9485-425c-a1c7-d40d7839e155 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:55.147083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c81168-9485-425c-a1c7-d40d7839e155 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:55.147890 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c81168-9485-425c-a1c7-d40d7839e155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:55.148267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c81168-9485-425c-a1c7-d40d7839e155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:55.148922 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:55.149917 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c81168-9485-425c-a1c7-d40d7839e155 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:55.166188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1025/2036] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:50:55.167342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d59f1b-4c5c-4ee2-9483-979cd254840e None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:55.177920 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d59f1b-4c5c-4ee2-9483-979cd254840e None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:55.186876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc103e2c-471d-4eb0-ace8-92fad595c5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:55.186876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc103e2c-471d-4eb0-ace8-92fad595c5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:55.186876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc103e2c-471d-4eb0-ace8-92fad595c5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:55.186876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc103e2c-471d-4eb0-ace8-92fad595c5d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:55.187192 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc103e2c-471d-4eb0-ace8-92fad595c5d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:55.188525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc103e2c-471d-4eb0-ace8-92fad595c5d4 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:55.333434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1012/2037] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:55 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:55.334189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c81168-9485-425c-a1c7-d40d7839e155 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:55.346962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c81168-9485-425c-a1c7-d40d7839e155 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:55.417559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc103e2c-471d-4eb0-ace8-92fad595c5d4 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:55.420943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-dc103e2c-471d-4eb0-ace8-92fad595c5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:55.431647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c6d47-8a7f-42b3-8e38-2b26aa6edcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:55.432414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c6d47-8a7f-42b3-8e38-2b26aa6edcb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:55.432839 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c6d47-8a7f-42b3-8e38-2b26aa6edcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:55.433100 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c6d47-8a7f-42b3-8e38-2b26aa6edcb7 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:55.434132 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c6d47-8a7f-42b3-8e38-2b26aa6edcb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:55.436374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c6d47-8a7f-42b3-8e38-2b26aa6edcb7 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:55.446800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:55.531540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc103e2c-471d-4eb0-ace8-92fad595c5d4 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:55.537937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883d765-1e77-46d9-96fc-7014758450d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:55.538766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883d765-1e77-46d9-96fc-7014758450d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:55.539052 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883d765-1e77-46d9-96fc-7014758450d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:55.539331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883d765-1e77-46d9-96fc-7014758450d9 admin admin] PATH_INFO: `/v3/users/9593804af7f94f6b821b67bfb67c3edc` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:55.540618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883d765-1e77-46d9-96fc-7014758450d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9593804af7f94f6b821b67bfb67c3edc)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:55.543071 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883d765-1e77-46d9-96fc-7014758450d9 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:55.559784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1026/2038] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:55 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:55.564685 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c6d47-8a7f-42b3-8e38-2b26aa6edcb7 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:55.579317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c6d47-8a7f-42b3-8e38-2b26aa6edcb7 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:55.593342 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec38ad6-9c38-4ae5-b1d7-2249a47a7c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:55.593342 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec38ad6-9c38-4ae5-b1d7-2249a47a7c64 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:55.593342 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec38ad6-9c38-4ae5-b1d7-2249a47a7c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:55.593779 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec38ad6-9c38-4ae5-b1d7-2249a47a7c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:55.594269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec38ad6-9c38-4ae5-b1d7-2249a47a7c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:55.596610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec38ad6-9c38-4ae5-b1d7-2249a47a7c64 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:55.624256 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1027/2039] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:55.624256 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec38ad6-9c38-4ae5-b1d7-2249a47a7c64 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:55.635164 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec38ad6-9c38-4ae5-b1d7-2249a47a7c64 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:55.651835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeba2f-79d5-4ff9-9656-e59a8c552bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:55.651835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeba2f-79d5-4ff9-9656-e59a8c552bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:55.651835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeba2f-79d5-4ff9-9656-e59a8c552bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:55.651835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeba2f-79d5-4ff9-9656-e59a8c552bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:55.652226 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeba2f-79d5-4ff9-9656-e59a8c552bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:55.652226 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeba2f-79d5-4ff9-9656-e59a8c552bf6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:55.663489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1028/2040] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:50:55.669335 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeba2f-79d5-4ff9-9656-e59a8c552bf6 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:55.681691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeba2f-79d5-4ff9-9656-e59a8c552bf6 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:55.688276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0d986-d5ae-4448-a97e-56fcce371c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:55.688276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0d986-d5ae-4448-a97e-56fcce371c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:55.688645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0d986-d5ae-4448-a97e-56fcce371c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:55.689018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0d986-d5ae-4448-a97e-56fcce371c7d admin admin] PATH_INFO: `/v3/projects/d3fe7654851d46a9ab3f05092c01dd0e/users/e2dacaa551c4410c92352cc8b32ec7e8/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:55.722516 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0d986-d5ae-4448-a97e-56fcce371c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3fe7654851d46a9ab3f05092c01dd0e, user_id=e2dacaa551c4410c92352cc8b32ec7e8, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:55.726331 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0d986-d5ae-4448-a97e-56fcce371c7d admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:55.827304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1029/2041] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:55 2022] PUT /identity/v3/projects/d3fe7654851d46a9ab3f05092c01dd0e/users/e2dacaa551c4410c92352cc8b32ec7e8/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:55.846975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f936d-0690-415a-abe8-3c12b1624785 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:55.847261 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f936d-0690-415a-abe8-3c12b1624785 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:55.847539 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f936d-0690-415a-abe8-3c12b1624785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:55.861018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3883d765-1e77-46d9-96fc-7014758450d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9593804af7f94f6b821b67bfb67c3edc'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:55.873911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3883d765-1e77-46d9-96fc-7014758450d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9593804af7f94f6b821b67bfb67c3edc'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:55.898269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-3e9f936d-0690-415a-abe8-3c12b1624785 None None] MFA Rules not processed for user `e2dacaa551c4410c92352cc8b32ec7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:55.899479 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3e9f936d-0690-415a-abe8-3c12b1624785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:55.949665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3883d765-1e77-46d9-96fc-7014758450d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9593804af7f94f6b821b67bfb67c3edc'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:55.950298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3883d765-1e77-46d9-96fc-7014758450d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9593804af7f94f6b821b67bfb67c3edc'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:55.950957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3883d765-1e77-46d9-96fc-7014758450d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9593804af7f94f6b821b67bfb67c3edc'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:55.966951 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1013/2042] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:55 2022] DELETE /identity/v3/users/9593804af7f94f6b821b67bfb67c3edc => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:55.971124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1030/2043] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:55.975540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2322e2-bdb5-4a63-ab02-911ec1b0dd21 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:55.975789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f936d-0690-415a-abe8-3c12b1624785 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:55.976652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2322e2-bdb5-4a63-ab02-911ec1b0dd21 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:55.977055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2322e2-bdb5-4a63-ab02-911ec1b0dd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:55.977544 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3e9f936d-0690-415a-abe8-3c12b1624785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:56.003100 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-7c2322e2-bdb5-4a63-ab02-911ec1b0dd21 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:56.004403 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-7c2322e2-bdb5-4a63-ab02-911ec1b0dd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:56.012377 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:56.064031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f936d-0690-415a-abe8-3c12b1624785 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:56.072339 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:56.105295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1014/2044] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:56.117789 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2322e2-bdb5-4a63-ab02-911ec1b0dd21 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:56.120737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-7c2322e2-bdb5-4a63-ab02-911ec1b0dd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:56.152519 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca12ca-0856-4f5c-93e8-6b28491b094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:56.154090 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca12ca-0856-4f5c-93e8-6b28491b094b admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:56.154457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca12ca-0856-4f5c-93e8-6b28491b094b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:56.155013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca12ca-0856-4f5c-93e8-6b28491b094b admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:56.155791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca12ca-0856-4f5c-93e8-6b28491b094b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:56.160237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca12ca-0856-4f5c-93e8-6b28491b094b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:56.246220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2322e2-bdb5-4a63-ab02-911ec1b0dd21 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:56.251420 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92826cc9-b075-4913-820e-7e852e986ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:56.253056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92826cc9-b075-4913-820e-7e852e986ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:56.253641 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92826cc9-b075-4913-820e-7e852e986ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:56.254085 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92826cc9-b075-4913-820e-7e852e986ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:56.268989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92826cc9-b075-4913-820e-7e852e986ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:56.270584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92826cc9-b075-4913-820e-7e852e986ac6 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:56.287639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1015/2045] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:56.337844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1031/2046] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:55 2022] POST /identity/v3/projects => generated 387 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:50:56.346071 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92826cc9-b075-4913-820e-7e852e986ac6 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:56.361438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92826cc9-b075-4913-820e-7e852e986ac6 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:56.443874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0de9b-1a86-4c0c-ac9b-e5925961f2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:56.444527 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0de9b-1a86-4c0c-ac9b-e5925961f2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:56.444931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0de9b-1a86-4c0c-ac9b-e5925961f2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:56.445362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0de9b-1a86-4c0c-ac9b-e5925961f2a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:56.446040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0de9b-1a86-4c0c-ac9b-e5925961f2a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:56.448631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0de9b-1a86-4c0c-ac9b-e5925961f2a0 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:56.503605 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca12ca-0856-4f5c-93e8-6b28491b094b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:56.509123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a1ca12ca-0856-4f5c-93e8-6b28491b094b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:56.578903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1016/2047] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:56 2022] POST /identity/v3/users => generated 300 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:56.581210 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0de9b-1a86-4c0c-ac9b-e5925961f2a0 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:56.599093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0de9b-1a86-4c0c-ac9b-e5925961f2a0 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:56.609778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a7b63-b90b-4bf1-b876-019d99fd5589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:56.610963 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a7b63-b90b-4bf1-b876-019d99fd5589 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:56.612818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a7b63-b90b-4bf1-b876-019d99fd5589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:56.613257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a7b63-b90b-4bf1-b876-019d99fd5589 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:56.619725 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca12ca-0856-4f5c-93e8-6b28491b094b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:56.621674 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a7b63-b90b-4bf1-b876-019d99fd5589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:56.624311 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a7b63-b90b-4bf1-b876-019d99fd5589 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:56.624631 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e71fae-27f1-448a-9fae-59188a4a24e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:56.625248 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e71fae-27f1-448a-9fae-59188a4a24e0 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:56.625681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e71fae-27f1-448a-9fae-59188a4a24e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:56.625962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e71fae-27f1-448a-9fae-59188a4a24e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:56.628668 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-99e71fae-27f1-448a-9fae-59188a4a24e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:56.635669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:56.641981 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1017/2048] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:50:56.645776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a7b63-b90b-4bf1-b876-019d99fd5589 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:56.665615 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a7b63-b90b-4bf1-b876-019d99fd5589 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:56.674702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501054e3-4760-4bd2-b1ab-5f70262234a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:56.676329 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501054e3-4760-4bd2-b1ab-5f70262234a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:56.676856 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501054e3-4760-4bd2-b1ab-5f70262234a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:56.677234 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501054e3-4760-4bd2-b1ab-5f70262234a2 admin admin] PATH_INFO: `/v3/projects/19c41fabac624afdb3604d31b0258ad2/users/fb5e60937d66462bba2b67593135e8f7/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:56.681818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:56.701205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501054e3-4760-4bd2-b1ab-5f70262234a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c41fabac624afdb3604d31b0258ad2, user_id=fb5e60937d66462bba2b67593135e8f7, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:56.703774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501054e3-4760-4bd2-b1ab-5f70262234a2 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:56.715191 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e71fae-27f1-448a-9fae-59188a4a24e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:56.717229 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e71fae-27f1-448a-9fae-59188a4a24e0 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:56.728701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1032/2049] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:56.767663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bcc52-ed90-4ff9-b540-54d7f91147e4 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:56.767953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bcc52-ed90-4ff9-b540-54d7f91147e4 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:56.768273 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bcc52-ed90-4ff9-b540-54d7f91147e4 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:56.769652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1033/2050] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 29 22:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:50:56.799835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3663a-0a84-4adb-9ffc-d6be468e2e17 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:56.800701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3663a-0a84-4adb-9ffc-d6be468e2e17 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:56.800701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3663a-0a84-4adb-9ffc-d6be468e2e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:56.821678 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-48e3663a-0a84-4adb-9ffc-d6be468e2e17 None None] MFA Rules not processed for user `2991c613878e4993901199434f384f49`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:56.823111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-48e3663a-0a84-4adb-9ffc-d6be468e2e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:56.855715 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1018/2051] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:56 2022] PUT /identity/v3/projects/19c41fabac624afdb3604d31b0258ad2/users/fb5e60937d66462bba2b67593135e8f7/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:56.860219 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501054e3-4760-4bd2-b1ab-5f70262234a2 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:56.923700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1034/2052] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 29 22:50:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:56.924664 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3663a-0a84-4adb-9ffc-d6be468e2e17 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:56.926547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-48e3663a-0a84-4adb-9ffc-d6be468e2e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:56.954068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3663a-0a84-4adb-9ffc-d6be468e2e17 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:57.011942 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501054e3-4760-4bd2-b1ab-5f70262234a2 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:57.018074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92a7b7-5857-4482-b47b-a2f869c1816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:57.018694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92a7b7-5857-4482-b47b-a2f869c1816b admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:57.018975 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92a7b7-5857-4482-b47b-a2f869c1816b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:57.019248 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92a7b7-5857-4482-b47b-a2f869c1816b admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:57.019895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92a7b7-5857-4482-b47b-a2f869c1816b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:57.021839 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92a7b7-5857-4482-b47b-a2f869c1816b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:57.027070 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25241043-71a0-4531-8349-1ef8676a34c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:57.028380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25241043-71a0-4531-8349-1ef8676a34c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:57.028736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25241043-71a0-4531-8349-1ef8676a34c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:57.029083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25241043-71a0-4531-8349-1ef8676a34c2 admin admin] PATH_INFO: `/v3/users/b7998943912747c6935db310ff1a4b3a` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:57.031176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25241043-71a0-4531-8349-1ef8676a34c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7998943912747c6935db310ff1a4b3a)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:57.033265 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25241043-71a0-4531-8349-1ef8676a34c2 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:57.033383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1019/2053] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:57.034135 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92a7b7-5857-4482-b47b-a2f869c1816b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:57.035759 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9a92a7b7-5857-4482-b47b-a2f869c1816b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:57.049618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92a7b7-5857-4482-b47b-a2f869c1816b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:57.054586 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dff0be-2527-46d3-bf20-52c88d8a5fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:57.056294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dff0be-2527-46d3-bf20-52c88d8a5fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:57.056294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dff0be-2527-46d3-bf20-52c88d8a5fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:57.056294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dff0be-2527-46d3-bf20-52c88d8a5fe1 admin admin] PATH_INFO: `/v3/projects/8ced50dfdfe74f6f99dd8b8d845ac37f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:57.059377 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dff0be-2527-46d3-bf20-52c88d8a5fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ced50dfdfe74f6f99dd8b8d845ac37f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:57.059377 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dff0be-2527-46d3-bf20-52c88d8a5fe1 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:57.086928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:57.220720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-16dff0be-2527-46d3-bf20-52c88d8a5fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ced50dfdfe74f6f99dd8b8d845ac37f', 'request_id': 'req-16dff0be-2527-46d3-bf20-52c88d8a5fe1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:57.220939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-25241043-71a0-4531-8349-1ef8676a34c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7998943912747c6935db310ff1a4b3a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:57.221422 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-25241043-71a0-4531-8349-1ef8676a34c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7998943912747c6935db310ff1a4b3a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:57.292295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-16dff0be-2527-46d3-bf20-52c88d8a5fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ced50dfdfe74f6f99dd8b8d845ac37f', 'request_id': 'req-16dff0be-2527-46d3-bf20-52c88d8a5fe1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:57.299129 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-16dff0be-2527-46d3-bf20-52c88d8a5fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ced50dfdfe74f6f99dd8b8d845ac37f', 'request_id': 'req-16dff0be-2527-46d3-bf20-52c88d8a5fe1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:57.311441 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-16dff0be-2527-46d3-bf20-52c88d8a5fe1 admin admin] The token cache is being invalidate because project 8ced50dfdfe74f6f99dd8b8d845ac37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:57.311735 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-16dff0be-2527-46d3-bf20-52c88d8a5fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:57.312420 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-16dff0be-2527-46d3-bf20-52c88d8a5fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:57.313916 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1020/2054] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:57 2022] DELETE /identity/v3/projects/8ced50dfdfe74f6f99dd8b8d845ac37f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:57.314780 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dff0be-2527-46d3-bf20-52c88d8a5fe1 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:57.316052 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-16dff0be-2527-46d3-bf20-52c88d8a5fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:57.384155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dff0be-2527-46d3-bf20-52c88d8a5fe1 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:57.389617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f032bf9-dcbb-499a-814a-a1affd943d1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2991c613878e4993901199434f384f49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:57.390227 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f032bf9-dcbb-499a-814a-a1affd943d1b service placement] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:57.394741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f032bf9-dcbb-499a-814a-a1affd943d1b service placement] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:57.394741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f032bf9-dcbb-499a-814a-a1affd943d1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:57.398523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1f032bf9-dcbb-499a-814a-a1affd943d1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:57.406733 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-25241043-71a0-4531-8349-1ef8676a34c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7998943912747c6935db310ff1a4b3a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:57.412140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-25241043-71a0-4531-8349-1ef8676a34c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7998943912747c6935db310ff1a4b3a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:57.414175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f032bf9-dcbb-499a-814a-a1affd943d1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:57.415901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f032bf9-dcbb-499a-814a-a1affd943d1b service placement] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:57.422184 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-25241043-71a0-4531-8349-1ef8676a34c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7998943912747c6935db310ff1a4b3a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:57.428166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1021/2055] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:57.429040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f032bf9-dcbb-499a-814a-a1affd943d1b service placement] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:57.430737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1f032bf9-dcbb-499a-814a-a1affd943d1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:57.437607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1035/2056] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:56 2022] DELETE /identity/v3/users/b7998943912747c6935db310ff1a4b3a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:57.441152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25241043-71a0-4531-8349-1ef8676a34c2 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:57.441152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-25241043-71a0-4531-8349-1ef8676a34c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:57.522255 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25241043-71a0-4531-8349-1ef8676a34c2 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:57.527456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8524c56-0692-4ebe-b7b2-5e35c8ed3b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:57.528117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8524c56-0692-4ebe-b7b2-5e35c8ed3b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:57.529078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8524c56-0692-4ebe-b7b2-5e35c8ed3b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:57.529882 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8524c56-0692-4ebe-b7b2-5e35c8ed3b1e admin admin] PATH_INFO: `/v3/users/60b7f73259a3418690c0fc2b55fefe7e` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:57.532710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8524c56-0692-4ebe-b7b2-5e35c8ed3b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b7f73259a3418690c0fc2b55fefe7e)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:57.534939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8524c56-0692-4ebe-b7b2-5e35c8ed3b1e admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:57.537552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f032bf9-dcbb-499a-814a-a1affd943d1b service placement] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:57.543218 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3895c-501f-4012-b9ce-f2e589451a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:57.544008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3895c-501f-4012-b9ce-f2e589451a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:57.544448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3895c-501f-4012-b9ce-f2e589451a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:57.545406 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3895c-501f-4012-b9ce-f2e589451a49 admin admin] PATH_INFO: `/v3/projects/19c41fabac624afdb3604d31b0258ad2/users/fb5e60937d66462bba2b67593135e8f7/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:57.547751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3895c-501f-4012-b9ce-f2e589451a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c41fabac624afdb3604d31b0258ad2, user_id=fb5e60937d66462bba2b67593135e8f7, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:57.550852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3895c-501f-4012-b9ce-f2e589451a49 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:57.572742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1022/2057] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:57 2022] PUT /identity/v3/projects/19c41fabac624afdb3604d31b0258ad2/users/fb5e60937d66462bba2b67593135e8f7/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:57.578213 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845891c-4f25-4aa7-9449-da4646819b4e None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:57.578690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845891c-4f25-4aa7-9449-da4646819b4e None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:57.579031 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845891c-4f25-4aa7-9449-da4646819b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:57.616053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-c845891c-4f25-4aa7-9449-da4646819b4e None None] MFA Rules not processed for user `fb5e60937d66462bba2b67593135e8f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:57.617372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-c845891c-4f25-4aa7-9449-da4646819b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:57.686888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1023/2058] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:57.698958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845891c-4f25-4aa7-9449-da4646819b4e None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:57.700496 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-c845891c-4f25-4aa7-9449-da4646819b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:57.771476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845891c-4f25-4aa7-9449-da4646819b4e None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:57.777513 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa87aac-b80d-4579-935a-c1321c25c195 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:57.778428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa87aac-b80d-4579-935a-c1321c25c195 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:57.778932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa87aac-b80d-4579-935a-c1321c25c195 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:57.780154 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa87aac-b80d-4579-935a-c1321c25c195 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:57.787632 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d8524c56-0692-4ebe-b7b2-5e35c8ed3b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b7f73259a3418690c0fc2b55fefe7e'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:57.788848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d8524c56-0692-4ebe-b7b2-5e35c8ed3b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b7f73259a3418690c0fc2b55fefe7e'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:57.797848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa87aac-b80d-4579-935a-c1321c25c195 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:57.799813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa87aac-b80d-4579-935a-c1321c25c195 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:57.813664 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1024/2059] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:50:57.814966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa87aac-b80d-4579-935a-c1321c25c195 service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:57.817429 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-baa87aac-b80d-4579-935a-c1321c25c195 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:57.870409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:57.871240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d8524c56-0692-4ebe-b7b2-5e35c8ed3b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b7f73259a3418690c0fc2b55fefe7e'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:57.872485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d8524c56-0692-4ebe-b7b2-5e35c8ed3b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b7f73259a3418690c0fc2b55fefe7e'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:57.887900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d8524c56-0692-4ebe-b7b2-5e35c8ed3b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b7f73259a3418690c0fc2b55fefe7e'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:57.898720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa87aac-b80d-4579-935a-c1321c25c195 service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:57.904170 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139a7d5-5556-43d0-b85b-d1c9403d65b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:57.904800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1036/2060] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:57 2022] DELETE /identity/v3/users/60b7f73259a3418690c0fc2b55fefe7e => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:57.905181 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139a7d5-5556-43d0-b85b-d1c9403d65b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:57.905494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139a7d5-5556-43d0-b85b-d1c9403d65b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:57.906582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139a7d5-5556-43d0-b85b-d1c9403d65b6 admin admin] PATH_INFO: `/v3/projects/b22fd9e58c694121a162b855555cd884` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:57.906695 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8524c56-0692-4ebe-b7b2-5e35c8ed3b1e admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:57.906931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139a7d5-5556-43d0-b85b-d1c9403d65b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b22fd9e58c694121a162b855555cd884)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:57.908424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d8524c56-0692-4ebe-b7b2-5e35c8ed3b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:57.915952 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139a7d5-5556-43d0-b85b-d1c9403d65b6 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:57.979835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8524c56-0692-4ebe-b7b2-5e35c8ed3b1e admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:57.984674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc8fa6-38b8-4c9c-87ef-252f7e3a8362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:57.985319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc8fa6-38b8-4c9c-87ef-252f7e3a8362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:57.985599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc8fa6-38b8-4c9c-87ef-252f7e3a8362 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:57.986059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc8fa6-38b8-4c9c-87ef-252f7e3a8362 admin admin] PATH_INFO: `/v3/users/e2dacaa551c4410c92352cc8b32ec7e8` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:57.987212 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc8fa6-38b8-4c9c-87ef-252f7e3a8362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2dacaa551c4410c92352cc8b32ec7e8)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:57.989197 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc8fa6-38b8-4c9c-87ef-252f7e3a8362 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:58.051384 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-f139a7d5-5556-43d0-b85b-d1c9403d65b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b22fd9e58c694121a162b855555cd884', 'request_id': 'req-f139a7d5-5556-43d0-b85b-d1c9403d65b6'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:58.142931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-f139a7d5-5556-43d0-b85b-d1c9403d65b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b22fd9e58c694121a162b855555cd884', 'request_id': 'req-f139a7d5-5556-43d0-b85b-d1c9403d65b6'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:58.152566 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-f139a7d5-5556-43d0-b85b-d1c9403d65b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b22fd9e58c694121a162b855555cd884', 'request_id': 'req-f139a7d5-5556-43d0-b85b-d1c9403d65b6'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:58.163548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-f139a7d5-5556-43d0-b85b-d1c9403d65b6 admin admin] The token cache is being invalidate because project b22fd9e58c694121a162b855555cd884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:58.163838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-f139a7d5-5556-43d0-b85b-d1c9403d65b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:58.164747 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-f139a7d5-5556-43d0-b85b-d1c9403d65b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:58.166607 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1025/2061] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:57 2022] DELETE /identity/v3/projects/b22fd9e58c694121a162b855555cd884 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:58.171109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b276b-581b-4ddd-8ca7-8739b79a2265 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:58.171402 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b276b-581b-4ddd-8ca7-8739b79a2265 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:58.171679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b276b-581b-4ddd-8ca7-8739b79a2265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:58.193696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-c68b276b-581b-4ddd-8ca7-8739b79a2265 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:58.194940 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-c68b276b-581b-4ddd-8ca7-8739b79a2265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:58.249108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-88bc8fa6-38b8-4c9c-87ef-252f7e3a8362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2dacaa551c4410c92352cc8b32ec7e8'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:58.250534 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-88bc8fa6-38b8-4c9c-87ef-252f7e3a8362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2dacaa551c4410c92352cc8b32ec7e8'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:58.279147 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1026/2062] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:58.287992 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32643267-c370-4b6b-9edc-e907c22e047e None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:58.288859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32643267-c370-4b6b-9edc-e907c22e047e None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:58.289295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32643267-c370-4b6b-9edc-e907c22e047e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:58.315178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-32643267-c370-4b6b-9edc-e907c22e047e None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:58.316484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-32643267-c370-4b6b-9edc-e907c22e047e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:58.325809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1027/2063] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:58.327710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-88bc8fa6-38b8-4c9c-87ef-252f7e3a8362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2dacaa551c4410c92352cc8b32ec7e8'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:58.328420 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-88bc8fa6-38b8-4c9c-87ef-252f7e3a8362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2dacaa551c4410c92352cc8b32ec7e8'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:58.332455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32643267-c370-4b6b-9edc-e907c22e047e None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:58.342932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32643267-c370-4b6b-9edc-e907c22e047e None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:58.343675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-88bc8fa6-38b8-4c9c-87ef-252f7e3a8362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2dacaa551c4410c92352cc8b32ec7e8'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:58.348714 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd78e1-59fe-498c-b348-ca035556ad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:58.349423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd78e1-59fe-498c-b348-ca035556ad0c admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:58.350045 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd78e1-59fe-498c-b348-ca035556ad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:58.350325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd78e1-59fe-498c-b348-ca035556ad0c admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:58.350978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd78e1-59fe-498c-b348-ca035556ad0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:58.351277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd78e1-59fe-498c-b348-ca035556ad0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:58.352902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd78e1-59fe-498c-b348-ca035556ad0c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:58.360713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1037/2064] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:57 2022] DELETE /identity/v3/users/e2dacaa551c4410c92352cc8b32ec7e8 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:58.363602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:58.364967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca9b5-5a29-4313-8d3e-30ae07e0342d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:58.371601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca9b5-5a29-4313-8d3e-30ae07e0342d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:58.371601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca9b5-5a29-4313-8d3e-30ae07e0342d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:58.371777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1028/2065] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:50:58.375278 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd78e1-59fe-498c-b348-ca035556ad0c admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:58.386797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd78e1-59fe-498c-b348-ca035556ad0c admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:58.387103 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-75fca9b5-5a29-4313-8d3e-30ae07e0342d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:58.388611 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-75fca9b5-5a29-4313-8d3e-30ae07e0342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:58.447501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb315f1-66e6-42fc-ad48-b9b922023d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:58.448139 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb315f1-66e6-42fc-ad48-b9b922023d67 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:58.448420 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb315f1-66e6-42fc-ad48-b9b922023d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:58.448696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb315f1-66e6-42fc-ad48-b9b922023d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:58.449162 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1038/2066] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:58.449324 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb315f1-66e6-42fc-ad48-b9b922023d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:58.451813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb315f1-66e6-42fc-ad48-b9b922023d67 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:58.460374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fca9b5-5a29-4313-8d3e-30ae07e0342d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:58.465517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-75fca9b5-5a29-4313-8d3e-30ae07e0342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:58.537758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fca9b5-5a29-4313-8d3e-30ae07e0342d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:58.541386 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5edd5-a213-4e74-b6ec-9159ec9a993a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:58.544241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5edd5-a213-4e74-b6ec-9159ec9a993a service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:58.544241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5edd5-a213-4e74-b6ec-9159ec9a993a service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:58.544241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5edd5-a213-4e74-b6ec-9159ec9a993a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:58.552573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5edd5-a213-4e74-b6ec-9159ec9a993a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:58.554063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5edd5-a213-4e74-b6ec-9159ec9a993a service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:58.563710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1039/2067] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:50:58.564468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5edd5-a213-4e74-b6ec-9159ec9a993a service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:58.568481 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d2f5edd5-a213-4e74-b6ec-9159ec9a993a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:58.577618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1029/2068] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:58 2022] POST /identity/v3/projects => generated 403 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:50:58.581859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb315f1-66e6-42fc-ad48-b9b922023d67 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:58.582412 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5edd5-a213-4e74-b6ec-9159ec9a993a service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:58.676001 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7834cd-bc57-4dc4-beb8-19aa28a5f1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:58.676001 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7834cd-bc57-4dc4-beb8-19aa28a5f1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:58.676001 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7834cd-bc57-4dc4-beb8-19aa28a5f1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:58.676001 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7834cd-bc57-4dc4-beb8-19aa28a5f1d3 admin admin] PATH_INFO: `/v3/projects/6ca1e0045fb54a9390ccbfc3ba65d81d` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:58.676781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7834cd-bc57-4dc4-beb8-19aa28a5f1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca1e0045fb54a9390ccbfc3ba65d81d)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:58.679331 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7834cd-bc57-4dc4-beb8-19aa28a5f1d3 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:58.682235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb315f1-66e6-42fc-ad48-b9b922023d67 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:58.687885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e45d2-ef9a-4d70-bb74-2c653e61cdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:58.688538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e45d2-ef9a-4d70-bb74-2c653e61cdce admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:58.688824 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e45d2-ef9a-4d70-bb74-2c653e61cdce admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:58.689121 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e45d2-ef9a-4d70-bb74-2c653e61cdce admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:58.689767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e45d2-ef9a-4d70-bb74-2c653e61cdce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:58.691756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e45d2-ef9a-4d70-bb74-2c653e61cdce admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:58.775697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1030/2069] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:58 2022] POST /identity/v3/users => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:58.779478 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e45d2-ef9a-4d70-bb74-2c653e61cdce admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:58.789087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3e7834cd-bc57-4dc4-beb8-19aa28a5f1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca1e0045fb54a9390ccbfc3ba65d81d', 'request_id': 'req-3e7834cd-bc57-4dc4-beb8-19aa28a5f1d3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:58.792549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e45d2-ef9a-4d70-bb74-2c653e61cdce admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:58.796268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3e7834cd-bc57-4dc4-beb8-19aa28a5f1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca1e0045fb54a9390ccbfc3ba65d81d', 'request_id': 'req-3e7834cd-bc57-4dc4-beb8-19aa28a5f1d3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:58.829205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:58.859730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1521b-bb48-4922-828e-f9f1f4e0015d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:58.860370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1521b-bb48-4922-828e-f9f1f4e0015d admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:58.860659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1521b-bb48-4922-828e-f9f1f4e0015d admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:58.860937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1521b-bb48-4922-828e-f9f1f4e0015d admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:58.861596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1521b-bb48-4922-828e-f9f1f4e0015d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:58.863207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1521b-bb48-4922-828e-f9f1f4e0015d admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:58.869724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3e7834cd-bc57-4dc4-beb8-19aa28a5f1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca1e0045fb54a9390ccbfc3ba65d81d', 'request_id': 'req-3e7834cd-bc57-4dc4-beb8-19aa28a5f1d3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:58.876886 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1031/2070] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:58.877954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1521b-bb48-4922-828e-f9f1f4e0015d admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:58.889407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3e7834cd-bc57-4dc4-beb8-19aa28a5f1d3 admin admin] The token cache is being invalidate because project 6ca1e0045fb54a9390ccbfc3ba65d81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:58.889745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3e7834cd-bc57-4dc4-beb8-19aa28a5f1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:58.890421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3e7834cd-bc57-4dc4-beb8-19aa28a5f1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:58.893226 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1040/2071] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:58 2022] DELETE /identity/v3/projects/6ca1e0045fb54a9390ccbfc3ba65d81d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:58.899629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3bac-376f-4f04-a692-b3a2db8c267f None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:58.899915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3bac-376f-4f04-a692-b3a2db8c267f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:58.900232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3bac-376f-4f04-a692-b3a2db8c267f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:58.906961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1521b-bb48-4922-828e-f9f1f4e0015d admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:58.913008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9516986-54f3-42b6-b8c4-6543067298a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:58.913639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9516986-54f3-42b6-b8c4-6543067298a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:58.914270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9516986-54f3-42b6-b8c4-6543067298a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:58.914777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9516986-54f3-42b6-b8c4-6543067298a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:58.916677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:58.917157 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9516986-54f3-42b6-b8c4-6543067298a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:58.919239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9516986-54f3-42b6-b8c4-6543067298a5 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:58.930519 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-233a3bac-376f-4f04-a692-b3a2db8c267f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:58.931900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-233a3bac-376f-4f04-a692-b3a2db8c267f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:58.939125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1032/2072] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:58.940284 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9516986-54f3-42b6-b8c4-6543067298a5 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:58.940944 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1041/2073] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:58.941989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a9516986-54f3-42b6-b8c4-6543067298a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:58.948188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7d718-257c-4fe9-8207-edc39127f158 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:58.948480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7d718-257c-4fe9-8207-edc39127f158 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:58.951793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7d718-257c-4fe9-8207-edc39127f158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:58.955697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9516986-54f3-42b6-b8c4-6543067298a5 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:58.961335 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e5e6a-e041-490a-a67e-6cd96423d5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:58.962018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e5e6a-e041-490a-a67e-6cd96423d5da admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:58.962304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e5e6a-e041-490a-a67e-6cd96423d5da admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:58.962580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e5e6a-e041-490a-a67e-6cd96423d5da admin admin] PATH_INFO: `/v3/projects/7613ddbeeb554bfebb3bbb0ab347a1b6/users/1bf46e4c702e4e9eb4353b2fdbbe8539/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:58.968610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-22a7d718-257c-4fe9-8207-edc39127f158 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:58.969829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-22a7d718-257c-4fe9-8207-edc39127f158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:58.977983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1042/2074] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:58.980526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e5e6a-e041-490a-a67e-6cd96423d5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=7613ddbeeb554bfebb3bbb0ab347a1b6, user_id=1bf46e4c702e4e9eb4353b2fdbbe8539, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:58.982050 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7d718-257c-4fe9-8207-edc39127f158 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:58.982232 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e5e6a-e041-490a-a67e-6cd96423d5da admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:58.991031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7d718-257c-4fe9-8207-edc39127f158 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:58.995627 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e455a-c988-4b03-b3a0-f8871d47f544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:58.996259 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e455a-c988-4b03-b3a0-f8871d47f544 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:58.996542 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e455a-c988-4b03-b3a0-f8871d47f544 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:58.996819 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e455a-c988-4b03-b3a0-f8871d47f544 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:58.997462 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e455a-c988-4b03-b3a0-f8871d47f544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:58.997769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e455a-c988-4b03-b3a0-f8871d47f544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:59.000547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e455a-c988-4b03-b3a0-f8871d47f544 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:59.014866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1043/2075] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:50:59.017114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e455a-c988-4b03-b3a0-f8871d47f544 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:59.018923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a58e455a-c988-4b03-b3a0-f8871d47f544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:59.038624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e455a-c988-4b03-b3a0-f8871d47f544 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:59.039741 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa0830-15d8-48a2-9f31-319617cbbdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:59.040392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa0830-15d8-48a2-9f31-319617cbbdd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:59.040671 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa0830-15d8-48a2-9f31-319617cbbdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:59.040938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa0830-15d8-48a2-9f31-319617cbbdd8 admin admin] PATH_INFO: `/v3/projects/d3fe7654851d46a9ab3f05092c01dd0e` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:59.042042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa0830-15d8-48a2-9f31-319617cbbdd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3fe7654851d46a9ab3f05092c01dd0e)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:59.043934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa0830-15d8-48a2-9f31-319617cbbdd8 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:59.064298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1033/2076] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:58 2022] PUT /identity/v3/projects/7613ddbeeb554bfebb3bbb0ab347a1b6/users/1bf46e4c702e4e9eb4353b2fdbbe8539/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:59.069706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e5e6a-e041-490a-a67e-6cd96423d5da admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:59.133016 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e5e6a-e041-490a-a67e-6cd96423d5da admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:59.137897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6984c2-9eae-454e-9a32-2349fa3597ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:59.138532 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6984c2-9eae-454e-9a32-2349fa3597ee admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:59.138810 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6984c2-9eae-454e-9a32-2349fa3597ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:59.139082 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6984c2-9eae-454e-9a32-2349fa3597ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:59.139711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6984c2-9eae-454e-9a32-2349fa3597ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:59.141673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6984c2-9eae-454e-9a32-2349fa3597ee admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:59.184234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7bfa0830-15d8-48a2-9f31-319617cbbdd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3fe7654851d46a9ab3f05092c01dd0e', 'request_id': 'req-7bfa0830-15d8-48a2-9f31-319617cbbdd8'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:59.190881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7bfa0830-15d8-48a2-9f31-319617cbbdd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3fe7654851d46a9ab3f05092c01dd0e', 'request_id': 'req-7bfa0830-15d8-48a2-9f31-319617cbbdd8'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:59.219825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1034/2077] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:59 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:59.221188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d7dba-63ce-4470-8223-f88ea6b9afc3 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:59.221474 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d7dba-63ce-4470-8223-f88ea6b9afc3 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:59.221785 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d7dba-63ce-4470-8223-f88ea6b9afc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:59.249238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-024d7dba-63ce-4470-8223-f88ea6b9afc3 None None] MFA Rules not processed for user `1bf46e4c702e4e9eb4353b2fdbbe8539`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:59.250474 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-024d7dba-63ce-4470-8223-f88ea6b9afc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:59.274591 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7bfa0830-15d8-48a2-9f31-319617cbbdd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3fe7654851d46a9ab3f05092c01dd0e', 'request_id': 'req-7bfa0830-15d8-48a2-9f31-319617cbbdd8'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:59.287905 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7bfa0830-15d8-48a2-9f31-319617cbbdd8 admin admin] The token cache is being invalidate because project d3fe7654851d46a9ab3f05092c01dd0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:59.288333 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7bfa0830-15d8-48a2-9f31-319617cbbdd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:59.289069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7bfa0830-15d8-48a2-9f31-319617cbbdd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:59.290943 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1044/2078] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:59 2022] DELETE /identity/v3/projects/d3fe7654851d46a9ab3f05092c01dd0e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:59.291804 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa0830-15d8-48a2-9f31-319617cbbdd8 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:59.293285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-7bfa0830-15d8-48a2-9f31-319617cbbdd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:59.320805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1035/2079] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:50:59 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:59.324532 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d7dba-63ce-4470-8223-f88ea6b9afc3 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:59.325422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-024d7dba-63ce-4470-8223-f88ea6b9afc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:59.344857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:59.385190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa0830-15d8-48a2-9f31-319617cbbdd8 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:59.392048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:59.412466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d7dba-63ce-4470-8223-f88ea6b9afc3 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:59.417717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db049b-cc0a-4cde-8da0-10f8dfbc6bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:59.419047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db049b-cc0a-4cde-8da0-10f8dfbc6bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:59.419364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db049b-cc0a-4cde-8da0-10f8dfbc6bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:59.419705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db049b-cc0a-4cde-8da0-10f8dfbc6bcf admin admin] PATH_INFO: `/v3/users/fb5e60937d66462bba2b67593135e8f7` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:59.420958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db049b-cc0a-4cde-8da0-10f8dfbc6bcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5e60937d66462bba2b67593135e8f7)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:59.423365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db049b-cc0a-4cde-8da0-10f8dfbc6bcf admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:59.458862 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0334aa2-47ea-486b-857d-8d68806a8081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:59.459646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0334aa2-47ea-486b-857d-8d68806a8081 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:59.459925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0334aa2-47ea-486b-857d-8d68806a8081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:59.460235 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0334aa2-47ea-486b-857d-8d68806a8081 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:59.460872 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0334aa2-47ea-486b-857d-8d68806a8081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:59.462855 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0334aa2-47ea-486b-857d-8d68806a8081 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:59.562231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1045/2080] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:59 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:59.562231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0334aa2-47ea-486b-857d-8d68806a8081 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:59.562231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d0334aa2-47ea-486b-857d-8d68806a8081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:59.571017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0334aa2-47ea-486b-857d-8d68806a8081 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:59.576931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31845b45-83a8-45bb-80f5-15b4b3e84413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:59.577533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31845b45-83a8-45bb-80f5-15b4b3e84413 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:59.577813 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31845b45-83a8-45bb-80f5-15b4b3e84413 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:59.578083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31845b45-83a8-45bb-80f5-15b4b3e84413 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:59.578716 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31845b45-83a8-45bb-80f5-15b4b3e84413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:59.580707 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31845b45-83a8-45bb-80f5-15b4b3e84413 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:59.636474 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-04db049b-cc0a-4cde-8da0-10f8dfbc6bcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5e60937d66462bba2b67593135e8f7'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:59.648705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-04db049b-cc0a-4cde-8da0-10f8dfbc6bcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5e60937d66462bba2b67593135e8f7'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:59.733003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1046/2081] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:59 2022] POST /identity/v3/projects => generated 403 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:59.734041 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31845b45-83a8-45bb-80f5-15b4b3e84413 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:59.795754 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31845b45-83a8-45bb-80f5-15b4b3e84413 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:59.800762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a12c5-fae9-498a-b84c-fbb7ee42b14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:59.801358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a12c5-fae9-498a-b84c-fbb7ee42b14b admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:59.801636 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a12c5-fae9-498a-b84c-fbb7ee42b14b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:59.801907 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a12c5-fae9-498a-b84c-fbb7ee42b14b admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:59.802544 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a12c5-fae9-498a-b84c-fbb7ee42b14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:59.804263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a12c5-fae9-498a-b84c-fbb7ee42b14b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:59.812433 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-04db049b-cc0a-4cde-8da0-10f8dfbc6bcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5e60937d66462bba2b67593135e8f7'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:59.813124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-04db049b-cc0a-4cde-8da0-10f8dfbc6bcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5e60937d66462bba2b67593135e8f7'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:59.813794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-04db049b-cc0a-4cde-8da0-10f8dfbc6bcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5e60937d66462bba2b67593135e8f7'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:59.814468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1047/2082] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:59.815278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a12c5-fae9-498a-b84c-fbb7ee42b14b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:59.817034 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-373a12c5-fae9-498a-b84c-fbb7ee42b14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:59.828081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1036/2083] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:59 2022] DELETE /identity/v3/users/fb5e60937d66462bba2b67593135e8f7 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:59.829223 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db049b-cc0a-4cde-8da0-10f8dfbc6bcf admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:59.830622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-04db049b-cc0a-4cde-8da0-10f8dfbc6bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:59.830740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a12c5-fae9-498a-b84c-fbb7ee42b14b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:59.901232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91486b7-96df-4243-8334-ee630272896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:59.902086 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91486b7-96df-4243-8334-ee630272896b admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:59.902413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91486b7-96df-4243-8334-ee630272896b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:59.902756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91486b7-96df-4243-8334-ee630272896b admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:59.903459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91486b7-96df-4243-8334-ee630272896b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:59.905496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91486b7-96df-4243-8334-ee630272896b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:59.911590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db049b-cc0a-4cde-8da0-10f8dfbc6bcf admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:59.918422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b079fb-1ca9-4991-8112-8b99928ff434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:59.919572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b079fb-1ca9-4991-8112-8b99928ff434 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:59.920114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b079fb-1ca9-4991-8112-8b99928ff434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:59.920657 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b079fb-1ca9-4991-8112-8b99928ff434 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:59.921633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b079fb-1ca9-4991-8112-8b99928ff434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:59.922148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:59.924458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b079fb-1ca9-4991-8112-8b99928ff434 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:59.937086 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1037/2084] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:59.941622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b079fb-1ca9-4991-8112-8b99928ff434 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:59.952120 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b079fb-1ca9-4991-8112-8b99928ff434 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:59.956982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dd58d-aa40-4003-853d-2ba777daee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:59.957643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dd58d-aa40-4003-853d-2ba777daee1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:59.957901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dd58d-aa40-4003-853d-2ba777daee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:59.958213 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dd58d-aa40-4003-853d-2ba777daee1f admin admin] PATH_INFO: `/v3/projects/0f5ae5e25b1c4003818687695989ca0d/users/b7468e2777a64bd0949a9fb8ea71ab0a/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:59.974798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573dd58d-aa40-4003-853d-2ba777daee1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5ae5e25b1c4003818687695989ca0d, user_id=b7468e2777a64bd0949a9fb8ea71ab0a, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:59.977518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573dd58d-aa40-4003-853d-2ba777daee1f admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:00.043043 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1048/2085] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:59 2022] POST /identity/v3/users => generated 308 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:00.044480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91486b7-96df-4243-8334-ee630272896b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:00.054987 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91486b7-96df-4243-8334-ee630272896b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:00.060354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55a396-69c1-457d-bfa4-2186e0dbe085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:00.061492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55a396-69c1-457d-bfa4-2186e0dbe085 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:00.061817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55a396-69c1-457d-bfa4-2186e0dbe085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:00.062434 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55a396-69c1-457d-bfa4-2186e0dbe085 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:00.064738 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55a396-69c1-457d-bfa4-2186e0dbe085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:00.065914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:00.066527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55a396-69c1-457d-bfa4-2186e0dbe085 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:00.079011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1038/2086] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:59 2022] PUT /identity/v3/projects/0f5ae5e25b1c4003818687695989ca0d/users/b7468e2777a64bd0949a9fb8ea71ab0a/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:00.079384 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1049/2087] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:51:00.083360 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dd58d-aa40-4003-853d-2ba777daee1f admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:00.084431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74f365-7749-44c5-b74f-a3d95c79634d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:00.084927 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74f365-7749-44c5-b74f-a3d95c79634d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:00.085388 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74f365-7749-44c5-b74f-a3d95c79634d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:00.118747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-9c74f365-7749-44c5-b74f-a3d95c79634d None None] MFA Rules not processed for user `b7468e2777a64bd0949a9fb8ea71ab0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:00.120064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9c74f365-7749-44c5-b74f-a3d95c79634d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:00.160313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dd58d-aa40-4003-853d-2ba777daee1f admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:00.166957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21130b0c-8321-495a-91d0-aad7bbc4f904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:00.167994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21130b0c-8321-495a-91d0-aad7bbc4f904 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:00.168529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21130b0c-8321-495a-91d0-aad7bbc4f904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:00.169040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21130b0c-8321-495a-91d0-aad7bbc4f904 admin admin] PATH_INFO: `/v3/projects/251cbb4a406040a59e4e264497b4e9a5/users/85e9409e6e2449de98ba67d81a5e3f5a/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:00.193111 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21130b0c-8321-495a-91d0-aad7bbc4f904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=251cbb4a406040a59e4e264497b4e9a5, user_id=85e9409e6e2449de98ba67d81a5e3f5a, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:00.195382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21130b0c-8321-495a-91d0-aad7bbc4f904 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:00.200210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1050/2088] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:00.211841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74f365-7749-44c5-b74f-a3d95c79634d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:00.213644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9c74f365-7749-44c5-b74f-a3d95c79634d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:00.274355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74f365-7749-44c5-b74f-a3d95c79634d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:00.275144 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1039/2089] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:00 2022] PUT /identity/v3/projects/251cbb4a406040a59e4e264497b4e9a5/users/85e9409e6e2449de98ba67d81a5e3f5a/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:00.279138 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21130b0c-8321-495a-91d0-aad7bbc4f904 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:00.343518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a79418-a76b-465e-ad09-0cc7f99250bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:00.343518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a79418-a76b-465e-ad09-0cc7f99250bf service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:00.343518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a79418-a76b-465e-ad09-0cc7f99250bf service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:00.343518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a79418-a76b-465e-ad09-0cc7f99250bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:00.364694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21130b0c-8321-495a-91d0-aad7bbc4f904 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:00.369531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a9eff-c164-4754-a97d-9a6ced8261a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:00.370125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a9eff-c164-4754-a97d-9a6ced8261a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:00.370402 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a9eff-c164-4754-a97d-9a6ced8261a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:00.370672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a9eff-c164-4754-a97d-9a6ced8261a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:00.371336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a9eff-c164-4754-a97d-9a6ced8261a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:00.373013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a9eff-c164-4754-a97d-9a6ced8261a7 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:00.387317 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1040/2090] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:51:00.387317 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a9eff-c164-4754-a97d-9a6ced8261a7 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:00.387317 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-2d3a9eff-c164-4754-a97d-9a6ced8261a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:00.400958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a79418-a76b-465e-ad09-0cc7f99250bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:00.401921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a9eff-c164-4754-a97d-9a6ced8261a7 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:00.402904 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a79418-a76b-465e-ad09-0cc7f99250bf service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:00.408905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9d349-df8f-4d28-80e5-75c7af85dcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:00.409576 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9d349-df8f-4d28-80e5-75c7af85dcd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:00.409860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9d349-df8f-4d28-80e5-75c7af85dcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:00.410136 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9d349-df8f-4d28-80e5-75c7af85dcd4 admin admin] PATH_INFO: `/v3/projects/19c41fabac624afdb3604d31b0258ad2` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:00.411294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9d349-df8f-4d28-80e5-75c7af85dcd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c41fabac624afdb3604d31b0258ad2)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:00.413231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9d349-df8f-4d28-80e5-75c7af85dcd4 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:00.414010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1051/2091] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:00.414829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a79418-a76b-465e-ad09-0cc7f99250bf service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:00.423973 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:00.428758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a79418-a76b-465e-ad09-0cc7f99250bf service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:00.439437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5fa5c-d7c7-43be-ab2b-6fe1853f9ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:00.440597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5fa5c-d7c7-43be-ab2b-6fe1853f9ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:00.440896 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5fa5c-d7c7-43be-ab2b-6fe1853f9ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:00.441180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5fa5c-d7c7-43be-ab2b-6fe1853f9ac5 admin admin] PATH_INFO: `/v3/projects/251cbb4a406040a59e4e264497b4e9a5/users/85e9409e6e2449de98ba67d81a5e3f5a/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:00.444708 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5fa5c-d7c7-43be-ab2b-6fe1853f9ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=251cbb4a406040a59e4e264497b4e9a5, user_id=85e9409e6e2449de98ba67d81a5e3f5a, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:00.448204 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5fa5c-d7c7-43be-ab2b-6fe1853f9ac5 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:00.460751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1052/2092] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:00 2022] PUT /identity/v3/projects/251cbb4a406040a59e4e264497b4e9a5/users/85e9409e6e2449de98ba67d81a5e3f5a/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:00.473208 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a196f-15d1-4986-982b-bbcc5570d596 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:00.473576 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a196f-15d1-4986-982b-bbcc5570d596 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:00.473925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a196f-15d1-4986-982b-bbcc5570d596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:00.503556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-4f4a196f-15d1-4986-982b-bbcc5570d596 None None] MFA Rules not processed for user `85e9409e6e2449de98ba67d81a5e3f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:00.504884 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4f4a196f-15d1-4986-982b-bbcc5570d596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:00.543339 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:00.578173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-75b9d349-df8f-4d28-80e5-75c7af85dcd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c41fabac624afdb3604d31b0258ad2', 'request_id': 'req-75b9d349-df8f-4d28-80e5-75c7af85dcd4'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:00.595819 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1053/2093] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:00 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:00.613997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a196f-15d1-4986-982b-bbcc5570d596 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:00.616127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4f4a196f-15d1-4986-982b-bbcc5570d596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:00.663956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-75b9d349-df8f-4d28-80e5-75c7af85dcd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c41fabac624afdb3604d31b0258ad2', 'request_id': 'req-75b9d349-df8f-4d28-80e5-75c7af85dcd4'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:00.674978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-75b9d349-df8f-4d28-80e5-75c7af85dcd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c41fabac624afdb3604d31b0258ad2', 'request_id': 'req-75b9d349-df8f-4d28-80e5-75c7af85dcd4'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:00.690216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a196f-15d1-4986-982b-bbcc5570d596 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:00.693668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-75b9d349-df8f-4d28-80e5-75c7af85dcd4 admin admin] The token cache is being invalidate because project 19c41fabac624afdb3604d31b0258ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:00.693968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-75b9d349-df8f-4d28-80e5-75c7af85dcd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:00.694658 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-75b9d349-df8f-4d28-80e5-75c7af85dcd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:00.696407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1041/2094] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:00 2022] DELETE /identity/v3/projects/19c41fabac624afdb3604d31b0258ad2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:00.697186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9d349-df8f-4d28-80e5-75c7af85dcd4 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:00.700556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-75b9d349-df8f-4d28-80e5-75c7af85dcd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:00.752711 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806a309-200f-4b28-b22b-772a2e51fdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:00.753432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806a309-200f-4b28-b22b-772a2e51fdf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:00.753712 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806a309-200f-4b28-b22b-772a2e51fdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:00.753984 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806a309-200f-4b28-b22b-772a2e51fdf9 admin admin] PATH_INFO: `/v3/users/942f675275924a0383cfe17f88b6b143` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:00.755198 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806a309-200f-4b28-b22b-772a2e51fdf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=942f675275924a0383cfe17f88b6b143)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:00.757199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806a309-200f-4b28-b22b-772a2e51fdf9 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:00.759505 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9d349-df8f-4d28-80e5-75c7af85dcd4 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:00.763219 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73473c-77a2-4cfc-8e99-91167bb34288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:00.764546 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73473c-77a2-4cfc-8e99-91167bb34288 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:00.764889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73473c-77a2-4cfc-8e99-91167bb34288 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:00.765222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73473c-77a2-4cfc-8e99-91167bb34288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:00.767040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ff73473c-77a2-4cfc-8e99-91167bb34288 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:00.831119 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73473c-77a2-4cfc-8e99-91167bb34288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:00.832635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73473c-77a2-4cfc-8e99-91167bb34288 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:00.844321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1042/2095] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:00 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:00.844321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7d125-0520-4be1-a6bb-eaac03b26689 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:00.844321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7d125-0520-4be1-a6bb-eaac03b26689 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:00.844321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7d125-0520-4be1-a6bb-eaac03b26689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:00.863946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-59f7d125-0520-4be1-a6bb-eaac03b26689 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:00.867480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-59f7d125-0520-4be1-a6bb-eaac03b26689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:00.873866 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1043/2096] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:00.881434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b303e-3cfb-49ad-8b1c-ad7128ef6028 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:00.881790 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b303e-3cfb-49ad-8b1c-ad7128ef6028 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:00.882072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b303e-3cfb-49ad-8b1c-ad7128ef6028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:00.902574 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-8c9b303e-3cfb-49ad-8b1c-ad7128ef6028 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:00.903858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8c9b303e-3cfb-49ad-8b1c-ad7128ef6028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:00.912932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1044/2097] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:00.918735 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b303e-3cfb-49ad-8b1c-ad7128ef6028 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:00.929244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b303e-3cfb-49ad-8b1c-ad7128ef6028 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:00.934984 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41064f03-dfd1-4e02-81af-09f0333b20cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:00.936336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41064f03-dfd1-4e02-81af-09f0333b20cf admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:00.936690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41064f03-dfd1-4e02-81af-09f0333b20cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:00.936975 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41064f03-dfd1-4e02-81af-09f0333b20cf admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:00.937784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41064f03-dfd1-4e02-81af-09f0333b20cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:51:00.938100 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41064f03-dfd1-4e02-81af-09f0333b20cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:00.939705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41064f03-dfd1-4e02-81af-09f0333b20cf admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:00.942071 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1806a309-200f-4b28-b22b-772a2e51fdf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '942f675275924a0383cfe17f88b6b143'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:00.951964 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1806a309-200f-4b28-b22b-772a2e51fdf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '942f675275924a0383cfe17f88b6b143'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:00.959782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1045/2098] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:51:00.962608 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41064f03-dfd1-4e02-81af-09f0333b20cf admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:00.964491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-41064f03-dfd1-4e02-81af-09f0333b20cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:00.977450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41064f03-dfd1-4e02-81af-09f0333b20cf admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:00.982670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80dc36-06cf-4d83-8ce4-a23b6165ea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:00.983293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80dc36-06cf-4d83-8ce4-a23b6165ea06 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:00.988058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80dc36-06cf-4d83-8ce4-a23b6165ea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:00.988058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80dc36-06cf-4d83-8ce4-a23b6165ea06 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:00.988058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80dc36-06cf-4d83-8ce4-a23b6165ea06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:00.988058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80dc36-06cf-4d83-8ce4-a23b6165ea06 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:01.034974 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1806a309-200f-4b28-b22b-772a2e51fdf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '942f675275924a0383cfe17f88b6b143'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:01.035725 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1806a309-200f-4b28-b22b-772a2e51fdf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '942f675275924a0383cfe17f88b6b143'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:01.048971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1806a309-200f-4b28-b22b-772a2e51fdf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '942f675275924a0383cfe17f88b6b143'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:01.062221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1054/2099] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:00 2022] DELETE /identity/v3/users/942f675275924a0383cfe17f88b6b143 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:01.063221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806a309-200f-4b28-b22b-772a2e51fdf9 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:01.064624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-1806a309-200f-4b28-b22b-772a2e51fdf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:01.068842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1046/2100] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:00 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:51:01.068842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a2ee1-fc1f-439d-b2a6-99fb528d45df None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:01.068842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a2ee1-fc1f-439d-b2a6-99fb528d45df None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:01.068842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a2ee1-fc1f-439d-b2a6-99fb528d45df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:01.086607 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d12a2ee1-fc1f-439d-b2a6-99fb528d45df None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:01.087845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d12a2ee1-fc1f-439d-b2a6-99fb528d45df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:01.134527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806a309-200f-4b28-b22b-772a2e51fdf9 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:01.140967 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:01.157019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1047/2101] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:01.157019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a2ee1-fc1f-439d-b2a6-99fb528d45df None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:01.165100 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a2ee1-fc1f-439d-b2a6-99fb528d45df None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:01.171060 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b214b-b936-454e-984f-b7434e231692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:01.171777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b214b-b936-454e-984f-b7434e231692 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:01.172112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b214b-b936-454e-984f-b7434e231692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:01.172482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b214b-b936-454e-984f-b7434e231692 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:01.173192 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b214b-b936-454e-984f-b7434e231692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:01.175344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b214b-b936-454e-984f-b7434e231692 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:01.206348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf051a-9e47-4287-bb26-ff34187e053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:01.207166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf051a-9e47-4287-bb26-ff34187e053c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:01.208592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:01.209099 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf051a-9e47-4287-bb26-ff34187e053c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:01.209525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf051a-9e47-4287-bb26-ff34187e053c admin admin] PATH_INFO: `/v3/users/1bf46e4c702e4e9eb4353b2fdbbe8539` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:01.210736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf051a-9e47-4287-bb26-ff34187e053c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf46e4c702e4e9eb4353b2fdbbe8539)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:01.212867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf051a-9e47-4287-bb26-ff34187e053c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:01.257946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1048/2102] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:01 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:01.258784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b214b-b936-454e-984f-b7434e231692 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:01.261042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-0d9b214b-b936-454e-984f-b7434e231692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:01.317456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b214b-b936-454e-984f-b7434e231692 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:01.321383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3d696-c7ed-4f97-b719-3c1e53da11a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:01.321998 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3d696-c7ed-4f97-b719-3c1e53da11a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:01.322282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3d696-c7ed-4f97-b719-3c1e53da11a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:01.322561 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3d696-c7ed-4f97-b719-3c1e53da11a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:01.332306 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3d696-c7ed-4f97-b719-3c1e53da11a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:01.333878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3d696-c7ed-4f97-b719-3c1e53da11a2 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:01.344374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1049/2103] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:01.345168 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3d696-c7ed-4f97-b719-3c1e53da11a2 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:01.354164 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3d696-c7ed-4f97-b719-3c1e53da11a2 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:01.359774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650835b-a5a3-47a4-89ae-5832193bad73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:01.360427 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650835b-a5a3-47a4-89ae-5832193bad73 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:01.360723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650835b-a5a3-47a4-89ae-5832193bad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:01.361003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650835b-a5a3-47a4-89ae-5832193bad73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:01.361635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650835b-a5a3-47a4-89ae-5832193bad73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:01.363284 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650835b-a5a3-47a4-89ae-5832193bad73 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:01.374003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1050/2104] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:01.377880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650835b-a5a3-47a4-89ae-5832193bad73 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:01.381222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-54bf051a-9e47-4287-bb26-ff34187e053c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf46e4c702e4e9eb4353b2fdbbe8539'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:01.382493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-54bf051a-9e47-4287-bb26-ff34187e053c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf46e4c702e4e9eb4353b2fdbbe8539'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:01.389410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650835b-a5a3-47a4-89ae-5832193bad73 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:01.394361 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005541a7-85ff-4b96-9095-579a5d034ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:01.394799 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005541a7-85ff-4b96-9095-579a5d034ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:01.395080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005541a7-85ff-4b96-9095-579a5d034ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:01.395356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005541a7-85ff-4b96-9095-579a5d034ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:01.395994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005541a7-85ff-4b96-9095-579a5d034ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:01.397635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005541a7-85ff-4b96-9095-579a5d034ba8 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:01.409166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1051/2105] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:51:01.413023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005541a7-85ff-4b96-9095-579a5d034ba8 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:01.414750 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-005541a7-85ff-4b96-9095-579a5d034ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:01.429183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005541a7-85ff-4b96-9095-579a5d034ba8 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:01.434490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-54bf051a-9e47-4287-bb26-ff34187e053c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf46e4c702e4e9eb4353b2fdbbe8539'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:01.435149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-54bf051a-9e47-4287-bb26-ff34187e053c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf46e4c702e4e9eb4353b2fdbbe8539'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:01.435618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcd646-64aa-4618-aeca-170202bbe7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:01.436378 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcd646-64aa-4618-aeca-170202bbe7c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:01.436664 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcd646-64aa-4618-aeca-170202bbe7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:01.437029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcd646-64aa-4618-aeca-170202bbe7c0 admin admin] PATH_INFO: `/v3/projects/342f4f20a4234f0fbb818bf1fd5b7837/users/aed1777c4f174bc7a168e92fe26d7bd7/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:01.448958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-54bf051a-9e47-4287-bb26-ff34187e053c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf46e4c702e4e9eb4353b2fdbbe8539'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:01.453625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcd646-64aa-4618-aeca-170202bbe7c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342f4f20a4234f0fbb818bf1fd5b7837, user_id=aed1777c4f174bc7a168e92fe26d7bd7, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:01.456844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcd646-64aa-4618-aeca-170202bbe7c0 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:01.461735 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1055/2106] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:01 2022] DELETE /identity/v3/users/1bf46e4c702e4e9eb4353b2fdbbe8539 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:01.466028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330689bc-ddc4-4436-bc75-28c2f8d3934e None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:01.466318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330689bc-ddc4-4436-bc75-28c2f8d3934e None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:01.467160 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330689bc-ddc4-4436-bc75-28c2f8d3934e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:01.487928 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-330689bc-ddc4-4436-bc75-28c2f8d3934e None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:01.489160 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-330689bc-ddc4-4436-bc75-28c2f8d3934e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:01.551130 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1056/2107] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:01.568327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330689bc-ddc4-4436-bc75-28c2f8d3934e None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:01.570267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-330689bc-ddc4-4436-bc75-28c2f8d3934e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:01.591577 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1052/2108] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:01 2022] PUT /identity/v3/projects/342f4f20a4234f0fbb818bf1fd5b7837/users/aed1777c4f174bc7a168e92fe26d7bd7/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:01.603562 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a347fd-e27e-4a39-b6dc-3f131b9e3a98 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:01.603855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a347fd-e27e-4a39-b6dc-3f131b9e3a98 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:01.604175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a347fd-e27e-4a39-b6dc-3f131b9e3a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:01.636441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330689bc-ddc4-4436-bc75-28c2f8d3934e None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:01.641346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-38a347fd-e27e-4a39-b6dc-3f131b9e3a98 None None] MFA Rules not processed for user `aed1777c4f174bc7a168e92fe26d7bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:01.643091 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-38a347fd-e27e-4a39-b6dc-3f131b9e3a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:01.691564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbca85-c183-4cf7-a115-83a94baaeb86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:01.692221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbca85-c183-4cf7-a115-83a94baaeb86 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:01.692522 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbca85-c183-4cf7-a115-83a94baaeb86 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:01.692785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbca85-c183-4cf7-a115-83a94baaeb86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:01.712176 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1053/2109] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:01.729449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a347fd-e27e-4a39-b6dc-3f131b9e3a98 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:01.731049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-38a347fd-e27e-4a39-b6dc-3f131b9e3a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:01.776446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbca85-c183-4cf7-a115-83a94baaeb86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:01.778068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbca85-c183-4cf7-a115-83a94baaeb86 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:01.791295 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1057/2110] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:01.814904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a347fd-e27e-4a39-b6dc-3f131b9e3a98 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:01.819143 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46638e9-e3ae-48cd-b39b-ddc664d1baa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:01.822360 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46638e9-e3ae-48cd-b39b-ddc664d1baa9 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:01.822360 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46638e9-e3ae-48cd-b39b-ddc664d1baa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:01.822360 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46638e9-e3ae-48cd-b39b-ddc664d1baa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:01.830095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46638e9-e3ae-48cd-b39b-ddc664d1baa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:01.831702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbca85-c183-4cf7-a115-83a94baaeb86 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:01.831852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46638e9-e3ae-48cd-b39b-ddc664d1baa9 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:01.833438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-86dbca85-c183-4cf7-a115-83a94baaeb86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:01.840042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:01.845701 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1054/2111] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:51:01.847244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbca85-c183-4cf7-a115-83a94baaeb86 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:01.852476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:01.853218 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:01.853601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:01.854066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4 admin admin] PATH_INFO: `/v3/projects/3a4fab2a43d2484a85877852bd1354d0` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:01.855496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4fab2a43d2484a85877852bd1354d0)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:01.857696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:01.997284 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4fab2a43d2484a85877852bd1354d0', 'request_id': 'req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:02.004920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4fab2a43d2484a85877852bd1354d0', 'request_id': 'req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:02.148898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4fab2a43d2484a85877852bd1354d0', 'request_id': 'req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:02.160932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4 admin admin] The token cache is being invalidate because project 3a4fab2a43d2484a85877852bd1354d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:02.161286 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:02.161926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:02.164410 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1058/2112] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:01 2022] DELETE /identity/v3/projects/3a4fab2a43d2484a85877852bd1354d0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:02.476773 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46638e9-e3ae-48cd-b39b-ddc664d1baa9 service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:02.485604 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e46638e9-e3ae-48cd-b39b-ddc664d1baa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:02.506523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46638e9-e3ae-48cd-b39b-ddc664d1baa9 service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:02.565854 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:02.566497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:02.568292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:02.568292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34 admin admin] PATH_INFO: `/v3/projects/7613ddbeeb554bfebb3bbb0ab347a1b6` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:02.568292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7613ddbeeb554bfebb3bbb0ab347a1b6)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:02.570145 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:02.613935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:02.684852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7613ddbeeb554bfebb3bbb0ab347a1b6', 'request_id': 'req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:02.771255 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7613ddbeeb554bfebb3bbb0ab347a1b6', 'request_id': 'req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:02.777823 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7613ddbeeb554bfebb3bbb0ab347a1b6', 'request_id': 'req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:02.789705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34 admin admin] The token cache is being invalidate because project 7613ddbeeb554bfebb3bbb0ab347a1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:02.790018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:02.790678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:02.792247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1055/2113] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:02 2022] DELETE /identity/v3/projects/7613ddbeeb554bfebb3bbb0ab347a1b6 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:02.796638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:02.798055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:02.810957 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2115e-babf-4895-bc2b-526bc8d2aaf4 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:02.843830 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:02.845362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:02.870606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e0c92-c32a-405b-b945-045b95208927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:02.871238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e0c92-c32a-405b-b945-045b95208927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:02.871512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e0c92-c32a-405b-b945-045b95208927 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:02.871783 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e0c92-c32a-405b-b945-045b95208927 admin admin] PATH_INFO: `/v3/users/85e9409e6e2449de98ba67d81a5e3f5a` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:02.873105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e0c92-c32a-405b-b945-045b95208927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85e9409e6e2449de98ba67d81a5e3f5a)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:02.875065 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e0c92-c32a-405b-b945-045b95208927 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:02.911304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e55e1f-fb28-4d6c-9798-ac1028c77f34 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:02.915953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb8524-d0f6-43c3-b0fe-deca40c659b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:02.916610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb8524-d0f6-43c3-b0fe-deca40c659b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:02.916890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb8524-d0f6-43c3-b0fe-deca40c659b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:02.917165 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb8524-d0f6-43c3-b0fe-deca40c659b7 admin admin] PATH_INFO: `/v3/users/80a4dbd9c74b4e2dbd3598a375f6d846` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:02.918881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb8524-d0f6-43c3-b0fe-deca40c659b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a4dbd9c74b4e2dbd3598a375f6d846)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:02.921324 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb8524-d0f6-43c3-b0fe-deca40c659b7 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:03.107479 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76cb8524-d0f6-43c3-b0fe-deca40c659b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a4dbd9c74b4e2dbd3598a375f6d846'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:03.108061 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-333e0c92-c32a-405b-b945-045b95208927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85e9409e6e2449de98ba67d81a5e3f5a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:03.108845 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-333e0c92-c32a-405b-b945-045b95208927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85e9409e6e2449de98ba67d81a5e3f5a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:03.120995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76cb8524-d0f6-43c3-b0fe-deca40c659b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a4dbd9c74b4e2dbd3598a375f6d846'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:03.144149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:03.199940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-333e0c92-c32a-405b-b945-045b95208927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85e9409e6e2449de98ba67d81a5e3f5a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:03.200598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-333e0c92-c32a-405b-b945-045b95208927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85e9409e6e2449de98ba67d81a5e3f5a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:03.214044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-333e0c92-c32a-405b-b945-045b95208927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85e9409e6e2449de98ba67d81a5e3f5a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:03.227201 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1059/2114] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:02 2022] DELETE /identity/v3/users/85e9409e6e2449de98ba67d81a5e3f5a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:03.281050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76cb8524-d0f6-43c3-b0fe-deca40c659b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a4dbd9c74b4e2dbd3598a375f6d846'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:03.281713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76cb8524-d0f6-43c3-b0fe-deca40c659b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a4dbd9c74b4e2dbd3598a375f6d846'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:03.282347 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76cb8524-d0f6-43c3-b0fe-deca40c659b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a4dbd9c74b4e2dbd3598a375f6d846'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:03.295510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1056/2115] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:02 2022] DELETE /identity/v3/users/80a4dbd9c74b4e2dbd3598a375f6d846 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:03.300442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc1f8e-17c4-46a9-9878-598297182f60 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:03.300862 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc1f8e-17c4-46a9-9878-598297182f60 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:03.301121 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc1f8e-17c4-46a9-9878-598297182f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:03.320153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-e0fc1f8e-17c4-46a9-9878-598297182f60 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:03.321383 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e0fc1f8e-17c4-46a9-9878-598297182f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:03.382543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1060/2116] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:03.392840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb8524-d0f6-43c3-b0fe-deca40c659b7 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:03.394228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-76cb8524-d0f6-43c3-b0fe-deca40c659b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:03.462890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb8524-d0f6-43c3-b0fe-deca40c659b7 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:03.462890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051951f-abbc-40c2-a185-4c6c01c124e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:03.463701 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051951f-abbc-40c2-a185-4c6c01c124e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:03.463907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051951f-abbc-40c2-a185-4c6c01c124e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:03.464251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051951f-abbc-40c2-a185-4c6c01c124e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:03.474108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051951f-abbc-40c2-a185-4c6c01c124e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:03.475550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051951f-abbc-40c2-a185-4c6c01c124e0 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:03.480370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:03.488055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1057/2117] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:03.798148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc1f8e-17c4-46a9-9878-598297182f60 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:03.800637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e0fc1f8e-17c4-46a9-9878-598297182f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:03.817301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc1f8e-17c4-46a9-9878-598297182f60 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:03.822356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d16990-adbf-404a-90e3-cab71a252b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:03.823263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d16990-adbf-404a-90e3-cab71a252b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:03.823626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d16990-adbf-404a-90e3-cab71a252b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:03.823951 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d16990-adbf-404a-90e3-cab71a252b5a admin admin] PATH_INFO: `/v3/projects/251cbb4a406040a59e4e264497b4e9a5` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:03.825933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d16990-adbf-404a-90e3-cab71a252b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=251cbb4a406040a59e4e264497b4e9a5)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:03.828577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d16990-adbf-404a-90e3-cab71a252b5a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:03.909579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:03.950134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-01d16990-adbf-404a-90e3-cab71a252b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '251cbb4a406040a59e4e264497b4e9a5', 'request_id': 'req-01d16990-adbf-404a-90e3-cab71a252b5a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:03.957435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-01d16990-adbf-404a-90e3-cab71a252b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '251cbb4a406040a59e4e264497b4e9a5', 'request_id': 'req-01d16990-adbf-404a-90e3-cab71a252b5a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.046891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-01d16990-adbf-404a-90e3-cab71a252b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '251cbb4a406040a59e4e264497b4e9a5', 'request_id': 'req-01d16990-adbf-404a-90e3-cab71a252b5a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.054997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051951f-abbc-40c2-a185-4c6c01c124e0 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:04.056558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8051951f-abbc-40c2-a185-4c6c01c124e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:04.058914 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-01d16990-adbf-404a-90e3-cab71a252b5a admin admin] The token cache is being invalidate because project 251cbb4a406040a59e4e264497b4e9a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:04.059244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-01d16990-adbf-404a-90e3-cab71a252b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.059905 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-01d16990-adbf-404a-90e3-cab71a252b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.062393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1061/2118] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:03 2022] DELETE /identity/v3/projects/251cbb4a406040a59e4e264497b4e9a5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:04.067007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01520c6f-d7b5-44f6-8953-a8c409804fa3 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:04.067472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01520c6f-d7b5-44f6-8953-a8c409804fa3 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:04.067837 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01520c6f-d7b5-44f6-8953-a8c409804fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:04.070994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051951f-abbc-40c2-a185-4c6c01c124e0 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:04.097800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-01520c6f-d7b5-44f6-8953-a8c409804fa3 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:04.099004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-01520c6f-d7b5-44f6-8953-a8c409804fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:04.131120 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f0f95-18c6-481d-9471-750b8214f79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:04.132059 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f0f95-18c6-481d-9471-750b8214f79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:04.132651 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f0f95-18c6-481d-9471-750b8214f79d admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:04.133103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f0f95-18c6-481d-9471-750b8214f79d admin admin] PATH_INFO: `/v3/projects/e3b090003c5546caa4ecd6cd8dbb7594` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:04.134277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f0f95-18c6-481d-9471-750b8214f79d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b090003c5546caa4ecd6cd8dbb7594)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:04.136431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f0f95-18c6-481d-9471-750b8214f79d admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:04.167084 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1062/2119] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:04.179158 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949bf7b-4c71-4f40-83e2-048abafd6c99 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:04.179158 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949bf7b-4c71-4f40-83e2-048abafd6c99 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:04.179158 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949bf7b-4c71-4f40-83e2-048abafd6c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:04.197333 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-3949bf7b-4c71-4f40-83e2-048abafd6c99 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:04.198519 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3949bf7b-4c71-4f40-83e2-048abafd6c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:04.207478 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1063/2120] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:04.211984 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949bf7b-4c71-4f40-83e2-048abafd6c99 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:04.221304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949bf7b-4c71-4f40-83e2-048abafd6c99 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:04.225920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ec6e5-c65f-499d-9120-2a2363ed440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:04.226516 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ec6e5-c65f-499d-9120-2a2363ed440d admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:04.226799 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ec6e5-c65f-499d-9120-2a2363ed440d admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:04.227077 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ec6e5-c65f-499d-9120-2a2363ed440d admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:04.227729 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ec6e5-c65f-499d-9120-2a2363ed440d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:51:04.228034 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ec6e5-c65f-499d-9120-2a2363ed440d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:04.229677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ec6e5-c65f-499d-9120-2a2363ed440d admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:04.246080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1064/2121] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:51:04.247217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ec6e5-c65f-499d-9120-2a2363ed440d admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:04.262020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ec6e5-c65f-499d-9120-2a2363ed440d admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:04.272409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-595f0f95-18c6-481d-9471-750b8214f79d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b090003c5546caa4ecd6cd8dbb7594', 'request_id': 'req-595f0f95-18c6-481d-9471-750b8214f79d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.338376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008c547-ce95-41d6-bae5-9318bacf7cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:04.339329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008c547-ce95-41d6-bae5-9318bacf7cdf admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:04.339521 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008c547-ce95-41d6-bae5-9318bacf7cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:04.339997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008c547-ce95-41d6-bae5-9318bacf7cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:04.340677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008c547-ce95-41d6-bae5-9318bacf7cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:04.342717 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008c547-ce95-41d6-bae5-9318bacf7cdf admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:04.365970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-595f0f95-18c6-481d-9471-750b8214f79d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b090003c5546caa4ecd6cd8dbb7594', 'request_id': 'req-595f0f95-18c6-481d-9471-750b8214f79d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.371907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-595f0f95-18c6-481d-9471-750b8214f79d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b090003c5546caa4ecd6cd8dbb7594', 'request_id': 'req-595f0f95-18c6-481d-9471-750b8214f79d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.383787 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-595f0f95-18c6-481d-9471-750b8214f79d admin admin] The token cache is being invalidate because project e3b090003c5546caa4ecd6cd8dbb7594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:04.384078 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-595f0f95-18c6-481d-9471-750b8214f79d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.384745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-595f0f95-18c6-481d-9471-750b8214f79d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.386232 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1058/2122] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:04 2022] DELETE /identity/v3/projects/e3b090003c5546caa4ecd6cd8dbb7594 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:04.390659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f0f95-18c6-481d-9471-750b8214f79d admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:04.391985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-595f0f95-18c6-481d-9471-750b8214f79d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:04.403994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f0f95-18c6-481d-9471-750b8214f79d admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:04.408703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205cdb1-993c-4da0-8ba8-88e88e0433da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:04.409311 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205cdb1-993c-4da0-8ba8-88e88e0433da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:04.409591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205cdb1-993c-4da0-8ba8-88e88e0433da admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:04.409867 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205cdb1-993c-4da0-8ba8-88e88e0433da admin admin] PATH_INFO: `/v3/users/38b42e426e624a78916cbf890d4bb058` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:04.411004 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205cdb1-993c-4da0-8ba8-88e88e0433da admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b42e426e624a78916cbf890d4bb058)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:04.412934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205cdb1-993c-4da0-8ba8-88e88e0433da admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:04.418702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1065/2123] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:04 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:04.423048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008c547-ce95-41d6-bae5-9318bacf7cdf admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:04.425331 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3008c547-ce95-41d6-bae5-9318bacf7cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:04.486215 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:04.490048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008c547-ce95-41d6-bae5-9318bacf7cdf admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:04.494820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340496b-6781-43d6-a3b9-549d1be9ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:04.495417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340496b-6781-43d6-a3b9-549d1be9ab96 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:04.495716 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340496b-6781-43d6-a3b9-549d1be9ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:04.495979 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340496b-6781-43d6-a3b9-549d1be9ab96 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:04.496654 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340496b-6781-43d6-a3b9-549d1be9ab96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:04.498692 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340496b-6781-43d6-a3b9-549d1be9ab96 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:04.579692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5205cdb1-993c-4da0-8ba8-88e88e0433da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b42e426e624a78916cbf890d4bb058'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.593125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5205cdb1-993c-4da0-8ba8-88e88e0433da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b42e426e624a78916cbf890d4bb058'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.601305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1066/2124] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:04 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:04.602162 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340496b-6781-43d6-a3b9-549d1be9ab96 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:04.603747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-1340496b-6781-43d6-a3b9-549d1be9ab96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:04.615971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340496b-6781-43d6-a3b9-549d1be9ab96 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:04.620685 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b929be0-cd88-4da4-96df-9f1a83fe1eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:04.621305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b929be0-cd88-4da4-96df-9f1a83fe1eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:04.621588 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b929be0-cd88-4da4-96df-9f1a83fe1eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:04.621856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b929be0-cd88-4da4-96df-9f1a83fe1eb3 admin admin] PATH_INFO: `/v3/users/b7468e2777a64bd0949a9fb8ea71ab0a` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:04.622974 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b929be0-cd88-4da4-96df-9f1a83fe1eb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7468e2777a64bd0949a9fb8ea71ab0a)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:04.624926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b929be0-cd88-4da4-96df-9f1a83fe1eb3 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:04.725616 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5205cdb1-993c-4da0-8ba8-88e88e0433da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b42e426e624a78916cbf890d4bb058'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.726284 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5205cdb1-993c-4da0-8ba8-88e88e0433da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b42e426e624a78916cbf890d4bb058'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.726909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5205cdb1-993c-4da0-8ba8-88e88e0433da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b42e426e624a78916cbf890d4bb058'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.739725 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1059/2125] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:04 2022] DELETE /identity/v3/users/38b42e426e624a78916cbf890d4bb058 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:04.741244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205cdb1-993c-4da0-8ba8-88e88e0433da admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:04.742812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5205cdb1-993c-4da0-8ba8-88e88e0433da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:04.809063 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205cdb1-993c-4da0-8ba8-88e88e0433da admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:04.814033 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f1a7b-7176-4579-9e26-bfac7a293033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:04.814582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f1a7b-7176-4579-9e26-bfac7a293033 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:04.814865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f1a7b-7176-4579-9e26-bfac7a293033 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:04.815140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f1a7b-7176-4579-9e26-bfac7a293033 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:04.815788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f1a7b-7176-4579-9e26-bfac7a293033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:04.817420 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f1a7b-7176-4579-9e26-bfac7a293033 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:04.828193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1060/2126] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:04.832038 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f1a7b-7176-4579-9e26-bfac7a293033 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:04.842706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f1a7b-7176-4579-9e26-bfac7a293033 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:04.847449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cae107-688d-4df9-9b8a-5f579b6ed08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:04.848198 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cae107-688d-4df9-9b8a-5f579b6ed08b admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:04.848480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cae107-688d-4df9-9b8a-5f579b6ed08b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:04.848775 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cae107-688d-4df9-9b8a-5f579b6ed08b admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:04.849434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cae107-688d-4df9-9b8a-5f579b6ed08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:04.851068 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cae107-688d-4df9-9b8a-5f579b6ed08b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:04.860931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1061/2127] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:51:04.865050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cae107-688d-4df9-9b8a-5f579b6ed08b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:04.875048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cae107-688d-4df9-9b8a-5f579b6ed08b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:04.879924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be4b63-24df-4414-afb6-8b7b2f8766c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:04.880584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be4b63-24df-4414-afb6-8b7b2f8766c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:04.880866 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be4b63-24df-4414-afb6-8b7b2f8766c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:04.881144 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be4b63-24df-4414-afb6-8b7b2f8766c2 admin admin] PATH_INFO: `/v3/projects/783b6e9796e44e51a8c2a97c59de06ce/users/bd55b66cf55e45a3b5b1231670de24e5/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:04.882896 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9b929be0-cd88-4da4-96df-9f1a83fe1eb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7468e2777a64bd0949a9fb8ea71ab0a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.883560 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9b929be0-cd88-4da4-96df-9f1a83fe1eb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7468e2777a64bd0949a9fb8ea71ab0a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.896635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be4b63-24df-4414-afb6-8b7b2f8766c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=783b6e9796e44e51a8c2a97c59de06ce, user_id=bd55b66cf55e45a3b5b1231670de24e5, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:04.899286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be4b63-24df-4414-afb6-8b7b2f8766c2 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:04.959913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9b929be0-cd88-4da4-96df-9f1a83fe1eb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7468e2777a64bd0949a9fb8ea71ab0a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.960610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9b929be0-cd88-4da4-96df-9f1a83fe1eb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7468e2777a64bd0949a9fb8ea71ab0a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.973875 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9b929be0-cd88-4da4-96df-9f1a83fe1eb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7468e2777a64bd0949a9fb8ea71ab0a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:04.986236 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1067/2128] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:04 2022] DELETE /identity/v3/users/b7468e2777a64bd0949a9fb8ea71ab0a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:04.992235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:04.999266 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1062/2129] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:04 2022] PUT /identity/v3/projects/783b6e9796e44e51a8c2a97c59de06ce/users/bd55b66cf55e45a3b5b1231670de24e5/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:04.999816 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112a25f-3218-41b3-9212-af5d35db4fa8 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:05.000342 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112a25f-3218-41b3-9212-af5d35db4fa8 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:05.000796 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112a25f-3218-41b3-9212-af5d35db4fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:05.009668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560c492-3f77-4904-b043-5518d0cfa9c1 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:05.009957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560c492-3f77-4904-b043-5518d0cfa9c1 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:05.010237 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560c492-3f77-4904-b043-5518d0cfa9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:05.024928 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-c112a25f-3218-41b3-9212-af5d35db4fa8 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:05.025984 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c112a25f-3218-41b3-9212-af5d35db4fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:05.043669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d560c492-3f77-4904-b043-5518d0cfa9c1 None None] MFA Rules not processed for user `bd55b66cf55e45a3b5b1231670de24e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:05.045175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d560c492-3f77-4904-b043-5518d0cfa9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:05.090436 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1068/2130] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:05.100398 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112a25f-3218-41b3-9212-af5d35db4fa8 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:05.101813 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c112a25f-3218-41b3-9212-af5d35db4fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:05.112079 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1063/2131] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:05.116593 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560c492-3f77-4904-b043-5518d0cfa9c1 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:05.117895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d560c492-3f77-4904-b043-5518d0cfa9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:05.131711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560c492-3f77-4904-b043-5518d0cfa9c1 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:05.136400 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531853c1-5264-4434-a555-8c59f212d8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:05.136998 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531853c1-5264-4434-a555-8c59f212d8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:05.137288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531853c1-5264-4434-a555-8c59f212d8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:05.137563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531853c1-5264-4434-a555-8c59f212d8f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:05.138216 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531853c1-5264-4434-a555-8c59f212d8f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:05.140914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531853c1-5264-4434-a555-8c59f212d8f8 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:05.162277 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112a25f-3218-41b3-9212-af5d35db4fa8 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:05.166737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90960f-e3b7-4595-bd34-2b9d7d825394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:05.167359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90960f-e3b7-4595-bd34-2b9d7d825394 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:05.167641 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90960f-e3b7-4595-bd34-2b9d7d825394 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:05.167922 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90960f-e3b7-4595-bd34-2b9d7d825394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:05.178007 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90960f-e3b7-4595-bd34-2b9d7d825394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:05.179455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90960f-e3b7-4595-bd34-2b9d7d825394 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:05.190021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1069/2132] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:05.190829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90960f-e3b7-4595-bd34-2b9d7d825394 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:05.192209 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-1a90960f-e3b7-4595-bd34-2b9d7d825394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:05.205105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90960f-e3b7-4595-bd34-2b9d7d825394 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:05.210167 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d450f01-81e6-4014-b0fc-2555297cfdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:05.210807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d450f01-81e6-4014-b0fc-2555297cfdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:05.211085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d450f01-81e6-4014-b0fc-2555297cfdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:05.211384 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d450f01-81e6-4014-b0fc-2555297cfdcb admin admin] PATH_INFO: `/v3/projects/1e3e1adf03b34fb2b14d039c4f35655b` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:05.212551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d450f01-81e6-4014-b0fc-2555297cfdcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3e1adf03b34fb2b14d039c4f35655b)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:05.214476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d450f01-81e6-4014-b0fc-2555297cfdcb admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:05.242335 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1064/2133] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:05 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:51:05.246564 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531853c1-5264-4434-a555-8c59f212d8f8 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:05.311155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531853c1-5264-4434-a555-8c59f212d8f8 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:05.316290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a288d19-d45e-4682-b2d4-196863f14bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:05.320381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a288d19-d45e-4682-b2d4-196863f14bbf admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:05.320381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a288d19-d45e-4682-b2d4-196863f14bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:05.320381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a288d19-d45e-4682-b2d4-196863f14bbf admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:05.320381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a288d19-d45e-4682-b2d4-196863f14bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:05.320834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a288d19-d45e-4682-b2d4-196863f14bbf admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:05.333949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6d450f01-81e6-4014-b0fc-2555297cfdcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3e1adf03b34fb2b14d039c4f35655b', 'request_id': 'req-6d450f01-81e6-4014-b0fc-2555297cfdcb'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:05.343251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6d450f01-81e6-4014-b0fc-2555297cfdcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3e1adf03b34fb2b14d039c4f35655b', 'request_id': 'req-6d450f01-81e6-4014-b0fc-2555297cfdcb'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:05.417781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6d450f01-81e6-4014-b0fc-2555297cfdcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3e1adf03b34fb2b14d039c4f35655b', 'request_id': 'req-6d450f01-81e6-4014-b0fc-2555297cfdcb'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:05.421284 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:05.426242 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1065/2134] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:05 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:51:05.430499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a288d19-d45e-4682-b2d4-196863f14bbf admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:05.432306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6d450f01-81e6-4014-b0fc-2555297cfdcb admin admin] The token cache is being invalidate because project 1e3e1adf03b34fb2b14d039c4f35655b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:05.432617 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6d450f01-81e6-4014-b0fc-2555297cfdcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:05.433896 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6d450f01-81e6-4014-b0fc-2555297cfdcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:05.440528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1070/2135] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:05 2022] DELETE /identity/v3/projects/1e3e1adf03b34fb2b14d039c4f35655b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:05.441900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10052242-2635-403e-ad60-f0fbcc5f3986 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:05.442341 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10052242-2635-403e-ad60-f0fbcc5f3986 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:05.442645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10052242-2635-403e-ad60-f0fbcc5f3986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:05.443953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a288d19-d45e-4682-b2d4-196863f14bbf admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:05.464045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-10052242-2635-403e-ad60-f0fbcc5f3986 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:05.464045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-10052242-2635-403e-ad60-f0fbcc5f3986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:05.512328 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486aa718-76d4-4062-9e30-591bfe90c3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:05.513106 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486aa718-76d4-4062-9e30-591bfe90c3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:05.513419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486aa718-76d4-4062-9e30-591bfe90c3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:05.513701 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486aa718-76d4-4062-9e30-591bfe90c3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:05.514359 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486aa718-76d4-4062-9e30-591bfe90c3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:05.515969 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486aa718-76d4-4062-9e30-591bfe90c3e4 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:05.527287 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1066/2136] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:51:05.531587 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486aa718-76d4-4062-9e30-591bfe90c3e4 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:05.533360 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-486aa718-76d4-4062-9e30-591bfe90c3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:05.545182 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1071/2137] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:05.550968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486aa718-76d4-4062-9e30-591bfe90c3e4 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:05.554586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7990b82-35c1-4310-89a2-94dc9240958c None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:05.554876 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7990b82-35c1-4310-89a2-94dc9240958c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:05.555186 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7990b82-35c1-4310-89a2-94dc9240958c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:05.562660 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d06d6-99d1-4728-a43a-3314ecdf851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:05.564264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d06d6-99d1-4728-a43a-3314ecdf851f admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:05.564264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d06d6-99d1-4728-a43a-3314ecdf851f admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:05.564264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d06d6-99d1-4728-a43a-3314ecdf851f admin admin] PATH_INFO: `/v3/projects/2f13dea0c4794922b804d5b9f2c7ac02/users/5058045697624d0e8b8396543780a8bd/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:05.579461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-b7990b82-35c1-4310-89a2-94dc9240958c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:05.580064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d06d6-99d1-4728-a43a-3314ecdf851f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f13dea0c4794922b804d5b9f2c7ac02, user_id=5058045697624d0e8b8396543780a8bd, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:05.581622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b7990b82-35c1-4310-89a2-94dc9240958c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:05.585189 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d06d6-99d1-4728-a43a-3314ecdf851f admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:05.600472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1072/2138] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:05.604848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7990b82-35c1-4310-89a2-94dc9240958c None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:05.625242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7990b82-35c1-4310-89a2-94dc9240958c None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:05.630054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf8b70-66ae-4a6c-8c4e-47fd0c11d2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:05.630657 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf8b70-66ae-4a6c-8c4e-47fd0c11d2ae admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:05.630930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf8b70-66ae-4a6c-8c4e-47fd0c11d2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:05.631195 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf8b70-66ae-4a6c-8c4e-47fd0c11d2ae admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:05.631838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf8b70-66ae-4a6c-8c4e-47fd0c11d2ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:51:05.632184 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf8b70-66ae-4a6c-8c4e-47fd0c11d2ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:05.633891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf8b70-66ae-4a6c-8c4e-47fd0c11d2ae admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:05.649645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1073/2139] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:51:05.650675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf8b70-66ae-4a6c-8c4e-47fd0c11d2ae admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:05.661520 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf8b70-66ae-4a6c-8c4e-47fd0c11d2ae admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:05.666081 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cbaac-9e40-4ac3-9d51-a2f8db592bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:05.666683 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cbaac-9e40-4ac3-9d51-a2f8db592bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:05.666968 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cbaac-9e40-4ac3-9d51-a2f8db592bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:05.667298 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cbaac-9e40-4ac3-9d51-a2f8db592bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:05.667879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cbaac-9e40-4ac3-9d51-a2f8db592bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:05.670487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cbaac-9e40-4ac3-9d51-a2f8db592bb1 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:05.714691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1067/2140] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:05 2022] PUT /identity/v3/projects/2f13dea0c4794922b804d5b9f2c7ac02/users/5058045697624d0e8b8396543780a8bd/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:05.718570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d06d6-99d1-4728-a43a-3314ecdf851f admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:05.787500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1074/2141] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:05 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:51:05.790957 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cbaac-9e40-4ac3-9d51-a2f8db592bb1 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:05.791464 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b64cbaac-9e40-4ac3-9d51-a2f8db592bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:05.798169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d06d6-99d1-4728-a43a-3314ecdf851f admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:05.875881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea53be5-b8bd-484e-a206-92f89e299e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:05.876260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cbaac-9e40-4ac3-9d51-a2f8db592bb1 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:05.876747 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea53be5-b8bd-484e-a206-92f89e299e2a admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:05.877123 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea53be5-b8bd-484e-a206-92f89e299e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:05.877552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea53be5-b8bd-484e-a206-92f89e299e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:05.878306 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea53be5-b8bd-484e-a206-92f89e299e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:05.880258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea53be5-b8bd-484e-a206-92f89e299e2a admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:05.880849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ca0fc-d591-4605-9075-de2dacd26f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:05.881473 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ca0fc-d591-4605-9075-de2dacd26f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:05.881764 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ca0fc-d591-4605-9075-de2dacd26f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:05.882185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ca0fc-d591-4605-9075-de2dacd26f31 admin admin] PATH_INFO: `/v3/projects/0f5ae5e25b1c4003818687695989ca0d` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:05.883327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ca0fc-d591-4605-9075-de2dacd26f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f5ae5e25b1c4003818687695989ca0d)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:05.885270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ca0fc-d591-4605-9075-de2dacd26f31 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:05.899855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1068/2142] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:51:05.899855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea53be5-b8bd-484e-a206-92f89e299e2a admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:05.906908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:05.911067 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea53be5-b8bd-484e-a206-92f89e299e2a admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:05.917377 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514fae1-1acd-47fc-b120-87d061c913c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:05.918062 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514fae1-1acd-47fc-b120-87d061c913c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:05.918342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514fae1-1acd-47fc-b120-87d061c913c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:05.918610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514fae1-1acd-47fc-b120-87d061c913c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:05.919227 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514fae1-1acd-47fc-b120-87d061c913c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:05.923847 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514fae1-1acd-47fc-b120-87d061c913c0 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:06.012240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9e7ca0fc-d591-4605-9075-de2dacd26f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f5ae5e25b1c4003818687695989ca0d', 'request_id': 'req-9e7ca0fc-d591-4605-9075-de2dacd26f31'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:06.019281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9e7ca0fc-d591-4605-9075-de2dacd26f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f5ae5e25b1c4003818687695989ca0d', 'request_id': 'req-9e7ca0fc-d591-4605-9075-de2dacd26f31'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:06.030108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1069/2143] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:05 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:06.030932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514fae1-1acd-47fc-b120-87d061c913c0 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:06.040611 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514fae1-1acd-47fc-b120-87d061c913c0 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:06.095734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb42bab-8253-4c35-9484-481e6ec0190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:06.096462 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb42bab-8253-4c35-9484-481e6ec0190d admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.096743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb42bab-8253-4c35-9484-481e6ec0190d admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.097022 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb42bab-8253-4c35-9484-481e6ec0190d admin admin] PATH_INFO: `/v3/projects/2f13dea0c4794922b804d5b9f2c7ac02/users/5058045697624d0e8b8396543780a8bd/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.098924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb42bab-8253-4c35-9484-481e6ec0190d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f13dea0c4794922b804d5b9f2c7ac02, user_id=5058045697624d0e8b8396543780a8bd, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:06.101643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb42bab-8253-4c35-9484-481e6ec0190d admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:06.112536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1070/2144] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:06 2022] PUT /identity/v3/projects/2f13dea0c4794922b804d5b9f2c7ac02/users/5058045697624d0e8b8396543780a8bd/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:06.113439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb42bab-8253-4c35-9484-481e6ec0190d admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:06.114683 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9e7ca0fc-d591-4605-9075-de2dacd26f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f5ae5e25b1c4003818687695989ca0d', 'request_id': 'req-9e7ca0fc-d591-4605-9075-de2dacd26f31'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:06.127180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9e7ca0fc-d591-4605-9075-de2dacd26f31 admin admin] The token cache is being invalidate because project 0f5ae5e25b1c4003818687695989ca0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:06.127407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9e7ca0fc-d591-4605-9075-de2dacd26f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:06.128047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9e7ca0fc-d591-4605-9075-de2dacd26f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:06.129616 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1075/2145] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:05 2022] DELETE /identity/v3/projects/0f5ae5e25b1c4003818687695989ca0d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:06.130857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf79564-28ad-465d-8c23-71a0ded4ab15 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.131133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf79564-28ad-465d-8c23-71a0ded4ab15 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.131403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf79564-28ad-465d-8c23-71a0ded4ab15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.159278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-5cf79564-28ad-465d-8c23-71a0ded4ab15 None None] MFA Rules not processed for user `5058045697624d0e8b8396543780a8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:06.160564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-5cf79564-28ad-465d-8c23-71a0ded4ab15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:06.179705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb42bab-8253-4c35-9484-481e6ec0190d admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:06.184468 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a14a1b-249b-44ab-97ba-09bf37fe9072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:06.185122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a14a1b-249b-44ab-97ba-09bf37fe9072 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.185907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a14a1b-249b-44ab-97ba-09bf37fe9072 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.186196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a14a1b-249b-44ab-97ba-09bf37fe9072 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.186829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a14a1b-249b-44ab-97ba-09bf37fe9072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:06.188444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a14a1b-249b-44ab-97ba-09bf37fe9072 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:06.198855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1071/2146] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:06.200221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d2a86-75a3-49ed-9004-26121c3b6902 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.200615 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d2a86-75a3-49ed-9004-26121c3b6902 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.201741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d2a86-75a3-49ed-9004-26121c3b6902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.222724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-326d2a86-75a3-49ed-9004-26121c3b6902 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:06.223934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-326d2a86-75a3-49ed-9004-26121c3b6902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:06.232416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1076/2147] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:06.233781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1072/2148] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:06.233889 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf79564-28ad-465d-8c23-71a0ded4ab15 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:06.241501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-5cf79564-28ad-465d-8c23-71a0ded4ab15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:06.243197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c68509-d53d-4122-a71d-a3fd400f2b10 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.244140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c68509-d53d-4122-a71d-a3fd400f2b10 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.244140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c68509-d53d-4122-a71d-a3fd400f2b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.248559 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf79564-28ad-465d-8c23-71a0ded4ab15 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:06.253259 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1175f40-f2cc-4289-ad78-312b76e9ffaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:06.253860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1175f40-f2cc-4289-ad78-312b76e9ffaa admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.254142 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1175f40-f2cc-4289-ad78-312b76e9ffaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.254413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1175f40-f2cc-4289-ad78-312b76e9ffaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.255061 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1175f40-f2cc-4289-ad78-312b76e9ffaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:06.256716 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1175f40-f2cc-4289-ad78-312b76e9ffaa admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:06.264667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-a4c68509-d53d-4122-a71d-a3fd400f2b10 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:06.265909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a4c68509-d53d-4122-a71d-a3fd400f2b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:06.267207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1077/2149] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:06.268005 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1175f40-f2cc-4289-ad78-312b76e9ffaa admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:06.269631 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a1175f40-f2cc-4289-ad78-312b76e9ffaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:06.274292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:06.276692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1073/2150] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:06.277452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c68509-d53d-4122-a71d-a3fd400f2b10 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:06.290210 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c68509-d53d-4122-a71d-a3fd400f2b10 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:06.295541 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c728cc-3d00-43e7-a401-8bb01884534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:06.296252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c728cc-3d00-43e7-a401-8bb01884534b admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.296530 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c728cc-3d00-43e7-a401-8bb01884534b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.296801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c728cc-3d00-43e7-a401-8bb01884534b admin admin] PATH_INFO: `/v3/projects/d9fff5014b8647e69c7e0dfe9395e9b5/users/f2e9e57b6e504e2cab79ce5da9972413/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.314803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c728cc-3d00-43e7-a401-8bb01884534b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9fff5014b8647e69c7e0dfe9395e9b5, user_id=f2e9e57b6e504e2cab79ce5da9972413, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:06.317581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c728cc-3d00-43e7-a401-8bb01884534b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:06.334282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1175f40-f2cc-4289-ad78-312b76e9ffaa admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:06.338359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804a6a5-9d88-4158-8055-cef71e163a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:06.338965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804a6a5-9d88-4158-8055-cef71e163a5b service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.339246 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804a6a5-9d88-4158-8055-cef71e163a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.339524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804a6a5-9d88-4158-8055-cef71e163a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.342841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d804a6a5-9d88-4158-8055-cef71e163a5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:06.372639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1074/2151] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:06 2022] PUT /identity/v3/projects/d9fff5014b8647e69c7e0dfe9395e9b5/users/f2e9e57b6e504e2cab79ce5da9972413/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:06.373624 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c728cc-3d00-43e7-a401-8bb01884534b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:06.405251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804a6a5-9d88-4158-8055-cef71e163a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:06.406661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804a6a5-9d88-4158-8055-cef71e163a5b service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:06.415906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1078/2152] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:06.417001 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb26b5f-6954-4438-99e0-b2c7d41b700a None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.417288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb26b5f-6954-4438-99e0-b2c7d41b700a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.417565 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb26b5f-6954-4438-99e0-b2c7d41b700a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.444383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c728cc-3d00-43e7-a401-8bb01884534b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:06.449125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-8eb26b5f-6954-4438-99e0-b2c7d41b700a None None] MFA Rules not processed for user `f2e9e57b6e504e2cab79ce5da9972413`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:06.450420 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8eb26b5f-6954-4438-99e0-b2c7d41b700a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:06.450532 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4e49a-4913-4fd0-93de-7126f9ad9cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:06.451953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4e49a-4913-4fd0-93de-7126f9ad9cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.452376 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4e49a-4913-4fd0-93de-7126f9ad9cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.452661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4e49a-4913-4fd0-93de-7126f9ad9cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.453444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4e49a-4913-4fd0-93de-7126f9ad9cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:51:06.453837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4e49a-4913-4fd0-93de-7126f9ad9cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:06.455590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4e49a-4913-4fd0-93de-7126f9ad9cd9 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:06.469962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1075/2153] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:51:06.477043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4e49a-4913-4fd0-93de-7126f9ad9cd9 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:06.487025 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:06.491714 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4e49a-4913-4fd0-93de-7126f9ad9cd9 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:06.499482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ef6d6-45f0-4f01-bd47-d9a8c607b6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:06.499482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ef6d6-45f0-4f01-bd47-d9a8c607b6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.499482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ef6d6-45f0-4f01-bd47-d9a8c607b6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.499482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ef6d6-45f0-4f01-bd47-d9a8c607b6d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.500069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ef6d6-45f0-4f01-bd47-d9a8c607b6d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:06.502565 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ef6d6-45f0-4f01-bd47-d9a8c607b6d5 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:06.522306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1079/2154] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:06.534257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb26b5f-6954-4438-99e0-b2c7d41b700a None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:06.535659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8eb26b5f-6954-4438-99e0-b2c7d41b700a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:06.590460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1076/2155] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:06 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:06.594803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ef6d6-45f0-4f01-bd47-d9a8c607b6d5 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:06.616986 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb26b5f-6954-4438-99e0-b2c7d41b700a None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:06.666945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ef6d6-45f0-4f01-bd47-d9a8c607b6d5 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:06.670093 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd652c2-bf4a-4b8c-b4d9-f0869b6b958c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7d8a79945a4e73839cd2ad995e016b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:06.670817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd652c2-bf4a-4b8c-b4d9-f0869b6b958c service glance] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.671150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd652c2-bf4a-4b8c-b4d9-f0869b6b958c service glance] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.671492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd652c2-bf4a-4b8c-b4d9-f0869b6b958c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.672541 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb661191-eff8-470d-8315-93d2241d3b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:06.673780 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb661191-eff8-470d-8315-93d2241d3b37 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.674066 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb661191-eff8-470d-8315-93d2241d3b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.674341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb661191-eff8-470d-8315-93d2241d3b37 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.674990 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb661191-eff8-470d-8315-93d2241d3b37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:06.676958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb661191-eff8-470d-8315-93d2241d3b37 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:06.686632 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:06.735299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd652c2-bf4a-4b8c-b4d9-f0869b6b958c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:06.736535 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd652c2-bf4a-4b8c-b4d9-f0869b6b958c service glance] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:06.746711 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1080/2156] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:51:06.799088 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1077/2157] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:06 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:51:06.799983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd652c2-bf4a-4b8c-b4d9-f0869b6b958c service glance] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:06.808834 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd652c2-bf4a-4b8c-b4d9-f0869b6b958c service glance] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:06.814593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bd85e-49c5-471b-9de3-6accd296fad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:06.815280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bd85e-49c5-471b-9de3-6accd296fad6 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.815568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bd85e-49c5-471b-9de3-6accd296fad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.815849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bd85e-49c5-471b-9de3-6accd296fad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.816542 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bd85e-49c5-471b-9de3-6accd296fad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:06.818227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bd85e-49c5-471b-9de3-6accd296fad6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:06.829379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1081/2158] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:06.832972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb661191-eff8-470d-8315-93d2241d3b37 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:06.843855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb661191-eff8-470d-8315-93d2241d3b37 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:06.851070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d6456-db62-410c-80f1-9389b32049cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:06.851902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d6456-db62-410c-80f1-9389b32049cb admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.852249 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d6456-db62-410c-80f1-9389b32049cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.852531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d6456-db62-410c-80f1-9389b32049cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.853356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d6456-db62-410c-80f1-9389b32049cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:06.855332 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d6456-db62-410c-80f1-9389b32049cb admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:06.866018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1078/2159] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:51:06.869968 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bd85e-49c5-471b-9de3-6accd296fad6 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:06.879982 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bd85e-49c5-471b-9de3-6accd296fad6 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:06.884737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d32ad3-bf64-4912-ba90-ee4ab41ccac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:06.885395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32ad3-bf64-4912-ba90-ee4ab41ccac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.885678 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32ad3-bf64-4912-ba90-ee4ab41ccac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.885960 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32ad3-bf64-4912-ba90-ee4ab41ccac6 admin admin] PATH_INFO: `/v3/projects/25b3e8c7753b43709c1c52aa96fbde87/users/b66efaf26a8a462eb9146043c378fb6f/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.902635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32ad3-bf64-4912-ba90-ee4ab41ccac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b3e8c7753b43709c1c52aa96fbde87, user_id=b66efaf26a8a462eb9146043c378fb6f, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:06.905951 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32ad3-bf64-4912-ba90-ee4ab41ccac6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:06.965677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1082/2160] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:06 2022] PUT /identity/v3/projects/25b3e8c7753b43709c1c52aa96fbde87/users/b66efaf26a8a462eb9146043c378fb6f/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:06.976555 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948cdb4-1130-4188-a62a-7875f2cb2b53 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:06.977096 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948cdb4-1130-4188-a62a-7875f2cb2b53 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:06.977557 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948cdb4-1130-4188-a62a-7875f2cb2b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:06.982340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:07.007582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-6948cdb4-1130-4188-a62a-7875f2cb2b53 None None] MFA Rules not processed for user `b66efaf26a8a462eb9146043c378fb6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:07.008793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6948cdb4-1130-4188-a62a-7875f2cb2b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:07.018578 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:07.076926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1079/2161] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:07.175648 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d32ad3-bf64-4912-ba90-ee4ab41ccac6 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:07.224719 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d32ad3-bf64-4912-ba90-ee4ab41ccac6 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:07.228400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f55f9-b10c-4236-9b8f-acff3902e246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:07.229000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f55f9-b10c-4236-9b8f-acff3902e246 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:07.229282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f55f9-b10c-4236-9b8f-acff3902e246 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:07.229556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f55f9-b10c-4236-9b8f-acff3902e246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:07.238242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f55f9-b10c-4236-9b8f-acff3902e246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:07.239662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f55f9-b10c-4236-9b8f-acff3902e246 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:07.248335 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1083/2162] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:07.266150 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:07.309203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:07.675823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:08.007205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:08.406283 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:08.440653 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:08.635074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:08.937865 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:09.235002 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:09.526577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:09.720667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:09.886008 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:10.068925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:10.241238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:10.334002 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948cdb4-1130-4188-a62a-7875f2cb2b53 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:10.345026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948cdb4-1130-4188-a62a-7875f2cb2b53 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:10.348980 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caecbc4-2f68-475e-b88c-f183117a28b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:10.349808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caecbc4-2f68-475e-b88c-f183117a28b4 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:10.350315 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caecbc4-2f68-475e-b88c-f183117a28b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:10.350599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caecbc4-2f68-475e-b88c-f183117a28b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:10.361209 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:10.422965 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caecbc4-2f68-475e-b88c-f183117a28b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:10.424776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caecbc4-2f68-475e-b88c-f183117a28b4 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:10.436336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1080/2163] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:10.463353 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:10.817641 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:11.103601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:11.589638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:12.097514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:12.468977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:12.829129 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:12.863859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:13.102329 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:13.172282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:13.371581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:13.554038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:13.817940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:14.166101 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:18.384202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f55f9-b10c-4236-9b8f-acff3902e246 service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:18.386363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-494f55f9-b10c-4236-9b8f-acff3902e246 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:18.425248 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:18.458905 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f55f9-b10c-4236-9b8f-acff3902e246 service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:18.463985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885798f-bb29-46d5-ac04-6bb1da39dd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:18.464657 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885798f-bb29-46d5-ac04-6bb1da39dd96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:18.464939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885798f-bb29-46d5-ac04-6bb1da39dd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:18.465237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885798f-bb29-46d5-ac04-6bb1da39dd96 admin admin] PATH_INFO: `/v3/users/aed1777c4f174bc7a168e92fe26d7bd7` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:18.466402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885798f-bb29-46d5-ac04-6bb1da39dd96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed1777c4f174bc7a168e92fe26d7bd7)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:18.468991 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885798f-bb29-46d5-ac04-6bb1da39dd96 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:18.700103 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2885798f-bb29-46d5-ac04-6bb1da39dd96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed1777c4f174bc7a168e92fe26d7bd7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:18.702046 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2885798f-bb29-46d5-ac04-6bb1da39dd96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed1777c4f174bc7a168e92fe26d7bd7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:18.800362 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2885798f-bb29-46d5-ac04-6bb1da39dd96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed1777c4f174bc7a168e92fe26d7bd7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:18.801141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2885798f-bb29-46d5-ac04-6bb1da39dd96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed1777c4f174bc7a168e92fe26d7bd7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:18.816108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2885798f-bb29-46d5-ac04-6bb1da39dd96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed1777c4f174bc7a168e92fe26d7bd7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:18.837975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1084/2164] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:18 2022] DELETE /identity/v3/users/aed1777c4f174bc7a168e92fe26d7bd7 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:18.842460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53690e12-d776-477c-8600-323ea9729f1c None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:18.844011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53690e12-d776-477c-8600-323ea9729f1c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:18.844379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53690e12-d776-477c-8600-323ea9729f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:18.864400 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-53690e12-d776-477c-8600-323ea9729f1c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:18.865614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-53690e12-d776-477c-8600-323ea9729f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:18.915161 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:18.927777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1081/2165] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:18.937972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885798f-bb29-46d5-ac04-6bb1da39dd96 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:18.939597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2885798f-bb29-46d5-ac04-6bb1da39dd96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:19.002975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885798f-bb29-46d5-ac04-6bb1da39dd96 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:19.006836 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8609b99-e61d-4cb0-8ca5-90f7a825a004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:19.008446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8609b99-e61d-4cb0-8ca5-90f7a825a004 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:19.008446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8609b99-e61d-4cb0-8ca5-90f7a825a004 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:19.008446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8609b99-e61d-4cb0-8ca5-90f7a825a004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:19.019781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8609b99-e61d-4cb0-8ca5-90f7a825a004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:19.021314 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8609b99-e61d-4cb0-8ca5-90f7a825a004 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:19.031610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1085/2166] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:19.523709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53690e12-d776-477c-8600-323ea9729f1c None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:19.526298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-53690e12-d776-477c-8600-323ea9729f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:19.545533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53690e12-d776-477c-8600-323ea9729f1c None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:19.554895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb514e-1e6e-4df9-b0cc-9e57a898d277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:19.554895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb514e-1e6e-4df9-b0cc-9e57a898d277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:19.554895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb514e-1e6e-4df9-b0cc-9e57a898d277 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:19.554895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb514e-1e6e-4df9-b0cc-9e57a898d277 admin admin] PATH_INFO: `/v3/projects/342f4f20a4234f0fbb818bf1fd5b7837` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:19.562202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb514e-1e6e-4df9-b0cc-9e57a898d277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=342f4f20a4234f0fbb818bf1fd5b7837)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:19.564611 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb514e-1e6e-4df9-b0cc-9e57a898d277 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:19.726899 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-69fb514e-1e6e-4df9-b0cc-9e57a898d277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342f4f20a4234f0fbb818bf1fd5b7837', 'request_id': 'req-69fb514e-1e6e-4df9-b0cc-9e57a898d277'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:19.817424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-69fb514e-1e6e-4df9-b0cc-9e57a898d277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342f4f20a4234f0fbb818bf1fd5b7837', 'request_id': 'req-69fb514e-1e6e-4df9-b0cc-9e57a898d277'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:19.824415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-69fb514e-1e6e-4df9-b0cc-9e57a898d277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342f4f20a4234f0fbb818bf1fd5b7837', 'request_id': 'req-69fb514e-1e6e-4df9-b0cc-9e57a898d277'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:19.835634 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-69fb514e-1e6e-4df9-b0cc-9e57a898d277 admin admin] The token cache is being invalidate because project 342f4f20a4234f0fbb818bf1fd5b7837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:19.835922 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-69fb514e-1e6e-4df9-b0cc-9e57a898d277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:19.836599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-69fb514e-1e6e-4df9-b0cc-9e57a898d277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:19.838118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1082/2167] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:19 2022] DELETE /identity/v3/projects/342f4f20a4234f0fbb818bf1fd5b7837 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:19.843490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c8462-3f58-407a-93e7-ccd98289d6f9 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:19.843966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c8462-3f58-407a-93e7-ccd98289d6f9 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:19.844308 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c8462-3f58-407a-93e7-ccd98289d6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:19.865116 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-392c8462-3f58-407a-93e7-ccd98289d6f9 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:19.866329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-392c8462-3f58-407a-93e7-ccd98289d6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:19.923231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:19.940411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1086/2168] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:19.947950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2e852-f2ef-4072-b817-70695fc9ab16 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:19.948628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2e852-f2ef-4072-b817-70695fc9ab16 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:19.953752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2e852-f2ef-4072-b817-70695fc9ab16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:19.973338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-a9f2e852-f2ef-4072-b817-70695fc9ab16 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:19.975375 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a9f2e852-f2ef-4072-b817-70695fc9ab16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:19.990273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1083/2169] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:19.995581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c8462-3f58-407a-93e7-ccd98289d6f9 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:20.007272 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c8462-3f58-407a-93e7-ccd98289d6f9 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:20.012649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7238a-1b66-402a-9675-7deadf012190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:20.013329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7238a-1b66-402a-9675-7deadf012190 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:20.013612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7238a-1b66-402a-9675-7deadf012190 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:20.013962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7238a-1b66-402a-9675-7deadf012190 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:20.014739 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7238a-1b66-402a-9675-7deadf012190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:51:20.015127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7238a-1b66-402a-9675-7deadf012190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:20.016863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7238a-1b66-402a-9675-7deadf012190 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:20.036204 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1087/2170] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:51:20.040605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2e852-f2ef-4072-b817-70695fc9ab16 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:20.051141 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2e852-f2ef-4072-b817-70695fc9ab16 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:20.056955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec520b-48c4-4399-b55d-a9911eccae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:20.057581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec520b-48c4-4399-b55d-a9911eccae72 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:20.057863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec520b-48c4-4399-b55d-a9911eccae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:20.064425 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec520b-48c4-4399-b55d-a9911eccae72 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:20.064425 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec520b-48c4-4399-b55d-a9911eccae72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:20.064425 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec520b-48c4-4399-b55d-a9911eccae72 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:20.138704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1084/2171] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:20 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:20.143217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7238a-1b66-402a-9675-7deadf012190 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:20.154186 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7238a-1b66-402a-9675-7deadf012190 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:20.213249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d161c-fe62-464c-9999-672ca91b6eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:20.213865 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d161c-fe62-464c-9999-672ca91b6eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:20.214148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d161c-fe62-464c-9999-672ca91b6eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:20.214423 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d161c-fe62-464c-9999-672ca91b6eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:20.215066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d161c-fe62-464c-9999-672ca91b6eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:20.217184 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d161c-fe62-464c-9999-672ca91b6eb3 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:20.320576 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1088/2172] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:20 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:20.324793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec520b-48c4-4399-b55d-a9911eccae72 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:20.335815 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec520b-48c4-4399-b55d-a9911eccae72 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:20.340485 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e707e-b2a4-445a-9a82-46ba5095fa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:20.341112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e707e-b2a4-445a-9a82-46ba5095fa90 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:20.341400 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e707e-b2a4-445a-9a82-46ba5095fa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:20.341679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e707e-b2a4-445a-9a82-46ba5095fa90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:20.342324 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e707e-b2a4-445a-9a82-46ba5095fa90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:20.344884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e707e-b2a4-445a-9a82-46ba5095fa90 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:20.359096 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1085/2173] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:20.360280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d161c-fe62-464c-9999-672ca91b6eb3 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:20.370347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d161c-fe62-464c-9999-672ca91b6eb3 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:20.375362 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08850e-cb69-48e1-a82e-1e534091771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:20.375967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08850e-cb69-48e1-a82e-1e534091771e admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:20.376354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08850e-cb69-48e1-a82e-1e534091771e admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:20.380708 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08850e-cb69-48e1-a82e-1e534091771e admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:20.380708 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08850e-cb69-48e1-a82e-1e534091771e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:20.380708 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08850e-cb69-48e1-a82e-1e534091771e admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:20.390472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1089/2174] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:51:20.394581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e707e-b2a4-445a-9a82-46ba5095fa90 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:20.406743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e707e-b2a4-445a-9a82-46ba5095fa90 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:20.410753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37387424-4d71-4918-bebb-9b6434071c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:20.411421 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37387424-4d71-4918-bebb-9b6434071c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:20.411699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37387424-4d71-4918-bebb-9b6434071c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:20.412008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37387424-4d71-4918-bebb-9b6434071c19 admin admin] PATH_INFO: `/v3/projects/a0211c04c2464c678916b8f7458cd343/users/4f38e10fa3a944118990c0f408757dff/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:20.432643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37387424-4d71-4918-bebb-9b6434071c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0211c04c2464c678916b8f7458cd343, user_id=4f38e10fa3a944118990c0f408757dff, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:20.433913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37387424-4d71-4918-bebb-9b6434071c19 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:20.578823 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1086/2175] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:20 2022] PUT /identity/v3/projects/a0211c04c2464c678916b8f7458cd343/users/4f38e10fa3a944118990c0f408757dff/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:20.583956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcf088-7cde-4a57-84ba-5f267ffdf773 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:20.584293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcf088-7cde-4a57-84ba-5f267ffdf773 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:20.584571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcf088-7cde-4a57-84ba-5f267ffdf773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:20.605037 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-edfcf088-7cde-4a57-84ba-5f267ffdf773 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:20.606248 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-edfcf088-7cde-4a57-84ba-5f267ffdf773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:20.667952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1090/2176] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:20.677928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37387424-4d71-4918-bebb-9b6434071c19 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:20.679753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-37387424-4d71-4918-bebb-9b6434071c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:20.749272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37387424-4d71-4918-bebb-9b6434071c19 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:20.752984 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57e24d-a7d0-4052-831d-56726834bb24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:20.753599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57e24d-a7d0-4052-831d-56726834bb24 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:20.753883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57e24d-a7d0-4052-831d-56726834bb24 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:20.754158 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57e24d-a7d0-4052-831d-56726834bb24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:20.763009 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57e24d-a7d0-4052-831d-56726834bb24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:20.765088 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57e24d-a7d0-4052-831d-56726834bb24 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:20.774855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1087/2177] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:22.168652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32db2b-f67a-4a30-a13f-f5fceae66992 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:22.172295 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32db2b-f67a-4a30-a13f-f5fceae66992 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:22.172295 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32db2b-f67a-4a30-a13f-f5fceae66992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:22.212811 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-2b32db2b-f67a-4a30-a13f-f5fceae66992 None None] MFA Rules not processed for user `4f38e10fa3a944118990c0f408757dff`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:22.214043 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2b32db2b-f67a-4a30-a13f-f5fceae66992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:22.291625 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:22.315920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1091/2178] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:22.332104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57e24d-a7d0-4052-831d-56726834bb24 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:22.334158 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ef57e24d-a7d0-4052-831d-56726834bb24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:22.367229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:22.423132 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57e24d-a7d0-4052-831d-56726834bb24 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:22.429018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205b326-8f9c-4618-809a-f971ac75cbcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:22.429656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205b326-8f9c-4618-809a-f971ac75cbcb service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:22.430011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205b326-8f9c-4618-809a-f971ac75cbcb service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:22.430726 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205b326-8f9c-4618-809a-f971ac75cbcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:22.440452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205b326-8f9c-4618-809a-f971ac75cbcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:22.442609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205b326-8f9c-4618-809a-f971ac75cbcb service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:22.453266 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1088/2179] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:24.222047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe1ce8-1f97-4110-98d8-eb798b2b1b84 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:24.222613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe1ce8-1f97-4110-98d8-eb798b2b1b84 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:24.222613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe1ce8-1f97-4110-98d8-eb798b2b1b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:24.243166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-4cfe1ce8-1f97-4110-98d8-eb798b2b1b84 None None] MFA Rules not processed for user `4f38e10fa3a944118990c0f408757dff`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:24.244464 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4cfe1ce8-1f97-4110-98d8-eb798b2b1b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:24.251352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1092/2180] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:26.255268 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205b326-8f9c-4618-809a-f971ac75cbcb service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:26.256767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3205b326-8f9c-4618-809a-f971ac75cbcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:26.271145 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205b326-8f9c-4618-809a-f971ac75cbcb service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:26.275924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642c924-5651-41b1-83b8-f073c9779cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:26.276585 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642c924-5651-41b1-83b8-f073c9779cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.276862 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642c924-5651-41b1-83b8-f073c9779cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.277159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642c924-5651-41b1-83b8-f073c9779cc8 admin admin] PATH_INFO: `/v3/users/bd55b66cf55e45a3b5b1231670de24e5` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.278274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642c924-5651-41b1-83b8-f073c9779cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd55b66cf55e45a3b5b1231670de24e5)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:26.280186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642c924-5651-41b1-83b8-f073c9779cc8 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:26.460273 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-e642c924-5651-41b1-83b8-f073c9779cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd55b66cf55e45a3b5b1231670de24e5'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:26.472808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-e642c924-5651-41b1-83b8-f073c9779cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd55b66cf55e45a3b5b1231670de24e5'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:26.531508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-e642c924-5651-41b1-83b8-f073c9779cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd55b66cf55e45a3b5b1231670de24e5'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:26.532150 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-e642c924-5651-41b1-83b8-f073c9779cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd55b66cf55e45a3b5b1231670de24e5'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:26.532756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-e642c924-5651-41b1-83b8-f073c9779cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd55b66cf55e45a3b5b1231670de24e5'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:26.546093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1089/2181] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:26 2022] DELETE /identity/v3/users/bd55b66cf55e45a3b5b1231670de24e5 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:26.551001 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5ffea-9e21-4d3f-89c9-303c9d93986b None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.551485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5ffea-9e21-4d3f-89c9-303c9d93986b None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.551584 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5ffea-9e21-4d3f-89c9-303c9d93986b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.571870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-73f5ffea-9e21-4d3f-89c9-303c9d93986b None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:26.573314 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-73f5ffea-9e21-4d3f-89c9-303c9d93986b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:26.639463 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1093/2182] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:26.649844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642c924-5651-41b1-83b8-f073c9779cc8 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:26.651376 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e642c924-5651-41b1-83b8-f073c9779cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:26.714279 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642c924-5651-41b1-83b8-f073c9779cc8 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:26.718138 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733953b-d31f-4ea1-aeed-51e10b387cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:26.718807 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733953b-d31f-4ea1-aeed-51e10b387cdf service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.719093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733953b-d31f-4ea1-aeed-51e10b387cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.719448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733953b-d31f-4ea1-aeed-51e10b387cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.729061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733953b-d31f-4ea1-aeed-51e10b387cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:26.730475 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733953b-d31f-4ea1-aeed-51e10b387cdf service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:26.740296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1090/2183] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:27.159784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5ffea-9e21-4d3f-89c9-303c9d93986b None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:27.161281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-73f5ffea-9e21-4d3f-89c9-303c9d93986b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:27.174288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5ffea-9e21-4d3f-89c9-303c9d93986b None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:27.198135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d1020-9510-479d-b90a-e9d86e7b4486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:27.198807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d1020-9510-479d-b90a-e9d86e7b4486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:27.199086 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d1020-9510-479d-b90a-e9d86e7b4486 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:27.199418 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d1020-9510-479d-b90a-e9d86e7b4486 admin admin] PATH_INFO: `/v3/projects/783b6e9796e44e51a8c2a97c59de06ce` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:27.200740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d1020-9510-479d-b90a-e9d86e7b4486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=783b6e9796e44e51a8c2a97c59de06ce)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:27.203856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d1020-9510-479d-b90a-e9d86e7b4486 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:27.333015 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3b0d1020-9510-479d-b90a-e9d86e7b4486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783b6e9796e44e51a8c2a97c59de06ce', 'request_id': 'req-3b0d1020-9510-479d-b90a-e9d86e7b4486'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:27.340588 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3b0d1020-9510-479d-b90a-e9d86e7b4486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783b6e9796e44e51a8c2a97c59de06ce', 'request_id': 'req-3b0d1020-9510-479d-b90a-e9d86e7b4486'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:27.417285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3b0d1020-9510-479d-b90a-e9d86e7b4486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783b6e9796e44e51a8c2a97c59de06ce', 'request_id': 'req-3b0d1020-9510-479d-b90a-e9d86e7b4486'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:27.430220 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3b0d1020-9510-479d-b90a-e9d86e7b4486 admin admin] The token cache is being invalidate because project 783b6e9796e44e51a8c2a97c59de06ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:27.430510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3b0d1020-9510-479d-b90a-e9d86e7b4486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:27.431207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3b0d1020-9510-479d-b90a-e9d86e7b4486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:27.432784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1094/2184] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:27 2022] DELETE /identity/v3/projects/783b6e9796e44e51a8c2a97c59de06ce => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:27.436926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733953b-d31f-4ea1-aeed-51e10b387cdf service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:27.447227 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733953b-d31f-4ea1-aeed-51e10b387cdf service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:27.479163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:27.510761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411601e-a2bc-4c5a-a63f-a1e51eb2740f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:27.511318 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411601e-a2bc-4c5a-a63f-a1e51eb2740f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:27.511602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411601e-a2bc-4c5a-a63f-a1e51eb2740f admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:27.511879 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411601e-a2bc-4c5a-a63f-a1e51eb2740f admin admin] PATH_INFO: `/v3/users/5058045697624d0e8b8396543780a8bd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:27.513136 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411601e-a2bc-4c5a-a63f-a1e51eb2740f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5058045697624d0e8b8396543780a8bd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:27.515025 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411601e-a2bc-4c5a-a63f-a1e51eb2740f admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:27.766870 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b411601e-a2bc-4c5a-a63f-a1e51eb2740f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5058045697624d0e8b8396543780a8bd'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:27.780157 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b411601e-a2bc-4c5a-a63f-a1e51eb2740f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5058045697624d0e8b8396543780a8bd'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:27.942769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b411601e-a2bc-4c5a-a63f-a1e51eb2740f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5058045697624d0e8b8396543780a8bd'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:27.943935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b411601e-a2bc-4c5a-a63f-a1e51eb2740f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5058045697624d0e8b8396543780a8bd'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:27.944914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b411601e-a2bc-4c5a-a63f-a1e51eb2740f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5058045697624d0e8b8396543780a8bd'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:27.958747 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1091/2185] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:27 2022] DELETE /identity/v3/users/5058045697624d0e8b8396543780a8bd => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:28.683579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d1020-9510-479d-b90a-e9d86e7b4486 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:28.685055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3b0d1020-9510-479d-b90a-e9d86e7b4486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:28.698513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d1020-9510-479d-b90a-e9d86e7b4486 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:28.761623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323cf7e-5ea0-4efb-9835-7813285bc04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:28.762721 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323cf7e-5ea0-4efb-9835-7813285bc04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:28.762998 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323cf7e-5ea0-4efb-9835-7813285bc04d admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:28.763271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323cf7e-5ea0-4efb-9835-7813285bc04d admin admin] PATH_INFO: `/v3/projects/2f13dea0c4794922b804d5b9f2c7ac02` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:28.764494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323cf7e-5ea0-4efb-9835-7813285bc04d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f13dea0c4794922b804d5b9f2c7ac02)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:28.766706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323cf7e-5ea0-4efb-9835-7813285bc04d admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:28.785559 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:28.918616 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9323cf7e-5ea0-4efb-9835-7813285bc04d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f13dea0c4794922b804d5b9f2c7ac02', 'request_id': 'req-9323cf7e-5ea0-4efb-9835-7813285bc04d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:28.938508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9323cf7e-5ea0-4efb-9835-7813285bc04d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f13dea0c4794922b804d5b9f2c7ac02', 'request_id': 'req-9323cf7e-5ea0-4efb-9835-7813285bc04d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:29.017062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9323cf7e-5ea0-4efb-9835-7813285bc04d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f13dea0c4794922b804d5b9f2c7ac02', 'request_id': 'req-9323cf7e-5ea0-4efb-9835-7813285bc04d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:29.029020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9323cf7e-5ea0-4efb-9835-7813285bc04d admin admin] The token cache is being invalidate because project 2f13dea0c4794922b804d5b9f2c7ac02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:29.029387 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9323cf7e-5ea0-4efb-9835-7813285bc04d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:29.030100 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9323cf7e-5ea0-4efb-9835-7813285bc04d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:29.031665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1095/2186] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:28 2022] DELETE /identity/v3/projects/2f13dea0c4794922b804d5b9f2c7ac02 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:29.037645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d110da-709a-4658-92a7-98bce69c9ce1 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.038172 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d110da-709a-4658-92a7-98bce69c9ce1 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.038172 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d110da-709a-4658-92a7-98bce69c9ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.060960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-50d110da-709a-4658-92a7-98bce69c9ce1 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:29.062196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-50d110da-709a-4658-92a7-98bce69c9ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:29.130835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1092/2187] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:29.141476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ce8db-f0ff-48d4-8bfe-5402d13d0f47 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.141476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ce8db-f0ff-48d4-8bfe-5402d13d0f47 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.141476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ce8db-f0ff-48d4-8bfe-5402d13d0f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.161287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-739ce8db-f0ff-48d4-8bfe-5402d13d0f47 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:29.162597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-739ce8db-f0ff-48d4-8bfe-5402d13d0f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:29.174463 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1096/2188] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:29.176806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d110da-709a-4658-92a7-98bce69c9ce1 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:29.187269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d110da-709a-4658-92a7-98bce69c9ce1 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:29.192768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583480-37ed-449e-b53a-129a11f0481b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:29.192768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583480-37ed-449e-b53a-129a11f0481b admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.192987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583480-37ed-449e-b53a-129a11f0481b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.193134 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583480-37ed-449e-b53a-129a11f0481b admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.193805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e583480-37ed-449e-b53a-129a11f0481b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:51:29.194112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e583480-37ed-449e-b53a-129a11f0481b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:29.195707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e583480-37ed-449e-b53a-129a11f0481b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:29.208001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1093/2189] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:51:29.220418 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ce8db-f0ff-48d4-8bfe-5402d13d0f47 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:29.243531 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ce8db-f0ff-48d4-8bfe-5402d13d0f47 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:29.248298 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbb8ae-c042-481c-a868-0915a66c6f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:29.248906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbb8ae-c042-481c-a868-0915a66c6f93 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.249180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbb8ae-c042-481c-a868-0915a66c6f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.250559 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbb8ae-c042-481c-a868-0915a66c6f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.251217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbb8ae-c042-481c-a868-0915a66c6f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:29.253220 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbb8ae-c042-481c-a868-0915a66c6f93 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:29.378390 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1097/2190] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:29 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:29.382788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583480-37ed-449e-b53a-129a11f0481b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:29.393696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583480-37ed-449e-b53a-129a11f0481b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:29.439553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:29.462065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96ac0a-865f-4b60-8de2-1bafd96a9253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:29.462950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ac0a-865f-4b60-8de2-1bafd96a9253 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.463235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ac0a-865f-4b60-8de2-1bafd96a9253 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.464116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ac0a-865f-4b60-8de2-1bafd96a9253 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.464231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96ac0a-865f-4b60-8de2-1bafd96a9253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:29.466536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96ac0a-865f-4b60-8de2-1bafd96a9253 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:29.556332 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1094/2191] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:29 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:29.560357 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbb8ae-c042-481c-a868-0915a66c6f93 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:29.572515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbb8ae-c042-481c-a868-0915a66c6f93 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:29.577742 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db2a51-8277-46e8-9b89-849c8a6acc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:29.578998 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db2a51-8277-46e8-9b89-849c8a6acc6b admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.578998 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db2a51-8277-46e8-9b89-849c8a6acc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.579162 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db2a51-8277-46e8-9b89-849c8a6acc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.579929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db2a51-8277-46e8-9b89-849c8a6acc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:29.582171 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db2a51-8277-46e8-9b89-849c8a6acc6b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:29.596206 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1098/2192] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:29.600263 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96ac0a-865f-4b60-8de2-1bafd96a9253 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:29.619901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96ac0a-865f-4b60-8de2-1bafd96a9253 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:29.625888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a63fcb-10a9-4e3b-9428-3b1ab31a8860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:29.626504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a63fcb-10a9-4e3b-9428-3b1ab31a8860 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.626888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a63fcb-10a9-4e3b-9428-3b1ab31a8860 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.627171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a63fcb-10a9-4e3b-9428-3b1ab31a8860 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.628672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a63fcb-10a9-4e3b-9428-3b1ab31a8860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:29.631058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a63fcb-10a9-4e3b-9428-3b1ab31a8860 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:29.648453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1095/2193] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:29.653085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db2a51-8277-46e8-9b89-849c8a6acc6b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:29.664498 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db2a51-8277-46e8-9b89-849c8a6acc6b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:29.669485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a71316-40fc-4958-be3b-5142ef6119a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:29.670293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a71316-40fc-4958-be3b-5142ef6119a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.670578 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a71316-40fc-4958-be3b-5142ef6119a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.671009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a71316-40fc-4958-be3b-5142ef6119a8 admin admin] PATH_INFO: `/v3/projects/391809258545423a98f5a7a51629d283/users/3d39ebf96cb94030b815269299a96c22/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.691470 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a71316-40fc-4958-be3b-5142ef6119a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=391809258545423a98f5a7a51629d283, user_id=3d39ebf96cb94030b815269299a96c22, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:29.694417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a71316-40fc-4958-be3b-5142ef6119a8 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:29.806976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1099/2194] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:29 2022] PUT /identity/v3/projects/391809258545423a98f5a7a51629d283/users/3d39ebf96cb94030b815269299a96c22/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:29.819153 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbeccba-86c9-4b44-b511-3566081798f1 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.822836 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbeccba-86c9-4b44-b511-3566081798f1 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.822836 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbeccba-86c9-4b44-b511-3566081798f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.850978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-0cbeccba-86c9-4b44-b511-3566081798f1 None None] MFA Rules not processed for user `3d39ebf96cb94030b815269299a96c22`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:29.852483 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-0cbeccba-86c9-4b44-b511-3566081798f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:29.934281 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1096/2195] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:29.938769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a71316-40fc-4958-be3b-5142ef6119a8 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:30.017866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a71316-40fc-4958-be3b-5142ef6119a8 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:30.024331 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899a789-3412-4e7d-9be8-153c91fc0a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:30.026674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899a789-3412-4e7d-9be8-153c91fc0a35 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:30.026674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899a789-3412-4e7d-9be8-153c91fc0a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:30.026674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899a789-3412-4e7d-9be8-153c91fc0a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:30.026674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899a789-3412-4e7d-9be8-153c91fc0a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:30.028169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899a789-3412-4e7d-9be8-153c91fc0a35 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:30.134875 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1100/2196] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:29 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:30.139062 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbeccba-86c9-4b44-b511-3566081798f1 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:30.154017 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbeccba-86c9-4b44-b511-3566081798f1 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:30.253198 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef49459-a97e-4865-ab49-95d3cf7e4f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:30.253810 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef49459-a97e-4865-ab49-95d3cf7e4f68 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:30.254083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef49459-a97e-4865-ab49-95d3cf7e4f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:30.254353 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef49459-a97e-4865-ab49-95d3cf7e4f68 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:30.255109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef49459-a97e-4865-ab49-95d3cf7e4f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:30.257046 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef49459-a97e-4865-ab49-95d3cf7e4f68 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:30.373824 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1097/2197] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:30 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:30.378278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899a789-3412-4e7d-9be8-153c91fc0a35 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:30.388613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899a789-3412-4e7d-9be8-153c91fc0a35 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:30.397612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95a7d0-cee1-4e5c-ac60-1acccd9bf701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:30.397612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95a7d0-cee1-4e5c-ac60-1acccd9bf701 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:30.397612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95a7d0-cee1-4e5c-ac60-1acccd9bf701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:30.397612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95a7d0-cee1-4e5c-ac60-1acccd9bf701 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:30.397971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95a7d0-cee1-4e5c-ac60-1acccd9bf701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:30.397971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95a7d0-cee1-4e5c-ac60-1acccd9bf701 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:30.411872 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1101/2198] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:30.413295 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef49459-a97e-4865-ab49-95d3cf7e4f68 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:30.423772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef49459-a97e-4865-ab49-95d3cf7e4f68 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:30.432689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58ae69-d4b3-4e6d-b933-3e1075957e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:30.433311 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58ae69-d4b3-4e6d-b933-3e1075957e36 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:30.433592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58ae69-d4b3-4e6d-b933-3e1075957e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:30.433984 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58ae69-d4b3-4e6d-b933-3e1075957e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:30.434640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58ae69-d4b3-4e6d-b933-3e1075957e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:30.436245 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58ae69-d4b3-4e6d-b933-3e1075957e36 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:30.447296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1098/2199] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:30.452132 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95a7d0-cee1-4e5c-ac60-1acccd9bf701 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:30.467168 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95a7d0-cee1-4e5c-ac60-1acccd9bf701 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:30.471948 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ef6bf-a750-4c91-899b-d329f0dfac91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:30.472835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ef6bf-a750-4c91-899b-d329f0dfac91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:30.472948 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ef6bf-a750-4c91-899b-d329f0dfac91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:30.473203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ef6bf-a750-4c91-899b-d329f0dfac91 admin admin] PATH_INFO: `/v3/projects/6dd7368f0fb54fa296a3e07ca6ad2639/users/edc82be0e5124e708b98e2beae7570d6/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:30.484372 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:30.494195 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ef6bf-a750-4c91-899b-d329f0dfac91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd7368f0fb54fa296a3e07ca6ad2639, user_id=edc82be0e5124e708b98e2beae7570d6, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:30.496952 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ef6bf-a750-4c91-899b-d329f0dfac91 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:30.601461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1102/2200] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:30 2022] PUT /identity/v3/projects/6dd7368f0fb54fa296a3e07ca6ad2639/users/edc82be0e5124e708b98e2beae7570d6/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:30.612591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420a251-23cc-478d-a7f5-e81bd2cfedb6 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:30.612878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420a251-23cc-478d-a7f5-e81bd2cfedb6 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:30.613153 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420a251-23cc-478d-a7f5-e81bd2cfedb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:30.643128 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-1420a251-23cc-478d-a7f5-e81bd2cfedb6 None None] MFA Rules not processed for user `edc82be0e5124e708b98e2beae7570d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:30.644387 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1420a251-23cc-478d-a7f5-e81bd2cfedb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:30.658565 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:30.712571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1099/2201] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:30.717064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ef6bf-a750-4c91-899b-d329f0dfac91 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:30.789618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ef6bf-a750-4c91-899b-d329f0dfac91 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:30.794545 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d1e97-58d8-48df-97e7-a6995ba60db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:30.795158 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d1e97-58d8-48df-97e7-a6995ba60db5 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:30.795438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d1e97-58d8-48df-97e7-a6995ba60db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:30.795715 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d1e97-58d8-48df-97e7-a6995ba60db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:30.796401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d1e97-58d8-48df-97e7-a6995ba60db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:30.798731 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d1e97-58d8-48df-97e7-a6995ba60db5 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:30.936915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1103/2202] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:30 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:30.938079 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420a251-23cc-478d-a7f5-e81bd2cfedb6 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:30.951745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420a251-23cc-478d-a7f5-e81bd2cfedb6 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:31.018967 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c2e52-2009-481e-95ec-bc90c3ee9472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:31.019934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c2e52-2009-481e-95ec-bc90c3ee9472 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:31.020342 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c2e52-2009-481e-95ec-bc90c3ee9472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:31.020716 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c2e52-2009-481e-95ec-bc90c3ee9472 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:31.021823 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c2e52-2009-481e-95ec-bc90c3ee9472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:31.024280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c2e52-2009-481e-95ec-bc90c3ee9472 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:31.108380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1100/2203] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:30 2022] POST /identity/v3/users => generated 300 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:31.118675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d1e97-58d8-48df-97e7-a6995ba60db5 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:31.129077 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d1e97-58d8-48df-97e7-a6995ba60db5 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:31.134052 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4f98c-01d4-404c-942e-2e49c41aa992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:31.134676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4f98c-01d4-404c-942e-2e49c41aa992 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:31.134960 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4f98c-01d4-404c-942e-2e49c41aa992 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:31.135302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4f98c-01d4-404c-942e-2e49c41aa992 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:31.135985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4f98c-01d4-404c-942e-2e49c41aa992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:31.137618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4f98c-01d4-404c-942e-2e49c41aa992 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:31.151120 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1104/2204] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:31.152359 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c2e52-2009-481e-95ec-bc90c3ee9472 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:31.163877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c2e52-2009-481e-95ec-bc90c3ee9472 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:31.168656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47ac8f-9cdc-4aae-8e6f-172482b3dd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:31.169309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47ac8f-9cdc-4aae-8e6f-172482b3dd10 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:31.169702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47ac8f-9cdc-4aae-8e6f-172482b3dd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:31.169983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47ac8f-9cdc-4aae-8e6f-172482b3dd10 admin admin] PATH_INFO: `/v3/projects/a10114ac5e8a4d7fac2db9b42dc4608f/users/376240cb7ef84be382ac381e5d198a1d/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:31.186111 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47ac8f-9cdc-4aae-8e6f-172482b3dd10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a10114ac5e8a4d7fac2db9b42dc4608f, user_id=376240cb7ef84be382ac381e5d198a1d, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:31.188851 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47ac8f-9cdc-4aae-8e6f-172482b3dd10 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:31.268816 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1101/2205] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:31 2022] PUT /identity/v3/projects/a10114ac5e8a4d7fac2db9b42dc4608f/users/376240cb7ef84be382ac381e5d198a1d/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:31.272885 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4f98c-01d4-404c-942e-2e49c41aa992 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:31.283295 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4f98c-01d4-404c-942e-2e49c41aa992 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:31.340752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c711b-8133-46c4-bb93-76e47df69945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:31.341380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c711b-8133-46c4-bb93-76e47df69945 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:31.341660 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c711b-8133-46c4-bb93-76e47df69945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:31.341932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c711b-8133-46c4-bb93-76e47df69945 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:31.342571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c711b-8133-46c4-bb93-76e47df69945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:31.344207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c711b-8133-46c4-bb93-76e47df69945 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:31.354316 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1105/2206] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:51:31.358623 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47ac8f-9cdc-4aae-8e6f-172482b3dd10 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:31.369781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47ac8f-9cdc-4aae-8e6f-172482b3dd10 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:31.374333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40285819-637b-47c1-adb2-ecdd2c45667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:31.375026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40285819-637b-47c1-adb2-ecdd2c45667f admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:31.375309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40285819-637b-47c1-adb2-ecdd2c45667f admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:31.375584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40285819-637b-47c1-adb2-ecdd2c45667f admin admin] PATH_INFO: `/v3/projects/a10114ac5e8a4d7fac2db9b42dc4608f/users/376240cb7ef84be382ac381e5d198a1d/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:31.377525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40285819-637b-47c1-adb2-ecdd2c45667f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a10114ac5e8a4d7fac2db9b42dc4608f, user_id=376240cb7ef84be382ac381e5d198a1d, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:31.380169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40285819-637b-47c1-adb2-ecdd2c45667f admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:31.390376 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1102/2207] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:31 2022] PUT /identity/v3/projects/a10114ac5e8a4d7fac2db9b42dc4608f/users/376240cb7ef84be382ac381e5d198a1d/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:31.401009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbe77d-28fe-4169-9a0b-09e0ed8aa672 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:31.401297 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbe77d-28fe-4169-9a0b-09e0ed8aa672 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:31.401573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbe77d-28fe-4169-9a0b-09e0ed8aa672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:31.436595 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-dbcbe77d-28fe-4169-9a0b-09e0ed8aa672 None None] MFA Rules not processed for user `376240cb7ef84be382ac381e5d198a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:31.438195 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-dbcbe77d-28fe-4169-9a0b-09e0ed8aa672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:31.484602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:31.508655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1106/2208] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:31.519796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40285819-637b-47c1-adb2-ecdd2c45667f admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:31.521790 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-40285819-637b-47c1-adb2-ecdd2c45667f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:31.583252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40285819-637b-47c1-adb2-ecdd2c45667f admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:31.587027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455088c9-71c7-4a74-8a59-ffd207795c2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:31.587655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455088c9-71c7-4a74-8a59-ffd207795c2b service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:31.587933 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455088c9-71c7-4a74-8a59-ffd207795c2b service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:31.588236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455088c9-71c7-4a74-8a59-ffd207795c2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:31.598016 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455088c9-71c7-4a74-8a59-ffd207795c2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:31.599509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455088c9-71c7-4a74-8a59-ffd207795c2b service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:31.608847 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1103/2209] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:31.711508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbe77d-28fe-4169-9a0b-09e0ed8aa672 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:31.713285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-dbcbe77d-28fe-4169-9a0b-09e0ed8aa672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:31.786196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbe77d-28fe-4169-9a0b-09e0ed8aa672 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:31.792189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d693ee-93f7-4589-a3dc-33e2a384229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:31.792841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d693ee-93f7-4589-a3dc-33e2a384229d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:31.793103 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d693ee-93f7-4589-a3dc-33e2a384229d admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:31.793381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d693ee-93f7-4589-a3dc-33e2a384229d admin admin] PATH_INFO: `/v3/users/f2e9e57b6e504e2cab79ce5da9972413` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:31.794752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d693ee-93f7-4589-a3dc-33e2a384229d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2e9e57b6e504e2cab79ce5da9972413)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:31.796741 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d693ee-93f7-4589-a3dc-33e2a384229d admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:32.027414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-82d693ee-93f7-4589-a3dc-33e2a384229d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2e9e57b6e504e2cab79ce5da9972413'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:32.028542 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-82d693ee-93f7-4589-a3dc-33e2a384229d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2e9e57b6e504e2cab79ce5da9972413'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:32.108463 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-82d693ee-93f7-4589-a3dc-33e2a384229d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2e9e57b6e504e2cab79ce5da9972413'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:32.109094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-82d693ee-93f7-4589-a3dc-33e2a384229d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2e9e57b6e504e2cab79ce5da9972413'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:32.139906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-82d693ee-93f7-4589-a3dc-33e2a384229d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2e9e57b6e504e2cab79ce5da9972413'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:32.153352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1107/2210] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:31 2022] DELETE /identity/v3/users/f2e9e57b6e504e2cab79ce5da9972413 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:32.158176 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d7eb6-63d5-4e19-9759-5aaf2433b4b4 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:32.158690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d7eb6-63d5-4e19-9759-5aaf2433b4b4 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:32.159004 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d7eb6-63d5-4e19-9759-5aaf2433b4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:32.179669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-fb1d7eb6-63d5-4e19-9759-5aaf2433b4b4 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:32.181209 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-fb1d7eb6-63d5-4e19-9759-5aaf2433b4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:32.188520 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:32.251394 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1104/2211] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:32.262134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d693ee-93f7-4589-a3dc-33e2a384229d admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:32.263573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-82d693ee-93f7-4589-a3dc-33e2a384229d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:32.324077 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d693ee-93f7-4589-a3dc-33e2a384229d admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:32.327707 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b6ab2-ed6c-41f9-92ce-e717fb83aefa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:32.328377 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b6ab2-ed6c-41f9-92ce-e717fb83aefa service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:32.328652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b6ab2-ed6c-41f9-92ce-e717fb83aefa service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:32.328919 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b6ab2-ed6c-41f9-92ce-e717fb83aefa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:32.337793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b6ab2-ed6c-41f9-92ce-e717fb83aefa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:32.339209 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b6ab2-ed6c-41f9-92ce-e717fb83aefa service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:32.348929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1108/2212] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:32.815106 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d7eb6-63d5-4e19-9759-5aaf2433b4b4 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:32.816713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-fb1d7eb6-63d5-4e19-9759-5aaf2433b4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:32.831297 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d7eb6-63d5-4e19-9759-5aaf2433b4b4 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:32.839703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316e2bd-5b05-4ddb-940c-bddb1ffc7701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:32.839703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316e2bd-5b05-4ddb-940c-bddb1ffc7701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:32.839703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316e2bd-5b05-4ddb-940c-bddb1ffc7701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:32.839703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316e2bd-5b05-4ddb-940c-bddb1ffc7701 admin admin] PATH_INFO: `/v3/projects/d9fff5014b8647e69c7e0dfe9395e9b5` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:32.840429 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316e2bd-5b05-4ddb-940c-bddb1ffc7701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9fff5014b8647e69c7e0dfe9395e9b5)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:32.842328 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316e2bd-5b05-4ddb-940c-bddb1ffc7701 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:32.898432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b6ab2-ed6c-41f9-92ce-e717fb83aefa service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:32.899920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-016b6ab2-ed6c-41f9-92ce-e717fb83aefa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:32.905334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:32.962082 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b6ab2-ed6c-41f9-92ce-e717fb83aefa service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:32.965734 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387a365-51b5-4295-bd38-c6683f2d0ca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:32.968221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387a365-51b5-4295-bd38-c6683f2d0ca9 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:32.968221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387a365-51b5-4295-bd38-c6683f2d0ca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:32.968221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387a365-51b5-4295-bd38-c6683f2d0ca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:32.968713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b387a365-51b5-4295-bd38-c6683f2d0ca9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:32.977878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9316e2bd-5b05-4ddb-940c-bddb1ffc7701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9fff5014b8647e69c7e0dfe9395e9b5', 'request_id': 'req-9316e2bd-5b05-4ddb-940c-bddb1ffc7701'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:33.031292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387a365-51b5-4295-bd38-c6683f2d0ca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:33.032781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387a365-51b5-4295-bd38-c6683f2d0ca9 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:33.042374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1109/2213] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:51:33.044905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9316e2bd-5b05-4ddb-940c-bddb1ffc7701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9fff5014b8647e69c7e0dfe9395e9b5', 'request_id': 'req-9316e2bd-5b05-4ddb-940c-bddb1ffc7701'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:33.051524 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9316e2bd-5b05-4ddb-940c-bddb1ffc7701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9fff5014b8647e69c7e0dfe9395e9b5', 'request_id': 'req-9316e2bd-5b05-4ddb-940c-bddb1ffc7701'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:33.063200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9316e2bd-5b05-4ddb-940c-bddb1ffc7701 admin admin] The token cache is being invalidate because project d9fff5014b8647e69c7e0dfe9395e9b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:33.063489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9316e2bd-5b05-4ddb-940c-bddb1ffc7701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:33.064181 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9316e2bd-5b05-4ddb-940c-bddb1ffc7701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:33.065831 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1105/2214] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:32 2022] DELETE /identity/v3/projects/d9fff5014b8647e69c7e0dfe9395e9b5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:33.070933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e6e4a-ea5a-4dc3-bc1d-a51d5f640193 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:33.071236 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e6e4a-ea5a-4dc3-bc1d-a51d5f640193 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:33.071512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e6e4a-ea5a-4dc3-bc1d-a51d5f640193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:33.111446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ad5e6e4a-ea5a-4dc3-bc1d-a51d5f640193 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:33.115489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ad5e6e4a-ea5a-4dc3-bc1d-a51d5f640193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:33.184350 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1110/2215] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:33.192596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423847-7956-4862-a05a-e9c4bfa4e8e8 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:33.193501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423847-7956-4862-a05a-e9c4bfa4e8e8 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:33.198464 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423847-7956-4862-a05a-e9c4bfa4e8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:33.215244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-bb423847-7956-4862-a05a-e9c4bfa4e8e8 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:33.216533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-bb423847-7956-4862-a05a-e9c4bfa4e8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:33.225407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1106/2216] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:33.231368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e6e4a-ea5a-4dc3-bc1d-a51d5f640193 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:33.240589 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e6e4a-ea5a-4dc3-bc1d-a51d5f640193 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:33.246050 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac6435-1fd5-49cc-a97c-da1e6511942e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:33.246852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac6435-1fd5-49cc-a97c-da1e6511942e admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:33.247159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac6435-1fd5-49cc-a97c-da1e6511942e admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:33.247421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac6435-1fd5-49cc-a97c-da1e6511942e admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:33.248111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac6435-1fd5-49cc-a97c-da1e6511942e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:51:33.251178 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac6435-1fd5-49cc-a97c-da1e6511942e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:33.251178 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac6435-1fd5-49cc-a97c-da1e6511942e admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:33.264290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1111/2217] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:51:33.269585 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423847-7956-4862-a05a-e9c4bfa4e8e8 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:33.279109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423847-7956-4862-a05a-e9c4bfa4e8e8 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:33.284888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02b99c-9e67-4e93-a0de-fac0c86120b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:33.285871 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02b99c-9e67-4e93-a0de-fac0c86120b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:33.286291 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02b99c-9e67-4e93-a0de-fac0c86120b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:33.286571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02b99c-9e67-4e93-a0de-fac0c86120b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:33.287206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02b99c-9e67-4e93-a0de-fac0c86120b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:33.289159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02b99c-9e67-4e93-a0de-fac0c86120b1 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:33.384525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1107/2218] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:33 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:33.388948 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac6435-1fd5-49cc-a97c-da1e6511942e admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:33.400252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac6435-1fd5-49cc-a97c-da1e6511942e admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:33.448144 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:33.484872 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cd710-e5f8-46a3-a60b-ba9afd07eda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:33.485405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cd710-e5f8-46a3-a60b-ba9afd07eda0 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:33.485687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cd710-e5f8-46a3-a60b-ba9afd07eda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:33.485960 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cd710-e5f8-46a3-a60b-ba9afd07eda0 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:33.486646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cd710-e5f8-46a3-a60b-ba9afd07eda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:33.488827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cd710-e5f8-46a3-a60b-ba9afd07eda0 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:33.642517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1112/2219] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:33 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:33.653720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02b99c-9e67-4e93-a0de-fac0c86120b1 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:33.664335 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02b99c-9e67-4e93-a0de-fac0c86120b1 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:33.669434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e119617-5d49-4dc1-9d78-8efc323c653d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:33.670031 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e119617-5d49-4dc1-9d78-8efc323c653d admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:33.670311 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e119617-5d49-4dc1-9d78-8efc323c653d admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:33.670592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e119617-5d49-4dc1-9d78-8efc323c653d admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:33.671246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e119617-5d49-4dc1-9d78-8efc323c653d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:33.672907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e119617-5d49-4dc1-9d78-8efc323c653d admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:33.685814 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1108/2220] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:33.689747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cd710-e5f8-46a3-a60b-ba9afd07eda0 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:33.711836 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cd710-e5f8-46a3-a60b-ba9afd07eda0 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:33.723873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12113aee-65fc-48c8-acef-27cb558e7cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:33.723873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12113aee-65fc-48c8-acef-27cb558e7cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:33.723873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12113aee-65fc-48c8-acef-27cb558e7cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:33.723873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12113aee-65fc-48c8-acef-27cb558e7cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:33.724322 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12113aee-65fc-48c8-acef-27cb558e7cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:33.726042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12113aee-65fc-48c8-acef-27cb558e7cb2 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:33.745356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1113/2221] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:33.746378 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e119617-5d49-4dc1-9d78-8efc323c653d admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:33.758735 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e119617-5d49-4dc1-9d78-8efc323c653d admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:33.765500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52ca79-303e-4c82-a663-23fb3e93324b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:33.766524 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52ca79-303e-4c82-a663-23fb3e93324b admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:33.766814 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52ca79-303e-4c82-a663-23fb3e93324b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:33.767247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52ca79-303e-4c82-a663-23fb3e93324b admin admin] PATH_INFO: `/v3/projects/5aa95c2b0d494be5bf36f95b502c7d00/users/2d6f85d6b7444c9e93d49c3f40365c49/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:33.789602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52ca79-303e-4c82-a663-23fb3e93324b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa95c2b0d494be5bf36f95b502c7d00, user_id=2d6f85d6b7444c9e93d49c3f40365c49, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:33.793180 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52ca79-303e-4c82-a663-23fb3e93324b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:33.880684 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1109/2222] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:33 2022] PUT /identity/v3/projects/5aa95c2b0d494be5bf36f95b502c7d00/users/2d6f85d6b7444c9e93d49c3f40365c49/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:33.890922 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8731f7e-4f90-4d10-97cc-c80a5c398669 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:33.891203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8731f7e-4f90-4d10-97cc-c80a5c398669 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:33.891478 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8731f7e-4f90-4d10-97cc-c80a5c398669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:33.920400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-c8731f7e-4f90-4d10-97cc-c80a5c398669 None None] MFA Rules not processed for user `2d6f85d6b7444c9e93d49c3f40365c49`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:33.921670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c8731f7e-4f90-4d10-97cc-c80a5c398669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:33.991025 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1114/2223] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:34.003578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52ca79-303e-4c82-a663-23fb3e93324b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:34.005304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-7b52ca79-303e-4c82-a663-23fb3e93324b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:34.040340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:34.065979 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52ca79-303e-4c82-a663-23fb3e93324b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:34.069934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e349f-fde0-47fc-a493-1ec62238e31c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7d8a79945a4e73839cd2ad995e016b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:34.071367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e349f-fde0-47fc-a493-1ec62238e31c service glance] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:34.071367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e349f-fde0-47fc-a493-1ec62238e31c service glance] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:34.071367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e349f-fde0-47fc-a493-1ec62238e31c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:34.080643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e349f-fde0-47fc-a493-1ec62238e31c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:34.082204 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e349f-fde0-47fc-a493-1ec62238e31c service glance] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:34.091802 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1110/2224] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:37.410426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240a5d1-be91-4eba-91a4-aa9317336ecf None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:37.410975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240a5d1-be91-4eba-91a4-aa9317336ecf None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:37.410975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240a5d1-be91-4eba-91a4-aa9317336ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:37.431899 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-e240a5d1-be91-4eba-91a4-aa9317336ecf None None] MFA Rules not processed for user `702f1e3b8d0342fc999f63d701bc4772`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:37.433333 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e240a5d1-be91-4eba-91a4-aa9317336ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:37.495026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1115/2225] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:38.243379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e349f-fde0-47fc-a493-1ec62238e31c service glance] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:38.244845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d47e349f-fde0-47fc-a493-1ec62238e31c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:38.308677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e349f-fde0-47fc-a493-1ec62238e31c service glance] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:38.312247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a51545-9c32-443c-a78e-1c9dfdbb11d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:38.312848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a51545-9c32-443c-a78e-1c9dfdbb11d0 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:38.313127 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a51545-9c32-443c-a78e-1c9dfdbb11d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:38.313407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a51545-9c32-443c-a78e-1c9dfdbb11d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:38.315738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-47a51545-9c32-443c-a78e-1c9dfdbb11d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:38.380200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a51545-9c32-443c-a78e-1c9dfdbb11d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:38.381540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a51545-9c32-443c-a78e-1c9dfdbb11d0 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:38.408844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1111/2226] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:42.713706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240a5d1-be91-4eba-91a4-aa9317336ecf None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:42.715127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e240a5d1-be91-4eba-91a4-aa9317336ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:42.789184 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:42.797544 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240a5d1-be91-4eba-91a4-aa9317336ecf None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:42.804322 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb03f3-ecad-4d0c-914a-4216247874ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:42.811328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb03f3-ecad-4d0c-914a-4216247874ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:42.811328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb03f3-ecad-4d0c-914a-4216247874ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:42.811328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb03f3-ecad-4d0c-914a-4216247874ca admin admin] PATH_INFO: `/v3/users/3d39ebf96cb94030b815269299a96c22` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:42.811328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb03f3-ecad-4d0c-914a-4216247874ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d39ebf96cb94030b815269299a96c22)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:42.811328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb03f3-ecad-4d0c-914a-4216247874ca admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:42.969396 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2ecb03f3-ecad-4d0c-914a-4216247874ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d39ebf96cb94030b815269299a96c22'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:42.970697 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2ecb03f3-ecad-4d0c-914a-4216247874ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d39ebf96cb94030b815269299a96c22'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:43.033553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2ecb03f3-ecad-4d0c-914a-4216247874ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d39ebf96cb94030b815269299a96c22'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:43.034733 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2ecb03f3-ecad-4d0c-914a-4216247874ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d39ebf96cb94030b815269299a96c22'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:43.049369 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2ecb03f3-ecad-4d0c-914a-4216247874ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d39ebf96cb94030b815269299a96c22'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:43.062040 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1116/2227] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:42 2022] DELETE /identity/v3/users/3d39ebf96cb94030b815269299a96c22 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:43.066741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850512e-eafb-4454-80f7-2f82e365bc82 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:43.067218 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850512e-eafb-4454-80f7-2f82e365bc82 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:43.067304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850512e-eafb-4454-80f7-2f82e365bc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:43.087310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-b850512e-eafb-4454-80f7-2f82e365bc82 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:43.088263 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b850512e-eafb-4454-80f7-2f82e365bc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:43.152347 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1112/2228] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:43.163316 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb03f3-ecad-4d0c-914a-4216247874ca admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:43.165118 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2ecb03f3-ecad-4d0c-914a-4216247874ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:43.238277 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb03f3-ecad-4d0c-914a-4216247874ca admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:43.242327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3398666-e627-440d-a94f-613e61b3e82b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:43.242938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3398666-e627-440d-a94f-613e61b3e82b service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:43.243216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3398666-e627-440d-a94f-613e61b3e82b service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:43.243490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3398666-e627-440d-a94f-613e61b3e82b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:43.255479 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3398666-e627-440d-a94f-613e61b3e82b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:43.256955 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3398666-e627-440d-a94f-613e61b3e82b service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:43.274457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1117/2229] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:43.843995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850512e-eafb-4454-80f7-2f82e365bc82 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:43.845528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b850512e-eafb-4454-80f7-2f82e365bc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:43.863732 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850512e-eafb-4454-80f7-2f82e365bc82 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:43.871223 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee820a6-1fa1-403d-8b85-285be10a4cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:43.872495 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee820a6-1fa1-403d-8b85-285be10a4cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:43.872748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee820a6-1fa1-403d-8b85-285be10a4cef admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:43.873070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee820a6-1fa1-403d-8b85-285be10a4cef admin admin] PATH_INFO: `/v3/projects/391809258545423a98f5a7a51629d283` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:43.875081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee820a6-1fa1-403d-8b85-285be10a4cef admin admin] RBAC: Authorizing `identity:delete_project(project_id=391809258545423a98f5a7a51629d283)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:43.877035 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee820a6-1fa1-403d-8b85-285be10a4cef admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:43.930831 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:44.036794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-fee820a6-1fa1-403d-8b85-285be10a4cef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '391809258545423a98f5a7a51629d283', 'request_id': 'req-fee820a6-1fa1-403d-8b85-285be10a4cef'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:44.114501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-fee820a6-1fa1-403d-8b85-285be10a4cef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '391809258545423a98f5a7a51629d283', 'request_id': 'req-fee820a6-1fa1-403d-8b85-285be10a4cef'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:44.121306 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-fee820a6-1fa1-403d-8b85-285be10a4cef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '391809258545423a98f5a7a51629d283', 'request_id': 'req-fee820a6-1fa1-403d-8b85-285be10a4cef'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:44.133522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-fee820a6-1fa1-403d-8b85-285be10a4cef admin admin] The token cache is being invalidate because project 391809258545423a98f5a7a51629d283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:44.133948 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-fee820a6-1fa1-403d-8b85-285be10a4cef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:44.134624 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-fee820a6-1fa1-403d-8b85-285be10a4cef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:44.136148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1113/2230] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:43 2022] DELETE /identity/v3/projects/391809258545423a98f5a7a51629d283 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:44.140099 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3398666-e627-440d-a94f-613e61b3e82b service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:44.150565 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3398666-e627-440d-a94f-613e61b3e82b service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:44.240980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0046f-1aa0-4c12-bd20-c5b992d2333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:44.245696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0046f-1aa0-4c12-bd20-c5b992d2333d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:44.245696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0046f-1aa0-4c12-bd20-c5b992d2333d admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:44.245696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0046f-1aa0-4c12-bd20-c5b992d2333d admin admin] PATH_INFO: `/v3/users/edc82be0e5124e708b98e2beae7570d6` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:44.245696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0046f-1aa0-4c12-bd20-c5b992d2333d admin admin] RBAC: Authorizing `identity:delete_user(user_id=edc82be0e5124e708b98e2beae7570d6)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:44.245696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0046f-1aa0-4c12-bd20-c5b992d2333d admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:44.285529 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:44.459181 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9cf0046f-1aa0-4c12-bd20-c5b992d2333d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edc82be0e5124e708b98e2beae7570d6'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:44.463031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9cf0046f-1aa0-4c12-bd20-c5b992d2333d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edc82be0e5124e708b98e2beae7570d6'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:44.536556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9cf0046f-1aa0-4c12-bd20-c5b992d2333d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edc82be0e5124e708b98e2beae7570d6'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:44.537202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9cf0046f-1aa0-4c12-bd20-c5b992d2333d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edc82be0e5124e708b98e2beae7570d6'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:44.564941 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9cf0046f-1aa0-4c12-bd20-c5b992d2333d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edc82be0e5124e708b98e2beae7570d6'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:44.599965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1118/2231] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:44 2022] DELETE /identity/v3/users/edc82be0e5124e708b98e2beae7570d6 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:45.103740 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee820a6-1fa1-403d-8b85-285be10a4cef admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:45.105491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-fee820a6-1fa1-403d-8b85-285be10a4cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:45.130770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee820a6-1fa1-403d-8b85-285be10a4cef admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:45.224011 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1921a29-4347-42e8-ba6d-68ad104060fe None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:45.224549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1921a29-4347-42e8-ba6d-68ad104060fe None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:45.224643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1921a29-4347-42e8-ba6d-68ad104060fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:45.242513 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddffab-df83-49e8-9bd6-24aeeb0320bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:45.243212 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddffab-df83-49e8-9bd6-24aeeb0320bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:45.243491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddffab-df83-49e8-9bd6-24aeeb0320bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:45.243765 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddffab-df83-49e8-9bd6-24aeeb0320bf admin admin] PATH_INFO: `/v3/projects/6dd7368f0fb54fa296a3e07ca6ad2639` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:45.245080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddffab-df83-49e8-9bd6-24aeeb0320bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd7368f0fb54fa296a3e07ca6ad2639)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:45.246978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddffab-df83-49e8-9bd6-24aeeb0320bf admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:45.249035 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-f1921a29-4347-42e8-ba6d-68ad104060fe None None] MFA Rules not processed for user `4f38e10fa3a944118990c0f408757dff`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:45.250244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f1921a29-4347-42e8-ba6d-68ad104060fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:45.310490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1119/2232] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:45.356482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ddddffab-df83-49e8-9bd6-24aeeb0320bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd7368f0fb54fa296a3e07ca6ad2639', 'request_id': 'req-ddddffab-df83-49e8-9bd6-24aeeb0320bf'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:45.416671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ddddffab-df83-49e8-9bd6-24aeeb0320bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd7368f0fb54fa296a3e07ca6ad2639', 'request_id': 'req-ddddffab-df83-49e8-9bd6-24aeeb0320bf'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:45.422878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ddddffab-df83-49e8-9bd6-24aeeb0320bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd7368f0fb54fa296a3e07ca6ad2639', 'request_id': 'req-ddddffab-df83-49e8-9bd6-24aeeb0320bf'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:45.437255 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ddddffab-df83-49e8-9bd6-24aeeb0320bf admin admin] The token cache is being invalidate because project 6dd7368f0fb54fa296a3e07ca6ad2639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:45.437572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ddddffab-df83-49e8-9bd6-24aeeb0320bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:45.438296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ddddffab-df83-49e8-9bd6-24aeeb0320bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:45.439858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1114/2233] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:45 2022] DELETE /identity/v3/projects/6dd7368f0fb54fa296a3e07ca6ad2639 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:45.443959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1921a29-4347-42e8-ba6d-68ad104060fe None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:45.445447 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f1921a29-4347-42e8-ba6d-68ad104060fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:45.458819 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1921a29-4347-42e8-ba6d-68ad104060fe None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:45.522490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c352e18-8b3f-4003-b60e-c445086eb0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:45.523122 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c352e18-8b3f-4003-b60e-c445086eb0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:45.523402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c352e18-8b3f-4003-b60e-c445086eb0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:45.523678 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c352e18-8b3f-4003-b60e-c445086eb0ad admin admin] PATH_INFO: `/v3/users/376240cb7ef84be382ac381e5d198a1d` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:45.524866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c352e18-8b3f-4003-b60e-c445086eb0ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=376240cb7ef84be382ac381e5d198a1d)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:45.526795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c352e18-8b3f-4003-b60e-c445086eb0ad admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:45.779125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:45.785101 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6c352e18-8b3f-4003-b60e-c445086eb0ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376240cb7ef84be382ac381e5d198a1d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:45.785101 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6c352e18-8b3f-4003-b60e-c445086eb0ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376240cb7ef84be382ac381e5d198a1d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:45.857573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6c352e18-8b3f-4003-b60e-c445086eb0ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376240cb7ef84be382ac381e5d198a1d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:45.858515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6c352e18-8b3f-4003-b60e-c445086eb0ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376240cb7ef84be382ac381e5d198a1d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:45.885473 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6c352e18-8b3f-4003-b60e-c445086eb0ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376240cb7ef84be382ac381e5d198a1d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:45.917373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1120/2234] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:45 2022] DELETE /identity/v3/users/376240cb7ef84be382ac381e5d198a1d => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:46.745300 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddffab-df83-49e8-9bd6-24aeeb0320bf admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:46.746821 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ddddffab-df83-49e8-9bd6-24aeeb0320bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:46.761516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddffab-df83-49e8-9bd6-24aeeb0320bf admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:46.819842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:46.841106 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd16236-19fe-455d-9ac2-c6d08bcd4700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:46.841887 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd16236-19fe-455d-9ac2-c6d08bcd4700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:46.842439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd16236-19fe-455d-9ac2-c6d08bcd4700 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:46.842937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd16236-19fe-455d-9ac2-c6d08bcd4700 admin admin] PATH_INFO: `/v3/projects/a10114ac5e8a4d7fac2db9b42dc4608f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:46.844683 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd16236-19fe-455d-9ac2-c6d08bcd4700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a10114ac5e8a4d7fac2db9b42dc4608f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:46.852283 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd16236-19fe-455d-9ac2-c6d08bcd4700 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:46.989575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5fd16236-19fe-455d-9ac2-c6d08bcd4700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a10114ac5e8a4d7fac2db9b42dc4608f', 'request_id': 'req-5fd16236-19fe-455d-9ac2-c6d08bcd4700'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:47.068840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5fd16236-19fe-455d-9ac2-c6d08bcd4700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a10114ac5e8a4d7fac2db9b42dc4608f', 'request_id': 'req-5fd16236-19fe-455d-9ac2-c6d08bcd4700'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:47.101131 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5fd16236-19fe-455d-9ac2-c6d08bcd4700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a10114ac5e8a4d7fac2db9b42dc4608f', 'request_id': 'req-5fd16236-19fe-455d-9ac2-c6d08bcd4700'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:47.117237 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5fd16236-19fe-455d-9ac2-c6d08bcd4700 admin admin] The token cache is being invalidate because project a10114ac5e8a4d7fac2db9b42dc4608f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:47.117536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5fd16236-19fe-455d-9ac2-c6d08bcd4700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:47.118551 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5fd16236-19fe-455d-9ac2-c6d08bcd4700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:47.121324 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1115/2235] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:46 2022] DELETE /identity/v3/projects/a10114ac5e8a4d7fac2db9b42dc4608f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:47.128336 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acea38-26f7-4313-bdc5-27b38b497bbb None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:47.128853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acea38-26f7-4313-bdc5-27b38b497bbb None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:47.128964 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acea38-26f7-4313-bdc5-27b38b497bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:47.155680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-53acea38-26f7-4313-bdc5-27b38b497bbb None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:47.158315 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-53acea38-26f7-4313-bdc5-27b38b497bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:47.240014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1121/2236] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:47.248581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024dab9-ad5a-470f-bac9-7c1f9d2f4cea None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:47.248913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024dab9-ad5a-470f-bac9-7c1f9d2f4cea None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:47.249626 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024dab9-ad5a-470f-bac9-7c1f9d2f4cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:47.290133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-0024dab9-ad5a-470f-bac9-7c1f9d2f4cea None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:47.290133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-0024dab9-ad5a-470f-bac9-7c1f9d2f4cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:47.300187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1116/2237] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:47.304255 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acea38-26f7-4313-bdc5-27b38b497bbb None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:47.321131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acea38-26f7-4313-bdc5-27b38b497bbb None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:47.329631 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1760ad-0ac5-4a93-b551-6ded6eb6b643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:47.331009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1760ad-0ac5-4a93-b551-6ded6eb6b643 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:47.331817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1760ad-0ac5-4a93-b551-6ded6eb6b643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:47.332233 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1760ad-0ac5-4a93-b551-6ded6eb6b643 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:47.333233 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1760ad-0ac5-4a93-b551-6ded6eb6b643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:51:47.333884 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1760ad-0ac5-4a93-b551-6ded6eb6b643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:47.335891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1760ad-0ac5-4a93-b551-6ded6eb6b643 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:47.352137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1122/2238] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:51:47.355451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024dab9-ad5a-470f-bac9-7c1f9d2f4cea None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:47.367290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024dab9-ad5a-470f-bac9-7c1f9d2f4cea None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:47.375741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6aca44-1117-4c2c-bd6a-33dfce5869e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:47.376680 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6aca44-1117-4c2c-bd6a-33dfce5869e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:47.377093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6aca44-1117-4c2c-bd6a-33dfce5869e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:47.377456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6aca44-1117-4c2c-bd6a-33dfce5869e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:47.378752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6aca44-1117-4c2c-bd6a-33dfce5869e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:47.381168 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6aca44-1117-4c2c-bd6a-33dfce5869e2 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:47.509620 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1117/2239] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:47 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:51:47.514194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1760ad-0ac5-4a93-b551-6ded6eb6b643 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:47.527588 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1760ad-0ac5-4a93-b551-6ded6eb6b643 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:47.591997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b1b7d-ebd4-4d90-96bd-e779f9cfaffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:47.592167 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b1b7d-ebd4-4d90-96bd-e779f9cfaffe admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:47.592427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b1b7d-ebd4-4d90-96bd-e779f9cfaffe admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:47.592701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b1b7d-ebd4-4d90-96bd-e779f9cfaffe admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:47.593342 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b1b7d-ebd4-4d90-96bd-e779f9cfaffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:47.595270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b1b7d-ebd4-4d90-96bd-e779f9cfaffe admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:47.750749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1123/2240] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:47 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:47.759105 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6aca44-1117-4c2c-bd6a-33dfce5869e2 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:47.771309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6aca44-1117-4c2c-bd6a-33dfce5869e2 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:47.776296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f7f79-91f4-459c-af02-0d53ca579f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:47.776987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f7f79-91f4-459c-af02-0d53ca579f57 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:47.777270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f7f79-91f4-459c-af02-0d53ca579f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:47.777659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f7f79-91f4-459c-af02-0d53ca579f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:47.778314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f7f79-91f4-459c-af02-0d53ca579f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:47.780516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f7f79-91f4-459c-af02-0d53ca579f57 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:47.792414 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1118/2241] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:47.796376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b1b7d-ebd4-4d90-96bd-e779f9cfaffe admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:47.807656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b1b7d-ebd4-4d90-96bd-e779f9cfaffe admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:47.812558 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ee1c5-f37f-4c98-96e7-2b9f268fc40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:47.813234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ee1c5-f37f-4c98-96e7-2b9f268fc40b admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:47.814011 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ee1c5-f37f-4c98-96e7-2b9f268fc40b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:47.814415 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ee1c5-f37f-4c98-96e7-2b9f268fc40b admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:47.815660 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ee1c5-f37f-4c98-96e7-2b9f268fc40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:47.817291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ee1c5-f37f-4c98-96e7-2b9f268fc40b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:47.828954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1124/2242] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:47.833432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f7f79-91f4-459c-af02-0d53ca579f57 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:47.843983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f7f79-91f4-459c-af02-0d53ca579f57 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:47.850374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09538e8-de10-4a0f-9c52-62d1b2ea5699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:47.851781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09538e8-de10-4a0f-9c52-62d1b2ea5699 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:47.851781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09538e8-de10-4a0f-9c52-62d1b2ea5699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:47.851781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09538e8-de10-4a0f-9c52-62d1b2ea5699 admin admin] PATH_INFO: `/v3/projects/31794ad38ab943d3bec92926e2134061/users/dad66ede7a2f43f8bc0b69c699d25b9a/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:47.887889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09538e8-de10-4a0f-9c52-62d1b2ea5699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31794ad38ab943d3bec92926e2134061, user_id=dad66ede7a2f43f8bc0b69c699d25b9a, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:47.893950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09538e8-de10-4a0f-9c52-62d1b2ea5699 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:48.003521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1119/2243] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:47 2022] PUT /identity/v3/projects/31794ad38ab943d3bec92926e2134061/users/dad66ede7a2f43f8bc0b69c699d25b9a/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:48.015100 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68b90f-12dd-4d21-b2d9-495b45581895 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:48.015385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68b90f-12dd-4d21-b2d9-495b45581895 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:48.015771 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68b90f-12dd-4d21-b2d9-495b45581895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:48.051629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-aa68b90f-12dd-4d21-b2d9-495b45581895 None None] MFA Rules not processed for user `dad66ede7a2f43f8bc0b69c699d25b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:48.053268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-aa68b90f-12dd-4d21-b2d9-495b45581895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:48.091944 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:48.161830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1125/2244] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:48.174991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09538e8-de10-4a0f-9c52-62d1b2ea5699 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:48.177163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b09538e8-de10-4a0f-9c52-62d1b2ea5699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:48.247860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09538e8-de10-4a0f-9c52-62d1b2ea5699 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:48.253144 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f94268-4e57-495a-bf4f-8e440d84e646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:48.253299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f94268-4e57-495a-bf4f-8e440d84e646 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:48.253639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f94268-4e57-495a-bf4f-8e440d84e646 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:48.253919 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f94268-4e57-495a-bf4f-8e440d84e646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:48.267599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f94268-4e57-495a-bf4f-8e440d84e646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:48.270241 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f94268-4e57-495a-bf4f-8e440d84e646 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:48.307102 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1120/2245] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:50.495844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68b90f-12dd-4d21-b2d9-495b45581895 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:50.497859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-aa68b90f-12dd-4d21-b2d9-495b45581895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:50.596225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68b90f-12dd-4d21-b2d9-495b45581895 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:50.601623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd00c5-61b9-4829-aeec-766cfb7b070c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:50.602316 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd00c5-61b9-4829-aeec-766cfb7b070c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:50.602933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd00c5-61b9-4829-aeec-766cfb7b070c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:50.603209 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd00c5-61b9-4829-aeec-766cfb7b070c admin admin] PATH_INFO: `/v3/users/b66efaf26a8a462eb9146043c378fb6f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:50.604956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd00c5-61b9-4829-aeec-766cfb7b070c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66efaf26a8a462eb9146043c378fb6f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:50.607203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd00c5-61b9-4829-aeec-766cfb7b070c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:50.814430 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-26fd00c5-61b9-4829-aeec-766cfb7b070c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66efaf26a8a462eb9146043c378fb6f'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:50.815403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-26fd00c5-61b9-4829-aeec-766cfb7b070c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66efaf26a8a462eb9146043c378fb6f'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:50.873971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-26fd00c5-61b9-4829-aeec-766cfb7b070c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66efaf26a8a462eb9146043c378fb6f'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:50.875309 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-26fd00c5-61b9-4829-aeec-766cfb7b070c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66efaf26a8a462eb9146043c378fb6f'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:50.904861 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-26fd00c5-61b9-4829-aeec-766cfb7b070c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66efaf26a8a462eb9146043c378fb6f'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:50.935625 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1126/2246] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:50 2022] DELETE /identity/v3/users/b66efaf26a8a462eb9146043c378fb6f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:50.940318 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08374f-e092-49cd-a14e-58548a580575 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:50.940820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08374f-e092-49cd-a14e-58548a580575 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:50.941725 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08374f-e092-49cd-a14e-58548a580575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:50.965699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-8d08374f-e092-49cd-a14e-58548a580575 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:50.966465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8d08374f-e092-49cd-a14e-58548a580575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:50.972918 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:51.040661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1121/2247] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:51.049714 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd00c5-61b9-4829-aeec-766cfb7b070c admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:51.051414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-26fd00c5-61b9-4829-aeec-766cfb7b070c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:51.094953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:51.111447 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd00c5-61b9-4829-aeec-766cfb7b070c admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:51.115491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026170f-415c-4321-96b6-f18919fcd0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:51.116013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026170f-415c-4321-96b6-f18919fcd0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:51.116315 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026170f-415c-4321-96b6-f18919fcd0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:51.116583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026170f-415c-4321-96b6-f18919fcd0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:51.127001 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026170f-415c-4321-96b6-f18919fcd0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:51.127707 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026170f-415c-4321-96b6-f18919fcd0c5 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:51.140136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1127/2248] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:51.584773 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08374f-e092-49cd-a14e-58548a580575 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:51.586350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8d08374f-e092-49cd-a14e-58548a580575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:51.601355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08374f-e092-49cd-a14e-58548a580575 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:51.606069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ef77d-9dce-4009-9a48-6c0847b8f050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:51.608812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ef77d-9dce-4009-9a48-6c0847b8f050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:51.608812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ef77d-9dce-4009-9a48-6c0847b8f050 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:51.608812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ef77d-9dce-4009-9a48-6c0847b8f050 admin admin] PATH_INFO: `/v3/projects/25b3e8c7753b43709c1c52aa96fbde87` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:51.608812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ef77d-9dce-4009-9a48-6c0847b8f050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b3e8c7753b43709c1c52aa96fbde87)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:51.610370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ef77d-9dce-4009-9a48-6c0847b8f050 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:51.754802 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-948ef77d-9dce-4009-9a48-6c0847b8f050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b3e8c7753b43709c1c52aa96fbde87', 'request_id': 'req-948ef77d-9dce-4009-9a48-6c0847b8f050'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:51.821801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-948ef77d-9dce-4009-9a48-6c0847b8f050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b3e8c7753b43709c1c52aa96fbde87', 'request_id': 'req-948ef77d-9dce-4009-9a48-6c0847b8f050'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:51.830113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-948ef77d-9dce-4009-9a48-6c0847b8f050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b3e8c7753b43709c1c52aa96fbde87', 'request_id': 'req-948ef77d-9dce-4009-9a48-6c0847b8f050'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:51.843078 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-948ef77d-9dce-4009-9a48-6c0847b8f050 admin admin] The token cache is being invalidate because project 25b3e8c7753b43709c1c52aa96fbde87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:51.843370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-948ef77d-9dce-4009-9a48-6c0847b8f050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:51.844079 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-948ef77d-9dce-4009-9a48-6c0847b8f050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:51.845650 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1122/2249] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:51 2022] DELETE /identity/v3/projects/25b3e8c7753b43709c1c52aa96fbde87 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:55.592232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026170f-415c-4321-96b6-f18919fcd0c5 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:55.593688 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9026170f-415c-4321-96b6-f18919fcd0c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:55.608347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026170f-415c-4321-96b6-f18919fcd0c5 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:55.667488 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a94ce-519c-4f54-aea9-461880a6dfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:55.668142 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a94ce-519c-4f54-aea9-461880a6dfa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:55.668426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a94ce-519c-4f54-aea9-461880a6dfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:55.668699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a94ce-519c-4f54-aea9-461880a6dfa6 admin admin] PATH_INFO: `/v3/users/dad66ede7a2f43f8bc0b69c699d25b9a` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:55.669810 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a94ce-519c-4f54-aea9-461880a6dfa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad66ede7a2f43f8bc0b69c699d25b9a)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:55.671778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a94ce-519c-4f54-aea9-461880a6dfa6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:55.900256 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3e3a94ce-519c-4f54-aea9-461880a6dfa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad66ede7a2f43f8bc0b69c699d25b9a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:55.900962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3e3a94ce-519c-4f54-aea9-461880a6dfa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad66ede7a2f43f8bc0b69c699d25b9a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:55.965146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3e3a94ce-519c-4f54-aea9-461880a6dfa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad66ede7a2f43f8bc0b69c699d25b9a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:55.969025 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3e3a94ce-519c-4f54-aea9-461880a6dfa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad66ede7a2f43f8bc0b69c699d25b9a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:55.983181 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-3e3a94ce-519c-4f54-aea9-461880a6dfa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad66ede7a2f43f8bc0b69c699d25b9a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:55.996972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1128/2250] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:55 2022] DELETE /identity/v3/users/dad66ede7a2f43f8bc0b69c699d25b9a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:56.001521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8840b-8afb-411b-9fdb-a5cfc6b2b3bf None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:56.002005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8840b-8afb-411b-9fdb-a5cfc6b2b3bf None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:56.002138 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8840b-8afb-411b-9fdb-a5cfc6b2b3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:56.020586 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-3ca8840b-8afb-411b-9fdb-a5cfc6b2b3bf None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:56.021826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3ca8840b-8afb-411b-9fdb-a5cfc6b2b3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:56.081982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1123/2251] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:56.095746 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a94ce-519c-4f54-aea9-461880a6dfa6 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:56.095746 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3e3a94ce-519c-4f54-aea9-461880a6dfa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:56.154450 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a94ce-519c-4f54-aea9-461880a6dfa6 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:56.158233 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b59b9a-bee4-4f3d-b4da-2bc4bcdb8cc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:56.159501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b59b9a-bee4-4f3d-b4da-2bc4bcdb8cc8 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:56.159780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b59b9a-bee4-4f3d-b4da-2bc4bcdb8cc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:56.160056 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b59b9a-bee4-4f3d-b4da-2bc4bcdb8cc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:56.169363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b59b9a-bee4-4f3d-b4da-2bc4bcdb8cc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:56.170879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b59b9a-bee4-4f3d-b4da-2bc4bcdb8cc8 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:56.180702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1129/2252] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:56.762112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8840b-8afb-411b-9fdb-a5cfc6b2b3bf None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:56.763689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3ca8840b-8afb-411b-9fdb-a5cfc6b2b3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:56.778212 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8840b-8afb-411b-9fdb-a5cfc6b2b3bf None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:56.783851 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e408d-392f-400b-a583-7588737919a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:56.784941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e408d-392f-400b-a583-7588737919a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:56.789166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e408d-392f-400b-a583-7588737919a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:56.789166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e408d-392f-400b-a583-7588737919a6 admin admin] PATH_INFO: `/v3/projects/31794ad38ab943d3bec92926e2134061` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:56.789166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e408d-392f-400b-a583-7588737919a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31794ad38ab943d3bec92926e2134061)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:56.789166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e408d-392f-400b-a583-7588737919a6 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:56.883306 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:56.892422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-617e408d-392f-400b-a583-7588737919a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31794ad38ab943d3bec92926e2134061', 'request_id': 'req-617e408d-392f-400b-a583-7588737919a6'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:56.954374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-617e408d-392f-400b-a583-7588737919a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31794ad38ab943d3bec92926e2134061', 'request_id': 'req-617e408d-392f-400b-a583-7588737919a6'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:56.960530 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-617e408d-392f-400b-a583-7588737919a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31794ad38ab943d3bec92926e2134061', 'request_id': 'req-617e408d-392f-400b-a583-7588737919a6'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:56.972477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-617e408d-392f-400b-a583-7588737919a6 admin admin] The token cache is being invalidate because project 31794ad38ab943d3bec92926e2134061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:56.972867 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-617e408d-392f-400b-a583-7588737919a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:56.975398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-617e408d-392f-400b-a583-7588737919a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:56.979926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1124/2253] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:56 2022] DELETE /identity/v3/projects/31794ad38ab943d3bec92926e2134061 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:56.982617 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90e5f4-e9df-4973-9fda-f06b9f6a2d20 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:56.982617 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90e5f4-e9df-4973-9fda-f06b9f6a2d20 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:56.983220 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90e5f4-e9df-4973-9fda-f06b9f6a2d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:56.993713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:57.008647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-db90e5f4-e9df-4973-9fda-f06b9f6a2d20 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:57.012972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-db90e5f4-e9df-4973-9fda-f06b9f6a2d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:57.135504 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1130/2254] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:57.144018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d0f54-db5e-4a0f-81ff-3c3e353e1dd4 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:57.144605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d0f54-db5e-4a0f-81ff-3c3e353e1dd4 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:57.145109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d0f54-db5e-4a0f-81ff-3c3e353e1dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:57.182117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-824d0f54-db5e-4a0f-81ff-3c3e353e1dd4 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:57.186360 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-824d0f54-db5e-4a0f-81ff-3c3e353e1dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:57.203563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1125/2255] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:57.207880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90e5f4-e9df-4973-9fda-f06b9f6a2d20 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:57.219778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90e5f4-e9df-4973-9fda-f06b9f6a2d20 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:57.238454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9241866-dd75-4fb5-9c24-eb4644da1f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:57.239110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9241866-dd75-4fb5-9c24-eb4644da1f1e admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:57.239399 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9241866-dd75-4fb5-9c24-eb4644da1f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:57.239684 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9241866-dd75-4fb5-9c24-eb4644da1f1e admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:57.240450 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9241866-dd75-4fb5-9c24-eb4644da1f1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:51:57.240764 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9241866-dd75-4fb5-9c24-eb4644da1f1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:57.243366 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9241866-dd75-4fb5-9c24-eb4644da1f1e admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:57.265301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1131/2256] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:51:57.266514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d0f54-db5e-4a0f-81ff-3c3e353e1dd4 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:57.277069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d0f54-db5e-4a0f-81ff-3c3e353e1dd4 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:57.282516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022dde5-fa24-4069-bacc-57b9b4e297c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:57.283307 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022dde5-fa24-4069-bacc-57b9b4e297c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:57.284284 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022dde5-fa24-4069-bacc-57b9b4e297c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:57.284736 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022dde5-fa24-4069-bacc-57b9b4e297c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:57.285423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022dde5-fa24-4069-bacc-57b9b4e297c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:57.287467 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022dde5-fa24-4069-bacc-57b9b4e297c9 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:57.384026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1126/2257] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:57 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:57.387583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9241866-dd75-4fb5-9c24-eb4644da1f1e admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:57.397584 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9241866-dd75-4fb5-9c24-eb4644da1f1e admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:57.453860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9248b-123e-40e6-a17b-70417525e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:57.454467 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9248b-123e-40e6-a17b-70417525e21f admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:57.454751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9248b-123e-40e6-a17b-70417525e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:57.455026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9248b-123e-40e6-a17b-70417525e21f admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:57.455664 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9248b-123e-40e6-a17b-70417525e21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:57.458249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9248b-123e-40e6-a17b-70417525e21f admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:57.545477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1132/2258] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:57 2022] POST /identity/v3/users => generated 284 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:57.550156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022dde5-fa24-4069-bacc-57b9b4e297c9 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:57.563856 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022dde5-fa24-4069-bacc-57b9b4e297c9 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:57.569826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d400928-900a-4609-8191-c345e1ddab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:57.570233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d400928-900a-4609-8191-c345e1ddab11 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:57.570576 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d400928-900a-4609-8191-c345e1ddab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:57.571084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d400928-900a-4609-8191-c345e1ddab11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:57.571750 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d400928-900a-4609-8191-c345e1ddab11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:57.573365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d400928-900a-4609-8191-c345e1ddab11 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:57.594154 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1127/2259] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:57.601870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9248b-123e-40e6-a17b-70417525e21f admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:57.610274 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9248b-123e-40e6-a17b-70417525e21f admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:57.615853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfef1a2-409e-4e16-a959-31807d762c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:57.616499 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfef1a2-409e-4e16-a959-31807d762c98 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:57.616779 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfef1a2-409e-4e16-a959-31807d762c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:57.617064 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfef1a2-409e-4e16-a959-31807d762c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:57.617710 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfef1a2-409e-4e16-a959-31807d762c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:57.619344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfef1a2-409e-4e16-a959-31807d762c98 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:57.630432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1133/2260] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:57.635396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d400928-900a-4609-8191-c345e1ddab11 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:57.647862 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d400928-900a-4609-8191-c345e1ddab11 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:57.652819 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747a1cd-0bfa-4290-bab9-b2da3c3695e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:57.653701 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747a1cd-0bfa-4290-bab9-b2da3c3695e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:57.654051 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747a1cd-0bfa-4290-bab9-b2da3c3695e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:57.654421 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747a1cd-0bfa-4290-bab9-b2da3c3695e0 admin admin] PATH_INFO: `/v3/projects/bdbd14e46f1147acba503e501b520118/users/0620a0bc2f354e61996e7888b9254dc4/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:57.672609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747a1cd-0bfa-4290-bab9-b2da3c3695e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdbd14e46f1147acba503e501b520118, user_id=0620a0bc2f354e61996e7888b9254dc4, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:57.675548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747a1cd-0bfa-4290-bab9-b2da3c3695e0 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:57.760463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1128/2261] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:57 2022] PUT /identity/v3/projects/bdbd14e46f1147acba503e501b520118/users/0620a0bc2f354e61996e7888b9254dc4/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:57.771237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b52a0-e1bd-4c83-8222-f4e1c3eff653 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:57.771599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b52a0-e1bd-4c83-8222-f4e1c3eff653 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:57.771988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b52a0-e1bd-4c83-8222-f4e1c3eff653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:57.802845 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-771b52a0-e1bd-4c83-8222-f4e1c3eff653 None None] MFA Rules not processed for user `0620a0bc2f354e61996e7888b9254dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:57.805110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-771b52a0-e1bd-4c83-8222-f4e1c3eff653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:57.875826 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1134/2262] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:57.887734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747a1cd-0bfa-4290-bab9-b2da3c3695e0 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:57.889425 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9747a1cd-0bfa-4290-bab9-b2da3c3695e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:57.951868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747a1cd-0bfa-4290-bab9-b2da3c3695e0 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:57.958619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb97c7-0a31-43a8-8a8a-4754bafc5519 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7d8a79945a4e73839cd2ad995e016b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:57.959280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb97c7-0a31-43a8-8a8a-4754bafc5519 service glance] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:57.959567 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb97c7-0a31-43a8-8a8a-4754bafc5519 service glance] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:57.959845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb97c7-0a31-43a8-8a8a-4754bafc5519 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:57.969334 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb97c7-0a31-43a8-8a8a-4754bafc5519 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:57.970787 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb97c7-0a31-43a8-8a8a-4754bafc5519 service glance] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:57.980308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1129/2263] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:58.067975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:58.199449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313bb57-f4b4-4d3c-a23a-e842e8b11f6c None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:58.199742 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313bb57-f4b4-4d3c-a23a-e842e8b11f6c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:58.200023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313bb57-f4b4-4d3c-a23a-e842e8b11f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:58.221706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-a313bb57-f4b4-4d3c-a23a-e842e8b11f6c None None] MFA Rules not processed for user `d4fbfe7d86aa42019a66868517eea7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:58.222925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a313bb57-f4b4-4d3c-a23a-e842e8b11f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:58.294577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1135/2264] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:51:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:02.792749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaf0d0-e5f5-4514-9119-10225c9cdf5d None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:02.793207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaf0d0-e5f5-4514-9119-10225c9cdf5d None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:02.793310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaf0d0-e5f5-4514-9119-10225c9cdf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:02.816965 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-eaeaf0d0-e5f5-4514-9119-10225c9cdf5d None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:02.818197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-eaeaf0d0-e5f5-4514-9119-10225c9cdf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:02.879460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1130/2265] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 29 22:52:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:02.983466 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313bb57-f4b4-4d3c-a23a-e842e8b11f6c None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:02.984233 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a313bb57-f4b4-4d3c-a23a-e842e8b11f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:03.082132 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313bb57-f4b4-4d3c-a23a-e842e8b11f6c None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:03.087531 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42096918-6ca7-4b3e-8ac1-dd87279708b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:03.088194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42096918-6ca7-4b3e-8ac1-dd87279708b5 service swift] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:03.088507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42096918-6ca7-4b3e-8ac1-dd87279708b5 service swift] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:03.088869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42096918-6ca7-4b3e-8ac1-dd87279708b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:03.098374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42096918-6ca7-4b3e-8ac1-dd87279708b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:03.099794 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42096918-6ca7-4b3e-8ac1-dd87279708b5 service swift] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:03.116442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1136/2266] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:52:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 22:52:03.384399 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaf0d0-e5f5-4514-9119-10225c9cdf5d None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:03.388698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-eaeaf0d0-e5f5-4514-9119-10225c9cdf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:03.400752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:03.490054 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaf0d0-e5f5-4514-9119-10225c9cdf5d None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:03.496272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29b580-eb53-47d7-b4ea-55d71d03f693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:03.496924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29b580-eb53-47d7-b4ea-55d71d03f693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:03.497389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29b580-eb53-47d7-b4ea-55d71d03f693 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:03.502724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29b580-eb53-47d7-b4ea-55d71d03f693 admin admin] PATH_INFO: `/v3/users/2d6f85d6b7444c9e93d49c3f40365c49` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:03.502724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29b580-eb53-47d7-b4ea-55d71d03f693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d6f85d6b7444c9e93d49c3f40365c49)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:03.502724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29b580-eb53-47d7-b4ea-55d71d03f693 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:03.680576 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ac29b580-eb53-47d7-b4ea-55d71d03f693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d6f85d6b7444c9e93d49c3f40365c49'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:03.699135 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ac29b580-eb53-47d7-b4ea-55d71d03f693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d6f85d6b7444c9e93d49c3f40365c49'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:03.770461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ac29b580-eb53-47d7-b4ea-55d71d03f693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d6f85d6b7444c9e93d49c3f40365c49'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:03.771404 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ac29b580-eb53-47d7-b4ea-55d71d03f693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d6f85d6b7444c9e93d49c3f40365c49'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:03.772107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ac29b580-eb53-47d7-b4ea-55d71d03f693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d6f85d6b7444c9e93d49c3f40365c49'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:03.792137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1131/2267] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:03 2022] DELETE /identity/v3/users/2d6f85d6b7444c9e93d49c3f40365c49 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:03.795535 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62bef1-328c-4a25-b08b-6c59eb5fbfcc None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:03.795998 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62bef1-328c-4a25-b08b-6c59eb5fbfcc None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:03.796462 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62bef1-328c-4a25-b08b-6c59eb5fbfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:03.830044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-fa62bef1-328c-4a25-b08b-6c59eb5fbfcc None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:03.831579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-fa62bef1-328c-4a25-b08b-6c59eb5fbfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:03.950806 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1137/2268] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:03.965292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29b580-eb53-47d7-b4ea-55d71d03f693 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:03.966900 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ac29b580-eb53-47d7-b4ea-55d71d03f693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:04.128784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29b580-eb53-47d7-b4ea-55d71d03f693 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:04.132876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ced463-2050-4f85-84de-e65c307eb4e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:04.133512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ced463-2050-4f85-84de-e65c307eb4e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:04.133789 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ced463-2050-4f85-84de-e65c307eb4e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:04.134061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ced463-2050-4f85-84de-e65c307eb4e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:04.144899 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ced463-2050-4f85-84de-e65c307eb4e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:04.146594 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ced463-2050-4f85-84de-e65c307eb4e3 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:04.162498 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1132/2269] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:04.739346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62bef1-328c-4a25-b08b-6c59eb5fbfcc None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:04.743242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-fa62bef1-328c-4a25-b08b-6c59eb5fbfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:04.769732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62bef1-328c-4a25-b08b-6c59eb5fbfcc None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:04.777278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa7953-372f-4a3c-8c97-1f5350cde543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:04.778140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa7953-372f-4a3c-8c97-1f5350cde543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:04.778860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa7953-372f-4a3c-8c97-1f5350cde543 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:04.779340 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa7953-372f-4a3c-8c97-1f5350cde543 admin admin] PATH_INFO: `/v3/projects/5aa95c2b0d494be5bf36f95b502c7d00` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:04.781140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa7953-372f-4a3c-8c97-1f5350cde543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa95c2b0d494be5bf36f95b502c7d00)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:04.784233 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa7953-372f-4a3c-8c97-1f5350cde543 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:04.877170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:04.900484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-dffa7953-372f-4a3c-8c97-1f5350cde543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa95c2b0d494be5bf36f95b502c7d00', 'request_id': 'req-dffa7953-372f-4a3c-8c97-1f5350cde543'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:04.909455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-dffa7953-372f-4a3c-8c97-1f5350cde543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa95c2b0d494be5bf36f95b502c7d00', 'request_id': 'req-dffa7953-372f-4a3c-8c97-1f5350cde543'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:04.988831 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-dffa7953-372f-4a3c-8c97-1f5350cde543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa95c2b0d494be5bf36f95b502c7d00', 'request_id': 'req-dffa7953-372f-4a3c-8c97-1f5350cde543'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:05.001745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-dffa7953-372f-4a3c-8c97-1f5350cde543 admin admin] The token cache is being invalidate because project 5aa95c2b0d494be5bf36f95b502c7d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:05.002135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-dffa7953-372f-4a3c-8c97-1f5350cde543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:05.003796 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-dffa7953-372f-4a3c-8c97-1f5350cde543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:05.010074 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1138/2270] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:04 2022] DELETE /identity/v3/projects/5aa95c2b0d494be5bf36f95b502c7d00 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:05.011427 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07025b-05b9-407a-8d89-b4dee90742af None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:05.011967 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07025b-05b9-407a-8d89-b4dee90742af None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:05.011967 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07025b-05b9-407a-8d89-b4dee90742af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:05.038571 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-9f07025b-05b9-407a-8d89-b4dee90742af None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:05.039914 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9f07025b-05b9-407a-8d89-b4dee90742af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:05.068930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:05.137428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1133/2271] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:05.143766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27bbf3-3d5e-4b54-8641-a4797c13b27c None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:05.144555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27bbf3-3d5e-4b54-8641-a4797c13b27c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:05.145009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27bbf3-3d5e-4b54-8641-a4797c13b27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:05.189695 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ac27bbf3-3d5e-4b54-8641-a4797c13b27c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:05.192762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ac27bbf3-3d5e-4b54-8641-a4797c13b27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:05.223848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1139/2272] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:05.227934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07025b-05b9-407a-8d89-b4dee90742af None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:05.249263 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07025b-05b9-407a-8d89-b4dee90742af None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:05.269332 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b41441-a876-44b4-bdd3-ed0074ec3d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:05.269962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b41441-a876-44b4-bdd3-ed0074ec3d8c admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:05.270244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b41441-a876-44b4-bdd3-ed0074ec3d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:05.270522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b41441-a876-44b4-bdd3-ed0074ec3d8c admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:05.271190 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b41441-a876-44b4-bdd3-ed0074ec3d8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:05.271945 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b41441-a876-44b4-bdd3-ed0074ec3d8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:05.273479 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b41441-a876-44b4-bdd3-ed0074ec3d8c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:05.312062 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1134/2273] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:52:05.320415 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27bbf3-3d5e-4b54-8641-a4797c13b27c None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:05.331123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27bbf3-3d5e-4b54-8641-a4797c13b27c None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:05.343822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9c13c-1a0c-40ee-bbbc-3523f76afc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:05.344487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c13c-1a0c-40ee-bbbc-3523f76afc54 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:05.344771 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c13c-1a0c-40ee-bbbc-3523f76afc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:05.345046 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c13c-1a0c-40ee-bbbc-3523f76afc54 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:05.345691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9c13c-1a0c-40ee-bbbc-3523f76afc54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:05.347822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9c13c-1a0c-40ee-bbbc-3523f76afc54 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:05.447464 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1140/2274] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:05 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:05.451688 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b41441-a876-44b4-bdd3-ed0074ec3d8c admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:05.475406 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b41441-a876-44b4-bdd3-ed0074ec3d8c admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:05.570164 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c73f8c-6d0e-4bf4-b9fa-e7d7a06363ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:05.571533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c73f8c-6d0e-4bf4-b9fa-e7d7a06363ce admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:05.573420 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c73f8c-6d0e-4bf4-b9fa-e7d7a06363ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:05.573829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c73f8c-6d0e-4bf4-b9fa-e7d7a06363ce admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:05.575905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c73f8c-6d0e-4bf4-b9fa-e7d7a06363ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:05.579477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c73f8c-6d0e-4bf4-b9fa-e7d7a06363ce admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:05.683093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1135/2275] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:05 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:05.687624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9c13c-1a0c-40ee-bbbc-3523f76afc54 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:05.707926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9c13c-1a0c-40ee-bbbc-3523f76afc54 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:05.717465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e471b6-83d2-4ab7-a74c-a99cd40f79a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:05.718322 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e471b6-83d2-4ab7-a74c-a99cd40f79a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:05.718609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e471b6-83d2-4ab7-a74c-a99cd40f79a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:05.718888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e471b6-83d2-4ab7-a74c-a99cd40f79a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:05.719555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e471b6-83d2-4ab7-a74c-a99cd40f79a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:05.721777 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e471b6-83d2-4ab7-a74c-a99cd40f79a1 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:05.744379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1141/2276] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:05.745038 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c73f8c-6d0e-4bf4-b9fa-e7d7a06363ce admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:05.760515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c73f8c-6d0e-4bf4-b9fa-e7d7a06363ce admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:05.773454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37653bc-6870-4bc2-b032-1e5853fbdfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:05.774075 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37653bc-6870-4bc2-b032-1e5853fbdfdf admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:05.774362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37653bc-6870-4bc2-b032-1e5853fbdfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:05.774675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37653bc-6870-4bc2-b032-1e5853fbdfdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:05.775343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37653bc-6870-4bc2-b032-1e5853fbdfdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:05.776995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37653bc-6870-4bc2-b032-1e5853fbdfdf admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:05.805012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1136/2277] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:05.808112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e471b6-83d2-4ab7-a74c-a99cd40f79a1 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:05.823394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e471b6-83d2-4ab7-a74c-a99cd40f79a1 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:05.826509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc18ff7-5464-41c3-a6a3-5124813121a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:05.827505 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc18ff7-5464-41c3-a6a3-5124813121a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:05.827933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc18ff7-5464-41c3-a6a3-5124813121a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:05.828395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc18ff7-5464-41c3-a6a3-5124813121a0 admin admin] PATH_INFO: `/v3/projects/d8bb83d3bc304eda9e6490d1d2cb501d/users/6e762e6e095148819279d742663659f2/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:05.850255 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc18ff7-5464-41c3-a6a3-5124813121a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8bb83d3bc304eda9e6490d1d2cb501d, user_id=6e762e6e095148819279d742663659f2, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:05.854863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc18ff7-5464-41c3-a6a3-5124813121a0 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:05.960213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1142/2278] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:05 2022] PUT /identity/v3/projects/d8bb83d3bc304eda9e6490d1d2cb501d/users/6e762e6e095148819279d742663659f2/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:05.962943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e141b5-40cb-4e47-a448-1a7419f1a5c0 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:05.962943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e141b5-40cb-4e47-a448-1a7419f1a5c0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:05.962943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e141b5-40cb-4e47-a448-1a7419f1a5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:05.992899 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-38e141b5-40cb-4e47-a448-1a7419f1a5c0 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:05.994852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-38e141b5-40cb-4e47-a448-1a7419f1a5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:06.099392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1137/2279] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:06.111108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc18ff7-5464-41c3-a6a3-5124813121a0 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:06.119178 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4dc18ff7-5464-41c3-a6a3-5124813121a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:06.213841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc18ff7-5464-41c3-a6a3-5124813121a0 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:06.216584 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449549a7-edf5-4be8-9864-71d51af7674a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:06.217540 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449549a7-edf5-4be8-9864-71d51af7674a service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:06.217540 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449549a7-edf5-4be8-9864-71d51af7674a service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:06.217758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449549a7-edf5-4be8-9864-71d51af7674a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:06.230659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449549a7-edf5-4be8-9864-71d51af7674a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:06.232324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449549a7-edf5-4be8-9864-71d51af7674a service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:06.246362 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1143/2280] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:08.735963 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7851f0-d34e-426b-8e72-f61720f121a4 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:08.736646 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7851f0-d34e-426b-8e72-f61720f121a4 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:08.736646 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7851f0-d34e-426b-8e72-f61720f121a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:08.788582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-0f7851f0-d34e-426b-8e72-f61720f121a4 None None] MFA Rules not processed for user `6e762e6e095148819279d742663659f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:08.790100 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-0f7851f0-d34e-426b-8e72-f61720f121a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:08.827321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:08.971171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1138/2281] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:52:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:08.993843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449549a7-edf5-4be8-9864-71d51af7674a service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:08.996568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-449549a7-edf5-4be8-9864-71d51af7674a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:09.088726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449549a7-edf5-4be8-9864-71d51af7674a service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:09.093408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5e1ae-adb8-43b7-9644-af162c1cbf8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:09.094055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5e1ae-adb8-43b7-9644-af162c1cbf8c service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:09.094339 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5e1ae-adb8-43b7-9644-af162c1cbf8c service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:09.094614 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5e1ae-adb8-43b7-9644-af162c1cbf8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:09.104757 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5e1ae-adb8-43b7-9644-af162c1cbf8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:09.106201 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5e1ae-adb8-43b7-9644-af162c1cbf8c service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:09.113260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:09.124671 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1144/2282] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:11.082116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a4d14-361f-421d-acce-526018e1e2d6 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:11.082704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a4d14-361f-421d-acce-526018e1e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:11.082915 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a4d14-361f-421d-acce-526018e1e2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:11.120656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-611a4d14-361f-421d-acce-526018e1e2d6 None None] MFA Rules not processed for user `6e762e6e095148819279d742663659f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:11.121882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-611a4d14-361f-421d-acce-526018e1e2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:11.129071 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1139/2283] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:52:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:12.685400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67e4e9-45c9-4782-8180-66356fbc1078 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:12.686352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67e4e9-45c9-4782-8180-66356fbc1078 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:12.686622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67e4e9-45c9-4782-8180-66356fbc1078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:12.708961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-bf67e4e9-45c9-4782-8180-66356fbc1078 None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:12.710231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-bf67e4e9-45c9-4782-8180-66356fbc1078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:12.796976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1145/2284] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 29 22:52:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:12.816181 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a4d14-361f-421d-acce-526018e1e2d6 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:12.820348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-611a4d14-361f-421d-acce-526018e1e2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:12.914354 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a4d14-361f-421d-acce-526018e1e2d6 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:12.920639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013e62f-e197-4ed4-b10a-ba5e8b076674 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:12.921643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013e62f-e197-4ed4-b10a-ba5e8b076674 service swift] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:12.926768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013e62f-e197-4ed4-b10a-ba5e8b076674 service swift] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:12.926768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013e62f-e197-4ed4-b10a-ba5e8b076674 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:12.932950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013e62f-e197-4ed4-b10a-ba5e8b076674 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:12.934898 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013e62f-e197-4ed4-b10a-ba5e8b076674 service swift] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:12.946482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1140/2285] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:52:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:52:22.792324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=26 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:22.940861 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=53 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:25.284072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd471e-788f-4b5e-9919-024d0737d806 None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.285163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd471e-788f-4b5e-9919-024d0737d806 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.285770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd471e-788f-4b5e-9919-024d0737d806 None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.287469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1146/2286] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 29 22:52:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:52:25.293933 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eaac2-0bea-4e1f-b046-116d70db80b5 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.294523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eaac2-0bea-4e1f-b046-116d70db80b5 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.294523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eaac2-0bea-4e1f-b046-116d70db80b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.333673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-037eaac2-0bea-4e1f-b046-116d70db80b5 None None] MFA Rules not processed for user `f06d910badb84c6aa6b48f3b56b91f82`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:25.335921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-037eaac2-0bea-4e1f-b046-116d70db80b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:25.448358 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1141/2287] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 29 22:52:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:25.460570 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd471e-788f-4b5e-9919-024d0737d806 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:25.464293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-95dd471e-788f-4b5e-9919-024d0737d806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:25.569085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd471e-788f-4b5e-9919-024d0737d806 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:25.572974 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef045df-4bf8-48c3-a6c7-c76c8dd3ad8b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7d8a79945a4e73839cd2ad995e016b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:25.573742 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef045df-4bf8-48c3-a6c7-c76c8dd3ad8b service glance] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.574214 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef045df-4bf8-48c3-a6c7-c76c8dd3ad8b service glance] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.574568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef045df-4bf8-48c3-a6c7-c76c8dd3ad8b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.586785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef045df-4bf8-48c3-a6c7-c76c8dd3ad8b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:25.588405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef045df-4bf8-48c3-a6c7-c76c8dd3ad8b service glance] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:25.601199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1147/2288] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:25.840778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1af8f5-1163-4b34-8500-3578daf1500b None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.841609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1af8f5-1163-4b34-8500-3578daf1500b None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.842093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1af8f5-1163-4b34-8500-3578daf1500b None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.843851 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1142/2289] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 29 22:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:52:25.850094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd65c7d-0d81-454e-8f07-0ccda4a862da None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.850393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd65c7d-0d81-454e-8f07-0ccda4a862da None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.850681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd65c7d-0d81-454e-8f07-0ccda4a862da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.881399 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-8fd65c7d-0d81-454e-8f07-0ccda4a862da None None] MFA Rules not processed for user `d8794e99a0024672974412ca4c045b63`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:25.884519 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8fd65c7d-0d81-454e-8f07-0ccda4a862da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:25.893101 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1148/2290] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 29 22:52:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:25.907120 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1af8f5-1163-4b34-8500-3578daf1500b None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:25.910644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1d1af8f5-1163-4b34-8500-3578daf1500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:25.926097 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1af8f5-1163-4b34-8500-3578daf1500b None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:25.930393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764332a5-6e98-463e-9d71-d6d71b5a4e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:25.930957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764332a5-6e98-463e-9d71-d6d71b5a4e95 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.931252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764332a5-6e98-463e-9d71-d6d71b5a4e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.931524 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764332a5-6e98-463e-9d71-d6d71b5a4e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.939579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764332a5-6e98-463e-9d71-d6d71b5a4e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:25.941110 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764332a5-6e98-463e-9d71-d6d71b5a4e95 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:25.949567 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1143/2291] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:26.085121 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc70ff-13a0-4eb9-9f0d-a80465fd352c None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:26.086928 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc70ff-13a0-4eb9-9f0d-a80465fd352c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:26.088245 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc70ff-13a0-4eb9-9f0d-a80465fd352c None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:26.091828 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1149/2292] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 29 22:52:26 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:52:26.100120 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77535007-fa8d-4c08-9a52-684a0d54fd90 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:26.100522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77535007-fa8d-4c08-9a52-684a0d54fd90 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:26.100814 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77535007-fa8d-4c08-9a52-684a0d54fd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:26.125899 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-77535007-fa8d-4c08-9a52-684a0d54fd90 None None] MFA Rules not processed for user `f06d910badb84c6aa6b48f3b56b91f82`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:26.127230 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-77535007-fa8d-4c08-9a52-684a0d54fd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:26.141493 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1144/2293] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 29 22:52:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:26.163223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc70ff-13a0-4eb9-9f0d-a80465fd352c None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:26.188811 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc70ff-13a0-4eb9-9f0d-a80465fd352c None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:26.195751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acee782-4a20-4026-ac1d-7cee358f486e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:26.196539 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acee782-4a20-4026-ac1d-7cee358f486e service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:26.196921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acee782-4a20-4026-ac1d-7cee358f486e service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:26.197309 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acee782-4a20-4026-ac1d-7cee358f486e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:26.212237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acee782-4a20-4026-ac1d-7cee358f486e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:26.214053 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acee782-4a20-4026-ac1d-7cee358f486e service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:26.228857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1150/2294] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:27.861294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77535007-fa8d-4c08-9a52-684a0d54fd90 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:27.861849 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-77535007-fa8d-4c08-9a52-684a0d54fd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:27.883332 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77535007-fa8d-4c08-9a52-684a0d54fd90 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:27.888796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af016ee5-c3e3-481f-b098-a9d2c37fd434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:27.889092 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af016ee5-c3e3-481f-b098-a9d2c37fd434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:27.889308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af016ee5-c3e3-481f-b098-a9d2c37fd434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:27.889589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af016ee5-c3e3-481f-b098-a9d2c37fd434 admin admin] PATH_INFO: `/v3/users/0620a0bc2f354e61996e7888b9254dc4` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:27.890829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af016ee5-c3e3-481f-b098-a9d2c37fd434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0620a0bc2f354e61996e7888b9254dc4)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:27.899146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af016ee5-c3e3-481f-b098-a9d2c37fd434 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:28.122777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-af016ee5-c3e3-481f-b098-a9d2c37fd434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0620a0bc2f354e61996e7888b9254dc4'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:28.140141 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-af016ee5-c3e3-481f-b098-a9d2c37fd434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0620a0bc2f354e61996e7888b9254dc4'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:28.215672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-af016ee5-c3e3-481f-b098-a9d2c37fd434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0620a0bc2f354e61996e7888b9254dc4'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:28.216357 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-af016ee5-c3e3-481f-b098-a9d2c37fd434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0620a0bc2f354e61996e7888b9254dc4'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:28.217068 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-af016ee5-c3e3-481f-b098-a9d2c37fd434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0620a0bc2f354e61996e7888b9254dc4'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:28.236730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1145/2295] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:27 2022] DELETE /identity/v3/users/0620a0bc2f354e61996e7888b9254dc4 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:28.241189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a04763-48da-4fc3-96a1-bee90a6e9897 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:28.241689 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a04763-48da-4fc3-96a1-bee90a6e9897 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:28.243829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a04763-48da-4fc3-96a1-bee90a6e9897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:28.269964 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-b6a04763-48da-4fc3-96a1-bee90a6e9897 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:28.276228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b6a04763-48da-4fc3-96a1-bee90a6e9897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:28.377736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1151/2296] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:28.384499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af016ee5-c3e3-481f-b098-a9d2c37fd434 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:28.386263 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-af016ee5-c3e3-481f-b098-a9d2c37fd434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:28.478372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:28.497735 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af016ee5-c3e3-481f-b098-a9d2c37fd434 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:28.503115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a907c8-d679-4f3b-b2da-a60c1b59ab1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:28.504067 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a907c8-d679-4f3b-b2da-a60c1b59ab1c service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:28.504603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a907c8-d679-4f3b-b2da-a60c1b59ab1c service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:28.505235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a907c8-d679-4f3b-b2da-a60c1b59ab1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:28.520455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a907c8-d679-4f3b-b2da-a60c1b59ab1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:28.522266 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a907c8-d679-4f3b-b2da-a60c1b59ab1c service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:28.547602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1146/2297] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:29.049745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a04763-48da-4fc3-96a1-bee90a6e9897 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:29.052915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b6a04763-48da-4fc3-96a1-bee90a6e9897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:29.081633 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a04763-48da-4fc3-96a1-bee90a6e9897 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:29.090967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab0dda-a155-4342-b47a-8313ed05d02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:29.091704 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab0dda-a155-4342-b47a-8313ed05d02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:29.092058 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab0dda-a155-4342-b47a-8313ed05d02d admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:29.092448 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab0dda-a155-4342-b47a-8313ed05d02d admin admin] PATH_INFO: `/v3/projects/bdbd14e46f1147acba503e501b520118` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:29.096457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab0dda-a155-4342-b47a-8313ed05d02d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdbd14e46f1147acba503e501b520118)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:29.098765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab0dda-a155-4342-b47a-8313ed05d02d admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:29.281514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1eab0dda-a155-4342-b47a-8313ed05d02d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdbd14e46f1147acba503e501b520118', 'request_id': 'req-1eab0dda-a155-4342-b47a-8313ed05d02d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:29.291436 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1eab0dda-a155-4342-b47a-8313ed05d02d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdbd14e46f1147acba503e501b520118', 'request_id': 'req-1eab0dda-a155-4342-b47a-8313ed05d02d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:29.358544 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1eab0dda-a155-4342-b47a-8313ed05d02d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdbd14e46f1147acba503e501b520118', 'request_id': 'req-1eab0dda-a155-4342-b47a-8313ed05d02d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:29.373783 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1eab0dda-a155-4342-b47a-8313ed05d02d admin admin] The token cache is being invalidate because project bdbd14e46f1147acba503e501b520118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:29.374110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1eab0dda-a155-4342-b47a-8313ed05d02d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:29.374944 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1eab0dda-a155-4342-b47a-8313ed05d02d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:29.377506 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1152/2298] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:29 2022] DELETE /identity/v3/projects/bdbd14e46f1147acba503e501b520118 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:29.382717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d3108-e3e2-44df-a2a8-197ca9afb81f None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:29.383184 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d3108-e3e2-44df-a2a8-197ca9afb81f None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:29.383369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d3108-e3e2-44df-a2a8-197ca9afb81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:29.403954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-799d3108-e3e2-44df-a2a8-197ca9afb81f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:29.405249 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-799d3108-e3e2-44df-a2a8-197ca9afb81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:29.474630 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1147/2299] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:29.483222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82c7f9-ff2a-4150-a5c6-db8a8ca551df None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:29.484838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82c7f9-ff2a-4150-a5c6-db8a8ca551df None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:29.484838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82c7f9-ff2a-4150-a5c6-db8a8ca551df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:29.502683 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:29.511844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-cb82c7f9-ff2a-4150-a5c6-db8a8ca551df None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:29.513305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-cb82c7f9-ff2a-4150-a5c6-db8a8ca551df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:29.521980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1153/2300] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:29.527227 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d3108-e3e2-44df-a2a8-197ca9afb81f None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:29.546875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d3108-e3e2-44df-a2a8-197ca9afb81f None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:29.552646 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e27ffe-2661-4c49-a7fd-fe532eb8cc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:29.553778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e27ffe-2661-4c49-a7fd-fe532eb8cc85 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:29.554236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e27ffe-2661-4c49-a7fd-fe532eb8cc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:29.554509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e27ffe-2661-4c49-a7fd-fe532eb8cc85 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:29.555163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e27ffe-2661-4c49-a7fd-fe532eb8cc85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:29.555467 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e27ffe-2661-4c49-a7fd-fe532eb8cc85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:29.557081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e27ffe-2661-4c49-a7fd-fe532eb8cc85 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:29.577970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1148/2301] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:52:29.583069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82c7f9-ff2a-4150-a5c6-db8a8ca551df None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:29.598280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82c7f9-ff2a-4150-a5c6-db8a8ca551df None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:29.614187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97a3a9-303a-4853-a0bb-dded89213d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:29.614926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97a3a9-303a-4853-a0bb-dded89213d07 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:29.615226 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97a3a9-303a-4853-a0bb-dded89213d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:29.615491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97a3a9-303a-4853-a0bb-dded89213d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:29.616163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97a3a9-303a-4853-a0bb-dded89213d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:29.618439 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97a3a9-303a-4853-a0bb-dded89213d07 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:29.709418 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1154/2302] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:29 2022] POST /identity/v3/projects => generated 399 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:29.710019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e27ffe-2661-4c49-a7fd-fe532eb8cc85 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:29.727678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e27ffe-2661-4c49-a7fd-fe532eb8cc85 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:29.797167 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068d899-8d6e-471e-84fb-3f03f3e9f6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:29.797703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068d899-8d6e-471e-84fb-3f03f3e9f6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:29.798107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068d899-8d6e-471e-84fb-3f03f3e9f6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:29.798432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068d899-8d6e-471e-84fb-3f03f3e9f6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:29.799341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068d899-8d6e-471e-84fb-3f03f3e9f6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:29.801332 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068d899-8d6e-471e-84fb-3f03f3e9f6b6 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:29.888382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1149/2303] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:29 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:29.891460 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97a3a9-303a-4853-a0bb-dded89213d07 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:29.909024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97a3a9-303a-4853-a0bb-dded89213d07 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:29.917068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b170a-3c99-42b2-bd4e-41a79966b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:29.917705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b170a-3c99-42b2-bd4e-41a79966b37e admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:29.917989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b170a-3c99-42b2-bd4e-41a79966b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:29.918264 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b170a-3c99-42b2-bd4e-41a79966b37e admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:29.918931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b170a-3c99-42b2-bd4e-41a79966b37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:29.921286 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b170a-3c99-42b2-bd4e-41a79966b37e admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:29.937828 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1155/2304] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:29.939915 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068d899-8d6e-471e-84fb-3f03f3e9f6b6 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:29.970516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068d899-8d6e-471e-84fb-3f03f3e9f6b6 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:29.976208 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6fbfd-1b2d-4123-ab8c-e06150a0b560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:29.976830 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6fbfd-1b2d-4123-ab8c-e06150a0b560 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:29.977115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6fbfd-1b2d-4123-ab8c-e06150a0b560 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:29.977392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6fbfd-1b2d-4123-ab8c-e06150a0b560 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:29.978099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6fbfd-1b2d-4123-ab8c-e06150a0b560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:29.979859 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6fbfd-1b2d-4123-ab8c-e06150a0b560 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:29.997417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1150/2305] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:30.003079 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b170a-3c99-42b2-bd4e-41a79966b37e admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:30.014237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b170a-3c99-42b2-bd4e-41a79966b37e admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:30.023987 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f2bdf-7f57-4461-8fde-24816c3286c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:30.024712 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f2bdf-7f57-4461-8fde-24816c3286c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:30.024996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f2bdf-7f57-4461-8fde-24816c3286c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:30.025276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f2bdf-7f57-4461-8fde-24816c3286c5 admin admin] PATH_INFO: `/v3/projects/b2a0d8faaa5940199a10ccb52d73eed3/users/1cf0240349ea4e5a8337a81e8e2510bf/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:30.055157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f2bdf-7f57-4461-8fde-24816c3286c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a0d8faaa5940199a10ccb52d73eed3, user_id=1cf0240349ea4e5a8337a81e8e2510bf, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:30.057981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f2bdf-7f57-4461-8fde-24816c3286c5 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:30.172405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1156/2306] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:29 2022] PUT /identity/v3/projects/b2a0d8faaa5940199a10ccb52d73eed3/users/1cf0240349ea4e5a8337a81e8e2510bf/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:30.191084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7558d4d-d929-4706-9331-cacd294c132c None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:30.191654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7558d4d-d929-4706-9331-cacd294c132c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:30.191943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7558d4d-d929-4706-9331-cacd294c132c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:30.222331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-a7558d4d-d929-4706-9331-cacd294c132c None None] MFA Rules not processed for user `1cf0240349ea4e5a8337a81e8e2510bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:30.223550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a7558d4d-d929-4706-9331-cacd294c132c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:30.270450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:30.295681 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1151/2307] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:52:30 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:30.311024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f2bdf-7f57-4461-8fde-24816c3286c5 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:30.319296 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-bc0f2bdf-7f57-4461-8fde-24816c3286c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:30.405946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f2bdf-7f57-4461-8fde-24816c3286c5 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:30.422105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c30d7-664d-483c-b8d5-e7a4b3830d31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:30.422596 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c30d7-664d-483c-b8d5-e7a4b3830d31 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:30.422945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c30d7-664d-483c-b8d5-e7a4b3830d31 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:30.423351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c30d7-664d-483c-b8d5-e7a4b3830d31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:30.439350 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c30d7-664d-483c-b8d5-e7a4b3830d31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:30.441498 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c30d7-664d-483c-b8d5-e7a4b3830d31 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:30.466180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1157/2308] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:30 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:31.747907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84553f3f-eaf2-4b0a-9e4e-cd6e97653464 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:31.748507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84553f3f-eaf2-4b0a-9e4e-cd6e97653464 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:31.748855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84553f3f-eaf2-4b0a-9e4e-cd6e97653464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:31.772415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-84553f3f-eaf2-4b0a-9e4e-cd6e97653464 None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:31.773745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-84553f3f-eaf2-4b0a-9e4e-cd6e97653464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:31.833909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1152/2309] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 29 22:52:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:31.845963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c30d7-664d-483c-b8d5-e7a4b3830d31 service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:31.847383 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-734c30d7-664d-483c-b8d5-e7a4b3830d31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:31.916533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c30d7-664d-483c-b8d5-e7a4b3830d31 service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:31.921402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90add10-2663-48ca-815e-ee0568664174 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:31.921997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90add10-2663-48ca-815e-ee0568664174 service swift] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:31.922274 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90add10-2663-48ca-815e-ee0568664174 service swift] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:31.922545 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90add10-2663-48ca-815e-ee0568664174 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:31.930798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90add10-2663-48ca-815e-ee0568664174 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:31.932433 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90add10-2663-48ca-815e-ee0568664174 service swift] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:31.940962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1158/2310] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:52:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:52:32.201827 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25704db7-e733-4c86-981e-a4e56a6eadae None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:32.202213 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25704db7-e733-4c86-981e-a4e56a6eadae None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:32.202554 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25704db7-e733-4c86-981e-a4e56a6eadae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:32.229723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-25704db7-e733-4c86-981e-a4e56a6eadae None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:32.231197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-25704db7-e733-4c86-981e-a4e56a6eadae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:32.248260 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1153/2311] 10.222.0.62 () {58 vars in 967 bytes} [Mon Aug 29 22:52:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:32.259262 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90add10-2663-48ca-815e-ee0568664174 service swift] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:32.276585 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90add10-2663-48ca-815e-ee0568664174 service swift] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:32.283954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620b6d7-e3ff-46c9-9838-6679fb96a181 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:32.285009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620b6d7-e3ff-46c9-9838-6679fb96a181 service swift] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:32.285508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620b6d7-e3ff-46c9-9838-6679fb96a181 service swift] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:32.286070 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620b6d7-e3ff-46c9-9838-6679fb96a181 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:32.297239 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620b6d7-e3ff-46c9-9838-6679fb96a181 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:32.300609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620b6d7-e3ff-46c9-9838-6679fb96a181 service swift] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:32.313958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1159/2312] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:52:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:52:36.687872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25704db7-e733-4c86-981e-a4e56a6eadae None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:36.691449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-25704db7-e733-4c86-981e-a4e56a6eadae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:36.759576 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25704db7-e733-4c86-981e-a4e56a6eadae None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:36.764111 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad07dc-215d-4535-a2a2-180e7be3ab0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:36.764746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad07dc-215d-4535-a2a2-180e7be3ab0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:36.766402 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad07dc-215d-4535-a2a2-180e7be3ab0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:36.766402 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad07dc-215d-4535-a2a2-180e7be3ab0a admin admin] PATH_INFO: `/v3/users/4f38e10fa3a944118990c0f408757dff` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:36.766402 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad07dc-215d-4535-a2a2-180e7be3ab0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f38e10fa3a944118990c0f408757dff)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:36.769084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad07dc-215d-4535-a2a2-180e7be3ab0a admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:36.951829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0bad07dc-215d-4535-a2a2-180e7be3ab0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f38e10fa3a944118990c0f408757dff'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.977866 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0bad07dc-215d-4535-a2a2-180e7be3ab0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f38e10fa3a944118990c0f408757dff'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.050697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0bad07dc-215d-4535-a2a2-180e7be3ab0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f38e10fa3a944118990c0f408757dff'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.051316 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0bad07dc-215d-4535-a2a2-180e7be3ab0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f38e10fa3a944118990c0f408757dff'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.051934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-0bad07dc-215d-4535-a2a2-180e7be3ab0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f38e10fa3a944118990c0f408757dff'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.061655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:37.066973 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1154/2313] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:36 2022] DELETE /identity/v3/users/4f38e10fa3a944118990c0f408757dff => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:37.349188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620b6d7-e3ff-46c9-9838-6679fb96a181 service swift] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.361009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620b6d7-e3ff-46c9-9838-6679fb96a181 service swift] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.385256 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:37.442400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e7d9a-3f81-475f-b3de-7b58a9483f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.443188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e7d9a-3f81-475f-b3de-7b58a9483f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.443452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e7d9a-3f81-475f-b3de-7b58a9483f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.443676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e7d9a-3f81-475f-b3de-7b58a9483f78 admin admin] PATH_INFO: `/v3/projects/a0211c04c2464c678916b8f7458cd343` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.445033 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e7d9a-3f81-475f-b3de-7b58a9483f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0211c04c2464c678916b8f7458cd343)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.447182 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e7d9a-3f81-475f-b3de-7b58a9483f78 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.542787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-838e7d9a-3f81-475f-b3de-7b58a9483f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0211c04c2464c678916b8f7458cd343', 'request_id': 'req-838e7d9a-3f81-475f-b3de-7b58a9483f78'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.549917 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-838e7d9a-3f81-475f-b3de-7b58a9483f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0211c04c2464c678916b8f7458cd343', 'request_id': 'req-838e7d9a-3f81-475f-b3de-7b58a9483f78'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.603121 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad07dc-215d-4535-a2a2-180e7be3ab0a admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.604954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-0bad07dc-215d-4535-a2a2-180e7be3ab0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:37.623758 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad07dc-215d-4535-a2a2-180e7be3ab0a admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.625576 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-838e7d9a-3f81-475f-b3de-7b58a9483f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0211c04c2464c678916b8f7458cd343', 'request_id': 'req-838e7d9a-3f81-475f-b3de-7b58a9483f78'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.658906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-838e7d9a-3f81-475f-b3de-7b58a9483f78 admin admin] The token cache is being invalidate because project a0211c04c2464c678916b8f7458cd343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:37.658906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-838e7d9a-3f81-475f-b3de-7b58a9483f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.659872 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-838e7d9a-3f81-475f-b3de-7b58a9483f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.663158 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1160/2314] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:37 2022] DELETE /identity/v3/projects/a0211c04c2464c678916b8f7458cd343 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:37.671249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e4a6d-f032-44cc-97c3-6e61377c4ac1 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.671531 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e4a6d-f032-44cc-97c3-6e61377c4ac1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.671809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e4a6d-f032-44cc-97c3-6e61377c4ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.697275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-1a9e4a6d-f032-44cc-97c3-6e61377c4ac1 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:37.703626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-1a9e4a6d-f032-44cc-97c3-6e61377c4ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:37.703781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d502d2d-2f37-4f92-b44d-237d83b20ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.703781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d502d2d-2f37-4f92-b44d-237d83b20ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.703781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d502d2d-2f37-4f92-b44d-237d83b20ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.703781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d502d2d-2f37-4f92-b44d-237d83b20ed6 admin admin] PATH_INFO: `/v3/users/1cf0240349ea4e5a8337a81e8e2510bf` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.704569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d502d2d-2f37-4f92-b44d-237d83b20ed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf0240349ea4e5a8337a81e8e2510bf)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.704569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d502d2d-2f37-4f92-b44d-237d83b20ed6 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.714356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1161/2315] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:37.722871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e31003-c8cc-4fb1-bfe2-d6813f2675a6 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.723279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e31003-c8cc-4fb1-bfe2-d6813f2675a6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.723656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e31003-c8cc-4fb1-bfe2-d6813f2675a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.746942 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-73e31003-c8cc-4fb1-bfe2-d6813f2675a6 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:37.748534 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-73e31003-c8cc-4fb1-bfe2-d6813f2675a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:37.759092 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1162/2316] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:37.763475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e31003-c8cc-4fb1-bfe2-d6813f2675a6 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.774822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e31003-c8cc-4fb1-bfe2-d6813f2675a6 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.780144 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e31102-6f87-4176-bacc-e3d148848063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.780753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e31102-6f87-4176-bacc-e3d148848063 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.781236 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e31102-6f87-4176-bacc-e3d148848063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.781587 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e31102-6f87-4176-bacc-e3d148848063 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.782335 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e31102-6f87-4176-bacc-e3d148848063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:37.782720 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e31102-6f87-4176-bacc-e3d148848063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.785331 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e31102-6f87-4176-bacc-e3d148848063 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.798232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1163/2317] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:52:37.803157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e31102-6f87-4176-bacc-e3d148848063 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.813219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e31102-6f87-4176-bacc-e3d148848063 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.818280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b23fb-e176-45f1-882b-9b2286500527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.818932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b23fb-e176-45f1-882b-9b2286500527 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.819314 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b23fb-e176-45f1-882b-9b2286500527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.819678 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b23fb-e176-45f1-882b-9b2286500527 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.820502 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b23fb-e176-45f1-882b-9b2286500527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.825416 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b23fb-e176-45f1-882b-9b2286500527 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.897902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1164/2318] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:37.901940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b23fb-e176-45f1-882b-9b2286500527 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.941934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-4d502d2d-2f37-4f92-b44d-237d83b20ed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf0240349ea4e5a8337a81e8e2510bf'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.957288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-4d502d2d-2f37-4f92-b44d-237d83b20ed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf0240349ea4e5a8337a81e8e2510bf'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.976700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b23fb-e176-45f1-882b-9b2286500527 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.981556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef48c3-fd96-4c8b-9f45-e9d57f8536ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.982161 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef48c3-fd96-4c8b-9f45-e9d57f8536ea admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.982446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef48c3-fd96-4c8b-9f45-e9d57f8536ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.982719 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef48c3-fd96-4c8b-9f45-e9d57f8536ea admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.983347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef48c3-fd96-4c8b-9f45-e9d57f8536ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.985300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef48c3-fd96-4c8b-9f45-e9d57f8536ea admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.996067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:38.026995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-4d502d2d-2f37-4f92-b44d-237d83b20ed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf0240349ea4e5a8337a81e8e2510bf'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:38.027683 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-4d502d2d-2f37-4f92-b44d-237d83b20ed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf0240349ea4e5a8337a81e8e2510bf'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:38.028334 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-4d502d2d-2f37-4f92-b44d-237d83b20ed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf0240349ea4e5a8337a81e8e2510bf'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:38.042623 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1155/2319] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:37 2022] DELETE /identity/v3/users/1cf0240349ea4e5a8337a81e8e2510bf => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:38.047125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6d501-fc17-44fb-a080-c423ff80f12c None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.047485 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6d501-fc17-44fb-a080-c423ff80f12c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.047846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6d501-fc17-44fb-a080-c423ff80f12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.062956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1165/2320] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:38.063910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef48c3-fd96-4c8b-9f45-e9d57f8536ea admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:38.065682 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-71ef48c3-fd96-4c8b-9f45-e9d57f8536ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:38.072046 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-8ee6d501-fc17-44fb-a080-c423ff80f12c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:38.073276 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8ee6d501-fc17-44fb-a080-c423ff80f12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:38.090068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef48c3-fd96-4c8b-9f45-e9d57f8536ea admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:38.138385 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1156/2321] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:38.148700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6d501-fc17-44fb-a080-c423ff80f12c None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:38.150036 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8ee6d501-fc17-44fb-a080-c423ff80f12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:38.153866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8c838-6545-4d35-9841-dd9ec9007714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:38.154646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8c838-6545-4d35-9841-dd9ec9007714 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.155118 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8c838-6545-4d35-9841-dd9ec9007714 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.161633 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8c838-6545-4d35-9841-dd9ec9007714 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.161633 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8c838-6545-4d35-9841-dd9ec9007714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:38.161633 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8c838-6545-4d35-9841-dd9ec9007714 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:38.178906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1166/2322] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:52:38.180011 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8c838-6545-4d35-9841-dd9ec9007714 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:38.191577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8c838-6545-4d35-9841-dd9ec9007714 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:38.198147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b63ace-3764-4154-8dfa-34540c3f67fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:38.201345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:38.202807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b63ace-3764-4154-8dfa-34540c3f67fd admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.203205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b63ace-3764-4154-8dfa-34540c3f67fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.203840 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b63ace-3764-4154-8dfa-34540c3f67fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.204636 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b63ace-3764-4154-8dfa-34540c3f67fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:38.206876 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b63ace-3764-4154-8dfa-34540c3f67fd admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:38.222034 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1167/2323] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:38.225778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b63ace-3764-4154-8dfa-34540c3f67fd admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:38.237501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b63ace-3764-4154-8dfa-34540c3f67fd admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:38.245358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb02a3-4692-4070-9750-e5f71fd3e4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:38.246333 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb02a3-4692-4070-9750-e5f71fd3e4c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.246863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb02a3-4692-4070-9750-e5f71fd3e4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.247137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb02a3-4692-4070-9750-e5f71fd3e4c7 admin admin] PATH_INFO: `/v3/projects/d84ba82278354f8aa81cf9f9e69757ff/users/c1fa807bd42c41289855b68255f89b44/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.255857 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6d501-fc17-44fb-a080-c423ff80f12c None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:38.260861 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904685b2-a83a-4607-bce1-1d58c2051faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:38.261680 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904685b2-a83a-4607-bce1-1d58c2051faf service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.262061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904685b2-a83a-4607-bce1-1d58c2051faf service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.262449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904685b2-a83a-4607-bce1-1d58c2051faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.269371 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb02a3-4692-4070-9750-e5f71fd3e4c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84ba82278354f8aa81cf9f9e69757ff, user_id=c1fa807bd42c41289855b68255f89b44, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:38.272340 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb02a3-4692-4070-9750-e5f71fd3e4c7 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:38.280494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904685b2-a83a-4607-bce1-1d58c2051faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:38.281951 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904685b2-a83a-4607-bce1-1d58c2051faf service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:38.292698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1157/2324] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:52:38.358956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1168/2325] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:38 2022] PUT /identity/v3/projects/d84ba82278354f8aa81cf9f9e69757ff/users/c1fa807bd42c41289855b68255f89b44/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:38.369462 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb52a60-4163-4543-bb8c-59ed56224cd0 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.369768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb52a60-4163-4543-bb8c-59ed56224cd0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.370046 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb52a60-4163-4543-bb8c-59ed56224cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.398948 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-1bb52a60-4163-4543-bb8c-59ed56224cd0 None None] MFA Rules not processed for user `c1fa807bd42c41289855b68255f89b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:38.400109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1bb52a60-4163-4543-bb8c-59ed56224cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:38.470509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1158/2326] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:52:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:38.486163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb02a3-4692-4070-9750-e5f71fd3e4c7 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:38.487963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-37bb02a3-4692-4070-9750-e5f71fd3e4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:38.570545 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb02a3-4692-4070-9750-e5f71fd3e4c7 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:38.575800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d6171-783a-41db-ad45-5a12cdcdcbf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:38.575800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d6171-783a-41db-ad45-5a12cdcdcbf3 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.575800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d6171-783a-41db-ad45-5a12cdcdcbf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.576243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d6171-783a-41db-ad45-5a12cdcdcbf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.596251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d6171-783a-41db-ad45-5a12cdcdcbf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:38.598278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d6171-783a-41db-ad45-5a12cdcdcbf3 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:38.610134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1169/2327] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:38.781463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb52a60-4163-4543-bb8c-59ed56224cd0 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:38.781463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1bb52a60-4163-4543-bb8c-59ed56224cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:38.885751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb52a60-4163-4543-bb8c-59ed56224cd0 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:38.892080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446288e-4268-4bb3-929a-d622d63f5b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:38.892785 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446288e-4268-4bb3-929a-d622d63f5b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.893067 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446288e-4268-4bb3-929a-d622d63f5b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.893343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446288e-4268-4bb3-929a-d622d63f5b12 admin admin] PATH_INFO: `/v3/projects/b2a0d8faaa5940199a10ccb52d73eed3` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.894516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446288e-4268-4bb3-929a-d622d63f5b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a0d8faaa5940199a10ccb52d73eed3)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:38.896579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446288e-4268-4bb3-929a-d622d63f5b12 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:39.035654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-8446288e-4268-4bb3-929a-d622d63f5b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a0d8faaa5940199a10ccb52d73eed3', 'request_id': 'req-8446288e-4268-4bb3-929a-d622d63f5b12'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.042164 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:39.130385 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-8446288e-4268-4bb3-929a-d622d63f5b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a0d8faaa5940199a10ccb52d73eed3', 'request_id': 'req-8446288e-4268-4bb3-929a-d622d63f5b12'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.140653 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-8446288e-4268-4bb3-929a-d622d63f5b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a0d8faaa5940199a10ccb52d73eed3', 'request_id': 'req-8446288e-4268-4bb3-929a-d622d63f5b12'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.161414 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-8446288e-4268-4bb3-929a-d622d63f5b12 admin admin] The token cache is being invalidate because project b2a0d8faaa5940199a10ccb52d73eed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:39.161876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-8446288e-4268-4bb3-929a-d622d63f5b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.162623 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-8446288e-4268-4bb3-929a-d622d63f5b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.164463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1159/2328] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:38 2022] DELETE /identity/v3/projects/b2a0d8faaa5940199a10ccb52d73eed3 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:40.466032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e7842-5ff2-4cd4-9efb-f8d56343ed14 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.466580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e7842-5ff2-4cd4-9efb-f8d56343ed14 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.466580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e7842-5ff2-4cd4-9efb-f8d56343ed14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.486202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-f84e7842-5ff2-4cd4-9efb-f8d56343ed14 None None] MFA Rules not processed for user `c1fa807bd42c41289855b68255f89b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:40.487437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f84e7842-5ff2-4cd4-9efb-f8d56343ed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:40.545054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1170/2329] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:52:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:47.045951 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446288e-4268-4bb3-929a-d622d63f5b12 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:47.047421 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8446288e-4268-4bb3-929a-d622d63f5b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:47.117502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446288e-4268-4bb3-929a-d622d63f5b12 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:47.122322 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb4c5f-e61e-43e0-be80-501e66bd236e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2991c613878e4993901199434f384f49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:47.123016 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4c5f-e61e-43e0-be80-501e66bd236e service placement] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.123292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4c5f-e61e-43e0-be80-501e66bd236e service placement] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.123567 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4c5f-e61e-43e0-be80-501e66bd236e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.125278 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-0fcb4c5f-e61e-43e0-be80-501e66bd236e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:47.138204 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb4c5f-e61e-43e0-be80-501e66bd236e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:47.139800 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb4c5f-e61e-43e0-be80-501e66bd236e service placement] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:47.149860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1160/2330] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:50.538469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:INSERT=2,keystone:SELECT=97 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:54.711519 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11d1e0-b9d6-42aa-9768-1481420ebcd2 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:54.712155 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11d1e0-b9d6-42aa-9768-1481420ebcd2 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:54.712776 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11d1e0-b9d6-42aa-9768-1481420ebcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:54.735392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ad11d1e0-b9d6-42aa-9768-1481420ebcd2 None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:54.738687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ad11d1e0-b9d6-42aa-9768-1481420ebcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:54.797404 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1171/2331] 10.222.0.62 () {58 vars in 967 bytes} [Mon Aug 29 22:52:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:54.810819 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb4c5f-e61e-43e0-be80-501e66bd236e service placement] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:54.812429 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-0fcb4c5f-e61e-43e0-be80-501e66bd236e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:54.886027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb4c5f-e61e-43e0-be80-501e66bd236e service placement] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:54.891276 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47b6fb-0ebd-48e7-a6df-3232d1bdbd90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:54.891896 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47b6fb-0ebd-48e7-a6df-3232d1bdbd90 service swift] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:54.892205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47b6fb-0ebd-48e7-a6df-3232d1bdbd90 service swift] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:54.892483 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47b6fb-0ebd-48e7-a6df-3232d1bdbd90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:54.901486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47b6fb-0ebd-48e7-a6df-3232d1bdbd90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:54.903136 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47b6fb-0ebd-48e7-a6df-3232d1bdbd90 service swift] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:54.912432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1161/2332] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:52:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:52:57.099447 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a29dcb-140f-410f-821d-5c7b9a7feeb8 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:57.099941 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a29dcb-140f-410f-821d-5c7b9a7feeb8 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:57.100046 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a29dcb-140f-410f-821d-5c7b9a7feeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:57.119922 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-97a29dcb-140f-410f-821d-5c7b9a7feeb8 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:57.121101 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-97a29dcb-140f-410f-821d-5c7b9a7feeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:57.185252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1172/2333] 10.222.0.15 () {58 vars in 1016 bytes} [Mon Aug 29 22:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:57.200444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47b6fb-0ebd-48e7-a6df-3232d1bdbd90 service swift] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:57.202041 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ea47b6fb-0ebd-48e7-a6df-3232d1bdbd90 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:57.261970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:57.277379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47b6fb-0ebd-48e7-a6df-3232d1bdbd90 service swift] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:57.283014 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c458b-2c4c-4e55-8283-11f63108ab1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:57.283625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c458b-2c4c-4e55-8283-11f63108ab1d service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:57.283908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c458b-2c4c-4e55-8283-11f63108ab1d service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:57.284708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c458b-2c4c-4e55-8283-11f63108ab1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:57.293422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c458b-2c4c-4e55-8283-11f63108ab1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:57.295056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c458b-2c4c-4e55-8283-11f63108ab1d service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:57.306924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1162/2334] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:02.358849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f163d-6e6d-4508-9f3e-5376913b6b35 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:02.359693 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f163d-6e6d-4508-9f3e-5376913b6b35 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:02.359856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f163d-6e6d-4508-9f3e-5376913b6b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:02.380393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-038f163d-6e6d-4508-9f3e-5376913b6b35 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:02.381592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-038f163d-6e6d-4508-9f3e-5376913b6b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:02.389282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1173/2335] 10.222.0.15 () {58 vars in 1016 bytes} [Mon Aug 29 22:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:02.408192 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c458b-2c4c-4e55-8283-11f63108ab1d service nova] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:02.419832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c458b-2c4c-4e55-8283-11f63108ab1d service nova] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:02.426597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f614e54-feea-4569-a668-6d2225f2f889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:02.427205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f614e54-feea-4569-a668-6d2225f2f889 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:02.427490 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f614e54-feea-4569-a668-6d2225f2f889 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:02.427767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f614e54-feea-4569-a668-6d2225f2f889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:02.436242 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f614e54-feea-4569-a668-6d2225f2f889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:02.437994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f614e54-feea-4569-a668-6d2225f2f889 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:02.447393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1163/2336] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:06.689202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c716cb0-3b3b-4791-8132-60b176860677 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:06.689687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c716cb0-3b3b-4791-8132-60b176860677 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:06.689774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c716cb0-3b3b-4791-8132-60b176860677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:06.709993 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-4c716cb0-3b3b-4791-8132-60b176860677 None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:06.711331 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4c716cb0-3b3b-4791-8132-60b176860677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:06.718606 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1174/2337] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 29 22:53:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:06.741079 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f614e54-feea-4569-a668-6d2225f2f889 service nova] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:06.752490 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f614e54-feea-4569-a668-6d2225f2f889 service nova] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:06.758319 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b00fa-f4a0-42c1-9b6c-ee19eb32e1c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:06.758932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b00fa-f4a0-42c1-9b6c-ee19eb32e1c5 service swift] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:06.759214 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b00fa-f4a0-42c1-9b6c-ee19eb32e1c5 service swift] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:06.759507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b00fa-f4a0-42c1-9b6c-ee19eb32e1c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:06.767933 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b00fa-f4a0-42c1-9b6c-ee19eb32e1c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:06.769567 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b00fa-f4a0-42c1-9b6c-ee19eb32e1c5 service swift] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:06.779413 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1164/2338] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:53:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:53:06.964622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcee6af-3ed3-406d-af7d-0a62a3c5bb3d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:06.964880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcee6af-3ed3-406d-af7d-0a62a3c5bb3d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:06.965170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcee6af-3ed3-406d-af7d-0a62a3c5bb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:06.986307 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-0bcee6af-3ed3-406d-af7d-0a62a3c5bb3d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:06.988355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0bcee6af-3ed3-406d-af7d-0a62a3c5bb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:06.997208 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1175/2339] 10.222.0.15 () {58 vars in 1016 bytes} [Mon Aug 29 22:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:07.010676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b00fa-f4a0-42c1-9b6c-ee19eb32e1c5 service swift] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:07.012263 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-900b00fa-f4a0-42c1-9b6c-ee19eb32e1c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:07.027920 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b00fa-f4a0-42c1-9b6c-ee19eb32e1c5 service swift] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:07.034386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d594a2a-fc24-4277-ac78-d4139d0ef066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:07.034933 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d594a2a-fc24-4277-ac78-d4139d0ef066 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:07.035210 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d594a2a-fc24-4277-ac78-d4139d0ef066 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:07.035488 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d594a2a-fc24-4277-ac78-d4139d0ef066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:07.043917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d594a2a-fc24-4277-ac78-d4139d0ef066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:07.045532 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d594a2a-fc24-4277-ac78-d4139d0ef066 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:07.055743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1165/2340] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:07.834232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9f1ec-9266-4031-8e06-3aaafe829742 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:07.836077 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9f1ec-9266-4031-8e06-3aaafe829742 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:07.836077 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9f1ec-9266-4031-8e06-3aaafe829742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:07.854431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-bff9f1ec-9266-4031-8e06-3aaafe829742 None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:07.855630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-bff9f1ec-9266-4031-8e06-3aaafe829742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:07.863433 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1176/2341] 10.222.0.62 () {58 vars in 967 bytes} [Mon Aug 29 22:53:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:07.875674 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d594a2a-fc24-4277-ac78-d4139d0ef066 service nova] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:07.887206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d594a2a-fc24-4277-ac78-d4139d0ef066 service nova] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:07.892963 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bb619-7ba9-4e24-a34e-6b4d7bf40f69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:07.893568 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bb619-7ba9-4e24-a34e-6b4d7bf40f69 service swift] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:07.893848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bb619-7ba9-4e24-a34e-6b4d7bf40f69 service swift] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:07.894122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bb619-7ba9-4e24-a34e-6b4d7bf40f69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:07.902583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bb619-7ba9-4e24-a34e-6b4d7bf40f69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:07.904173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bb619-7ba9-4e24-a34e-6b4d7bf40f69 service swift] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:07.913593 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1166/2342] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:53:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:53:08.465503 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e812ea-eb5a-4e2a-9b35-4fde3f9740b2 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:08.465792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e812ea-eb5a-4e2a-9b35-4fde3f9740b2 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:08.466075 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e812ea-eb5a-4e2a-9b35-4fde3f9740b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:08.487293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-a8e812ea-eb5a-4e2a-9b35-4fde3f9740b2 None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:08.488543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a8e812ea-eb5a-4e2a-9b35-4fde3f9740b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:08.495719 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1177/2343] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 29 22:53:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:08.508348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bb619-7ba9-4e24-a34e-6b4d7bf40f69 service swift] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:08.519523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bb619-7ba9-4e24-a34e-6b4d7bf40f69 service swift] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:08.524595 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800067d4-8314-4143-acb9-fb2977a07451 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:08.531672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800067d4-8314-4143-acb9-fb2977a07451 service swift] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:08.531672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800067d4-8314-4143-acb9-fb2977a07451 service swift] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:08.531672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800067d4-8314-4143-acb9-fb2977a07451 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:08.533766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800067d4-8314-4143-acb9-fb2977a07451 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:08.535348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800067d4-8314-4143-acb9-fb2977a07451 service swift] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:08.543431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1167/2344] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:53:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 22:53:09.146232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c13c5-94ad-4998-8114-571143f2b02f None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:09.146694 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c13c5-94ad-4998-8114-571143f2b02f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:09.146905 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c13c5-94ad-4998-8114-571143f2b02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:09.170010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-889c13c5-94ad-4998-8114-571143f2b02f None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:09.171237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-889c13c5-94ad-4998-8114-571143f2b02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:09.180880 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1178/2345] 10.222.0.62 () {58 vars in 967 bytes} [Mon Aug 29 22:53:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:09.197780 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800067d4-8314-4143-acb9-fb2977a07451 service swift] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:09.203888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800067d4-8314-4143-acb9-fb2977a07451 service swift] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:09.209313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4571a8-f789-4db0-96d1-a6d9ca915369 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:09.210151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4571a8-f789-4db0-96d1-a6d9ca915369 service swift] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:09.210508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4571a8-f789-4db0-96d1-a6d9ca915369 service swift] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:09.210849 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4571a8-f789-4db0-96d1-a6d9ca915369 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:09.219422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4571a8-f789-4db0-96d1-a6d9ca915369 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:09.221097 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4571a8-f789-4db0-96d1-a6d9ca915369 service swift] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:09.229628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1168/2346] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:53:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:53:10.897759 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4ff65-7b5b-4dbb-8be5-7be2214c22ce None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:10.898355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4ff65-7b5b-4dbb-8be5-7be2214c22ce None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:10.898355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4ff65-7b5b-4dbb-8be5-7be2214c22ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:10.923764 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-dab4ff65-7b5b-4dbb-8be5-7be2214c22ce None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:10.925500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-dab4ff65-7b5b-4dbb-8be5-7be2214c22ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:10.934169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1179/2347] 10.222.0.15 () {58 vars in 1016 bytes} [Mon Aug 29 22:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:10.950929 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4571a8-f789-4db0-96d1-a6d9ca915369 service swift] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:10.972464 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4571a8-f789-4db0-96d1-a6d9ca915369 service swift] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:10.978309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c40833-c73f-4bb4-80de-8f6cf643b133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:10.978924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c40833-c73f-4bb4-80de-8f6cf643b133 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:10.979712 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c40833-c73f-4bb4-80de-8f6cf643b133 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:10.979712 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c40833-c73f-4bb4-80de-8f6cf643b133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:10.988434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c40833-c73f-4bb4-80de-8f6cf643b133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:10.990095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c40833-c73f-4bb4-80de-8f6cf643b133 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:11.000451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1169/2348] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:11.994315 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4ff65-7b5b-4dbb-8be5-7be2214c22ce None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:11.996461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-dab4ff65-7b5b-4dbb-8be5-7be2214c22ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:12.009637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4ff65-7b5b-4dbb-8be5-7be2214c22ce None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:12.014856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69f00c-17b0-4123-8a79-0876f8a6b005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:12.015503 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69f00c-17b0-4123-8a79-0876f8a6b005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:12.015783 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69f00c-17b0-4123-8a79-0876f8a6b005 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:12.016051 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69f00c-17b0-4123-8a79-0876f8a6b005 admin admin] PATH_INFO: `/v3/users/c1fa807bd42c41289855b68255f89b44` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:12.017336 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69f00c-17b0-4123-8a79-0876f8a6b005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1fa807bd42c41289855b68255f89b44)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:12.019265 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69f00c-17b0-4123-8a79-0876f8a6b005 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:12.193948 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-ba69f00c-17b0-4123-8a79-0876f8a6b005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1fa807bd42c41289855b68255f89b44'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:12.194600 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-ba69f00c-17b0-4123-8a79-0876f8a6b005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1fa807bd42c41289855b68255f89b44'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:12.243803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-ba69f00c-17b0-4123-8a79-0876f8a6b005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1fa807bd42c41289855b68255f89b44'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:12.244468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-ba69f00c-17b0-4123-8a79-0876f8a6b005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1fa807bd42c41289855b68255f89b44'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:12.245908 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:12.257592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-ba69f00c-17b0-4123-8a79-0876f8a6b005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1fa807bd42c41289855b68255f89b44'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:12.269510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1180/2349] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:53:11 2022] DELETE /identity/v3/users/c1fa807bd42c41289855b68255f89b44 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:12.274043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549e9b8-45e9-4d69-a944-acb0eb405c06 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:12.274536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549e9b8-45e9-4d69-a944-acb0eb405c06 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:12.274727 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549e9b8-45e9-4d69-a944-acb0eb405c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:12.295016 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-e549e9b8-45e9-4d69-a944-acb0eb405c06 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:12.296184 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e549e9b8-45e9-4d69-a944-acb0eb405c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:12.365706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1170/2350] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:12.375375 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69f00c-17b0-4123-8a79-0876f8a6b005 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:12.376838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ba69f00c-17b0-4123-8a79-0876f8a6b005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:12.433540 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69f00c-17b0-4123-8a79-0876f8a6b005 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:12.441429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d46c1-5793-487f-b622-7462ed4f1555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:12.441429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d46c1-5793-487f-b622-7462ed4f1555 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:12.441429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d46c1-5793-487f-b622-7462ed4f1555 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:12.441429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d46c1-5793-487f-b622-7462ed4f1555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:12.447273 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d46c1-5793-487f-b622-7462ed4f1555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:12.448773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d46c1-5793-487f-b622-7462ed4f1555 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:12.458249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1181/2351] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:12.747621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549e9b8-45e9-4d69-a944-acb0eb405c06 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:12.749049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e549e9b8-45e9-4d69-a944-acb0eb405c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:12.764650 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549e9b8-45e9-4d69-a944-acb0eb405c06 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:12.771449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2f6a3-b385-4ea2-971a-741501745a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:12.772017 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2f6a3-b385-4ea2-971a-741501745a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:12.772265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2f6a3-b385-4ea2-971a-741501745a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:12.772610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2f6a3-b385-4ea2-971a-741501745a1a admin admin] PATH_INFO: `/v3/projects/d84ba82278354f8aa81cf9f9e69757ff` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:12.773782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2f6a3-b385-4ea2-971a-741501745a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84ba82278354f8aa81cf9f9e69757ff)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:12.775701 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2f6a3-b385-4ea2-971a-741501745a1a admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:12.911112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76a2f6a3-b385-4ea2-971a-741501745a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84ba82278354f8aa81cf9f9e69757ff', 'request_id': 'req-76a2f6a3-b385-4ea2-971a-741501745a1a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:12.912943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:13.021520 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76a2f6a3-b385-4ea2-971a-741501745a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84ba82278354f8aa81cf9f9e69757ff', 'request_id': 'req-76a2f6a3-b385-4ea2-971a-741501745a1a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:13.027510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76a2f6a3-b385-4ea2-971a-741501745a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84ba82278354f8aa81cf9f9e69757ff', 'request_id': 'req-76a2f6a3-b385-4ea2-971a-741501745a1a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:13.038796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76a2f6a3-b385-4ea2-971a-741501745a1a admin admin] The token cache is being invalidate because project d84ba82278354f8aa81cf9f9e69757ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:53:13.039090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76a2f6a3-b385-4ea2-971a-741501745a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:13.039745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76a2f6a3-b385-4ea2-971a-741501745a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:13.041237 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1171/2352] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:53:12 2022] DELETE /identity/v3/projects/d84ba82278354f8aa81cf9f9e69757ff => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:13.046463 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee49b9-6829-4163-a369-f6ede917195c None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:13.046959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee49b9-6829-4163-a369-f6ede917195c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:13.047095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee49b9-6829-4163-a369-f6ede917195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:13.067415 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-99ee49b9-6829-4163-a369-f6ede917195c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:13.068659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-99ee49b9-6829-4163-a369-f6ede917195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:13.127662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1182/2353] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:13.136270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ba0c0-4403-4013-b7c6-af99fc7d50ad None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:13.136588 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ba0c0-4403-4013-b7c6-af99fc7d50ad None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:13.136867 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ba0c0-4403-4013-b7c6-af99fc7d50ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:13.158553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-851ba0c0-4403-4013-b7c6-af99fc7d50ad None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:13.159769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-851ba0c0-4403-4013-b7c6-af99fc7d50ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:13.167747 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1172/2354] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:13.171959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee49b9-6829-4163-a369-f6ede917195c None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:13.182215 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee49b9-6829-4163-a369-f6ede917195c None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:13.186957 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957aca4-7a8d-41e5-b5a8-7e646d2c8613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:13.187568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957aca4-7a8d-41e5-b5a8-7e646d2c8613 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:13.187837 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957aca4-7a8d-41e5-b5a8-7e646d2c8613 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:13.188139 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957aca4-7a8d-41e5-b5a8-7e646d2c8613 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:13.188795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957aca4-7a8d-41e5-b5a8-7e646d2c8613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:53:13.189101 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957aca4-7a8d-41e5-b5a8-7e646d2c8613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:13.191330 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957aca4-7a8d-41e5-b5a8-7e646d2c8613 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:13.203068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1183/2355] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:53:13.208149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ba0c0-4403-4013-b7c6-af99fc7d50ad None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:13.217549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ba0c0-4403-4013-b7c6-af99fc7d50ad None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:13.222349 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ec448-b68b-4383-92bf-be8f83be0b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:13.222951 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ec448-b68b-4383-92bf-be8f83be0b7f admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:13.223228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ec448-b68b-4383-92bf-be8f83be0b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:13.223499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ec448-b68b-4383-92bf-be8f83be0b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:13.224150 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ec448-b68b-4383-92bf-be8f83be0b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:13.226171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ec448-b68b-4383-92bf-be8f83be0b7f admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:13.320525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1173/2356] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:53:13 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:53:13.324823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957aca4-7a8d-41e5-b5a8-7e646d2c8613 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:13.335084 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957aca4-7a8d-41e5-b5a8-7e646d2c8613 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:13.391318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb485c-0b4f-48d5-a3d2-a20f8162a9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:13.391834 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb485c-0b4f-48d5-a3d2-a20f8162a9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:13.392138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb485c-0b4f-48d5-a3d2-a20f8162a9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:13.392411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb485c-0b4f-48d5-a3d2-a20f8162a9e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:13.393040 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb485c-0b4f-48d5-a3d2-a20f8162a9e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:13.394940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb485c-0b4f-48d5-a3d2-a20f8162a9e4 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:13.403712 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:13.490530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1184/2357] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:53:13 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:53:13.494394 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ec448-b68b-4383-92bf-be8f83be0b7f admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:13.504735 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ec448-b68b-4383-92bf-be8f83be0b7f admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:13.509432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b9e0e-404d-4c1e-9423-31106e5dd269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:13.510029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b9e0e-404d-4c1e-9423-31106e5dd269 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:13.510319 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b9e0e-404d-4c1e-9423-31106e5dd269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:13.510592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b9e0e-404d-4c1e-9423-31106e5dd269 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:13.511237 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b9e0e-404d-4c1e-9423-31106e5dd269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:13.512867 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b9e0e-404d-4c1e-9423-31106e5dd269 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:13.523754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1174/2358] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:53:13.527811 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb485c-0b4f-48d5-a3d2-a20f8162a9e4 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:13.538474 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb485c-0b4f-48d5-a3d2-a20f8162a9e4 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:13.543274 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0304c-d207-43d3-99e8-f0b8e00b8f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:13.543863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0304c-d207-43d3-99e8-f0b8e00b8f7b admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:13.544177 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0304c-d207-43d3-99e8-f0b8e00b8f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:13.544454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0304c-d207-43d3-99e8-f0b8e00b8f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:13.545141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0304c-d207-43d3-99e8-f0b8e00b8f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:13.546729 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0304c-d207-43d3-99e8-f0b8e00b8f7b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:13.557976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1185/2359] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:53:13.561773 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b9e0e-404d-4c1e-9423-31106e5dd269 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:13.571830 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b9e0e-404d-4c1e-9423-31106e5dd269 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:13.576492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cba127-8878-4550-8d05-3d348fd65c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:13.577131 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cba127-8878-4550-8d05-3d348fd65c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:13.577413 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cba127-8878-4550-8d05-3d348fd65c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:13.577708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cba127-8878-4550-8d05-3d348fd65c7c admin admin] PATH_INFO: `/v3/projects/4f95d720ec184934b6c94fe5738261b7/users/d3d28b9e27444162b5d02429c56d327a/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:13.593809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cba127-8878-4550-8d05-3d348fd65c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f95d720ec184934b6c94fe5738261b7, user_id=d3d28b9e27444162b5d02429c56d327a, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:13.596826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cba127-8878-4550-8d05-3d348fd65c7c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:13.707601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1175/2360] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:53:13 2022] PUT /identity/v3/projects/4f95d720ec184934b6c94fe5738261b7/users/d3d28b9e27444162b5d02429c56d327a/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:53:13.713376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48044d4-3ae5-40a1-a2c9-4e041932d545 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:13.713657 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48044d4-3ae5-40a1-a2c9-4e041932d545 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:13.713928 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48044d4-3ae5-40a1-a2c9-4e041932d545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:13.733502 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-b48044d4-3ae5-40a1-a2c9-4e041932d545 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:13.734767 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b48044d4-3ae5-40a1-a2c9-4e041932d545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:13.793477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1186/2361] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:13.803916 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cba127-8878-4550-8d05-3d348fd65c7c admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:13.805685 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d2cba127-8878-4550-8d05-3d348fd65c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:13.868461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cba127-8878-4550-8d05-3d348fd65c7c admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:13.872378 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b7603-8920-4749-85e3-e7714d1a61cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:13.872992 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7603-8920-4749-85e3-e7714d1a61cb service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:13.873276 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7603-8920-4749-85e3-e7714d1a61cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:13.873556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7603-8920-4749-85e3-e7714d1a61cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:13.883385 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b7603-8920-4749-85e3-e7714d1a61cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:13.884866 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b7603-8920-4749-85e3-e7714d1a61cb service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:13.894432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1176/2362] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:14.103546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf958d9-ef8d-42c9-a04d-9e693c137a35 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:14.104035 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf958d9-ef8d-42c9-a04d-9e693c137a35 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:14.104283 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf958d9-ef8d-42c9-a04d-9e693c137a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:14.124897 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-2cf958d9-ef8d-42c9-a04d-9e693c137a35 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:14.126543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2cf958d9-ef8d-42c9-a04d-9e693c137a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:14.135284 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1187/2363] 10.222.0.15 () {58 vars in 1016 bytes} [Mon Aug 29 22:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:14.152418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b7603-8920-4749-85e3-e7714d1a61cb service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:14.153927 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-df9b7603-8920-4749-85e3-e7714d1a61cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:14.230902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b7603-8920-4749-85e3-e7714d1a61cb service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:14.237727 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b743d-34d1-4b2a-ac0f-605e032c3be4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:14.238344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b743d-34d1-4b2a-ac0f-605e032c3be4 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:14.238626 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b743d-34d1-4b2a-ac0f-605e032c3be4 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:14.238941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b743d-34d1-4b2a-ac0f-605e032c3be4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:14.247597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b743d-34d1-4b2a-ac0f-605e032c3be4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:14.249235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b743d-34d1-4b2a-ac0f-605e032c3be4 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:14.258898 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1177/2364] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:17.347911 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ead27-24b7-4ad6-b0df-b5df01c0dd24 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:17.348471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ead27-24b7-4ad6-b0df-b5df01c0dd24 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:17.348703 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ead27-24b7-4ad6-b0df-b5df01c0dd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:17.370855 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-d32ead27-24b7-4ad6-b0df-b5df01c0dd24 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:17.372115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d32ead27-24b7-4ad6-b0df-b5df01c0dd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:17.382132 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1188/2365] 10.222.0.15 () {58 vars in 1016 bytes} [Mon Aug 29 22:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:17.399041 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b743d-34d1-4b2a-ac0f-605e032c3be4 service nova] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:17.405044 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:17.411199 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b743d-34d1-4b2a-ac0f-605e032c3be4 service nova] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:17.417185 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65306216-80ee-4102-9e33-654b7c2ff687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:17.417807 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65306216-80ee-4102-9e33-654b7c2ff687 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:17.418090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65306216-80ee-4102-9e33-654b7c2ff687 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:17.418368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65306216-80ee-4102-9e33-654b7c2ff687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:17.428518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65306216-80ee-4102-9e33-654b7c2ff687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:17.430455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65306216-80ee-4102-9e33-654b7c2ff687 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:17.443369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1178/2366] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:18.421559 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836a1aa-bc6a-43d3-8244-b0e3ead07935 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:18.422013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836a1aa-bc6a-43d3-8244-b0e3ead07935 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:18.422112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836a1aa-bc6a-43d3-8244-b0e3ead07935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:18.442984 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-8836a1aa-bc6a-43d3-8244-b0e3ead07935 None None] MFA Rules not processed for user `702f1e3b8d0342fc999f63d701bc4772`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:18.444306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8836a1aa-bc6a-43d3-8244-b0e3ead07935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:18.515053 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1189/2367] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:53:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:20.494736 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111a07f-ccde-4e0a-9488-b16200534112 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:20.495208 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111a07f-ccde-4e0a-9488-b16200534112 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:20.495290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111a07f-ccde-4e0a-9488-b16200534112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:20.548503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-1111a07f-ccde-4e0a-9488-b16200534112 None None] MFA Rules not processed for user `d3d28b9e27444162b5d02429c56d327a`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:20.548503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1111a07f-ccde-4e0a-9488-b16200534112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:20.655299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1179/2368] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:53:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:20.656460 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836a1aa-bc6a-43d3-8244-b0e3ead07935 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:20.669682 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836a1aa-bc6a-43d3-8244-b0e3ead07935 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:20.675364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54c92e-1fb0-4158-a77b-d694748d146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:20.675990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54c92e-1fb0-4158-a77b-d694748d146a admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:20.677014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54c92e-1fb0-4158-a77b-d694748d146a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:20.677295 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54c92e-1fb0-4158-a77b-d694748d146a admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:20.677965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54c92e-1fb0-4158-a77b-d694748d146a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:20.680046 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54c92e-1fb0-4158-a77b-d694748d146a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:20.810147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1190/2369] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:53:20 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:53:20.811983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111a07f-ccde-4e0a-9488-b16200534112 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:20.826246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111a07f-ccde-4e0a-9488-b16200534112 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:20.888257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4315321-0bc8-48f6-9397-865755e0eb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:20.889112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4315321-0bc8-48f6-9397-865755e0eb43 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:20.889601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4315321-0bc8-48f6-9397-865755e0eb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:20.889874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4315321-0bc8-48f6-9397-865755e0eb43 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:20.890586 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4315321-0bc8-48f6-9397-865755e0eb43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:20.892632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4315321-0bc8-48f6-9397-865755e0eb43 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:20.969912 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1180/2370] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:53:20 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:53:20.974646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54c92e-1fb0-4158-a77b-d694748d146a admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:20.984849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54c92e-1fb0-4158-a77b-d694748d146a admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:20.989909 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f40a0-f33a-4612-8c62-e1e5502fae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:20.990504 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f40a0-f33a-4612-8c62-e1e5502fae77 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:20.990948 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f40a0-f33a-4612-8c62-e1e5502fae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:20.991376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f40a0-f33a-4612-8c62-e1e5502fae77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:20.992028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f40a0-f33a-4612-8c62-e1e5502fae77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:20.994116 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f40a0-f33a-4612-8c62-e1e5502fae77 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:21.008066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1191/2371] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:53:21.009179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4315321-0bc8-48f6-9397-865755e0eb43 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:21.019575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4315321-0bc8-48f6-9397-865755e0eb43 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:21.024816 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f8917-0f64-4045-80f0-3253496e280c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:21.025439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f8917-0f64-4045-80f0-3253496e280c admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:21.025719 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f8917-0f64-4045-80f0-3253496e280c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:21.025991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f8917-0f64-4045-80f0-3253496e280c admin admin] PATH_INFO: `/v3/projects/574c8f664b3a44ae8688b1882ee4177e/users/ea03863bda2f47208461a776e24d85d9/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:21.041587 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f8917-0f64-4045-80f0-3253496e280c admin admin] RBAC: Authorizing `identity:create_grant(project_id=574c8f664b3a44ae8688b1882ee4177e, user_id=ea03863bda2f47208461a776e24d85d9, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:21.044919 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f8917-0f64-4045-80f0-3253496e280c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:21.113137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1181/2372] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:53:21 2022] PUT /identity/v3/projects/574c8f664b3a44ae8688b1882ee4177e/users/ea03863bda2f47208461a776e24d85d9/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:53:21.117306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f40a0-f33a-4612-8c62-e1e5502fae77 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:21.128363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f40a0-f33a-4612-8c62-e1e5502fae77 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:21.167360 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:21.188979 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20c804-2fa2-44ad-aac2-e67ad00233b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:21.189599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c804-2fa2-44ad-aac2-e67ad00233b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:21.189883 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c804-2fa2-44ad-aac2-e67ad00233b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:21.190161 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c804-2fa2-44ad-aac2-e67ad00233b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:21.190814 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20c804-2fa2-44ad-aac2-e67ad00233b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:21.192555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20c804-2fa2-44ad-aac2-e67ad00233b6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:21.207230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1192/2373] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:53:21.212326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f8917-0f64-4045-80f0-3253496e280c admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:21.223154 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f8917-0f64-4045-80f0-3253496e280c admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:21.228074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4a6fa-972a-440a-878c-df14949dcb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:21.228932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4a6fa-972a-440a-878c-df14949dcb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:21.229283 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4a6fa-972a-440a-878c-df14949dcb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:21.229633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4a6fa-972a-440a-878c-df14949dcb1d admin admin] PATH_INFO: `/v3/projects/574c8f664b3a44ae8688b1882ee4177e/users/ea03863bda2f47208461a776e24d85d9/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:21.231717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4a6fa-972a-440a-878c-df14949dcb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=574c8f664b3a44ae8688b1882ee4177e, user_id=ea03863bda2f47208461a776e24d85d9, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:21.234477 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4a6fa-972a-440a-878c-df14949dcb1d admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:21.246665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1182/2374] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:53:21 2022] PUT /identity/v3/projects/574c8f664b3a44ae8688b1882ee4177e/users/ea03863bda2f47208461a776e24d85d9/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:27.180649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56f18b-3977-48a0-ad43-4a2ace24e967 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:27.181162 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56f18b-3977-48a0-ad43-4a2ace24e967 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:27.181379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56f18b-3977-48a0-ad43-4a2ace24e967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:27.217774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-6d56f18b-3977-48a0-ad43-4a2ace24e967 None None] MFA Rules not processed for user `ea03863bda2f47208461a776e24d85d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:27.235441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-6d56f18b-3977-48a0-ad43-4a2ace24e967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:27.347513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1193/2375] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:53:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:27.362829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4a6fa-972a-440a-878c-df14949dcb1d admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:27.410182 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:27.466430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4a6fa-972a-440a-878c-df14949dcb1d admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:27.474947 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492586b8-91aa-4146-af8d-1f128e92494d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:27.475951 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492586b8-91aa-4146-af8d-1f128e92494d service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:27.476569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492586b8-91aa-4146-af8d-1f128e92494d service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:27.477040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492586b8-91aa-4146-af8d-1f128e92494d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:27.547794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492586b8-91aa-4146-af8d-1f128e92494d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:27.549801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492586b8-91aa-4146-af8d-1f128e92494d service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:27.564202 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1183/2376] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:30.961166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ad705-b081-488e-848c-6075e11e90e8 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:30.961646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ad705-b081-488e-848c-6075e11e90e8 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:30.961743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ad705-b081-488e-848c-6075e11e90e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:30.996334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-b99ad705-b081-488e-848c-6075e11e90e8 None None] MFA Rules not processed for user `d3d28b9e27444162b5d02429c56d327a`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:30.998180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b99ad705-b081-488e-848c-6075e11e90e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:31.006426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1194/2377] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:53:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:35.231876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a40c3-a04d-4260-a29d-0c06cd7f2ce0 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:35.232433 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a40c3-a04d-4260-a29d-0c06cd7f2ce0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:35.237089 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a40c3-a04d-4260-a29d-0c06cd7f2ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:35.252478 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-b03a40c3-a04d-4260-a29d-0c06cd7f2ce0 None None] MFA Rules not processed for user `6e762e6e095148819279d742663659f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:35.253704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b03a40c3-a04d-4260-a29d-0c06cd7f2ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:35.325153 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1184/2378] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:40.979527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=48 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:45.318397 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=67 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:48.721202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b623c-ced2-40b6-aff1-0bbd312040f7 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:48.721720 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b623c-ced2-40b6-aff1-0bbd312040f7 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:48.721859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b623c-ced2-40b6-aff1-0bbd312040f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:48.741327 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-295b623c-ced2-40b6-aff1-0bbd312040f7 None None] MFA Rules not processed for user `d4fbfe7d86aa42019a66868517eea7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:48.742533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-295b623c-ced2-40b6-aff1-0bbd312040f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:48.799723 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1195/2379] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:53:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:50.863692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5a731-db44-4664-b3c1-ea6496201477 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:50.864255 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5a731-db44-4664-b3c1-ea6496201477 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:50.868363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5a731-db44-4664-b3c1-ea6496201477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:50.883144 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d9c5a731-db44-4664-b3c1-ea6496201477 None None] MFA Rules not processed for user `bd130bf777664a62ab043200c84ac8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:50.884397 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d9c5a731-db44-4664-b3c1-ea6496201477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:50.939055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1185/2380] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:53:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:57.990530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e704f94-04a0-490e-a98f-a0b03948b902 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:57.991019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e704f94-04a0-490e-a98f-a0b03948b902 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:57.991148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e704f94-04a0-490e-a98f-a0b03948b902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:58.011673 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-6e704f94-04a0-490e-a98f-a0b03948b902 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:58.012955 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-6e704f94-04a0-490e-a98f-a0b03948b902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:58.082675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1196/2381] 10.222.0.15 () {58 vars in 1016 bytes} [Mon Aug 29 22:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:58.104261 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5a731-db44-4664-b3c1-ea6496201477 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:58.105728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d9c5a731-db44-4664-b3c1-ea6496201477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:58.122826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5a731-db44-4664-b3c1-ea6496201477 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:58.128380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43634f-8dda-4a25-b7b6-f9f3979b12f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:58.128992 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43634f-8dda-4a25-b7b6-f9f3979b12f8 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:58.129274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43634f-8dda-4a25-b7b6-f9f3979b12f8 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:58.129578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43634f-8dda-4a25-b7b6-f9f3979b12f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:58.137985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43634f-8dda-4a25-b7b6-f9f3979b12f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:58.139623 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43634f-8dda-4a25-b7b6-f9f3979b12f8 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:58.149172 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1186/2382] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:02.375132 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38a6c0-6ab5-4929-b625-072848981ab6 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:02.375565 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38a6c0-6ab5-4929-b625-072848981ab6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:02.375684 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38a6c0-6ab5-4929-b625-072848981ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:02.395349 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-6d38a6c0-6ab5-4929-b625-072848981ab6 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:02.396639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-6d38a6c0-6ab5-4929-b625-072848981ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:02.404583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1197/2383] 10.222.0.15 () {58 vars in 1016 bytes} [Mon Aug 29 22:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:02.420796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43634f-8dda-4a25-b7b6-f9f3979b12f8 service nova] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:02.432672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43634f-8dda-4a25-b7b6-f9f3979b12f8 service nova] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:02.438187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e6f4a-b54d-4dda-8060-2a58276cabeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:02.442596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e6f4a-b54d-4dda-8060-2a58276cabeb service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:02.442596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e6f4a-b54d-4dda-8060-2a58276cabeb service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:02.442596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e6f4a-b54d-4dda-8060-2a58276cabeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:02.447235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e6f4a-b54d-4dda-8060-2a58276cabeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:02.448845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e6f4a-b54d-4dda-8060-2a58276cabeb service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:02.458331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1187/2384] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:06.366347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13020704-db09-4520-ba6f-51638d5fd1b7 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:06.366836 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13020704-db09-4520-ba6f-51638d5fd1b7 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:06.366836 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13020704-db09-4520-ba6f-51638d5fd1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:06.386646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-13020704-db09-4520-ba6f-51638d5fd1b7 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:06.387821 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-13020704-db09-4520-ba6f-51638d5fd1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:06.396140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1198/2385] 10.222.0.15 () {58 vars in 1016 bytes} [Mon Aug 29 22:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:06.416455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e6f4a-b54d-4dda-8060-2a58276cabeb service nova] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:06.427822 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e6f4a-b54d-4dda-8060-2a58276cabeb service nova] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:06.433302 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a54a23-0b3c-48cf-88ec-aedc7da853e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:06.433895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a54a23-0b3c-48cf-88ec-aedc7da853e9 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:06.434183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a54a23-0b3c-48cf-88ec-aedc7da853e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:06.434460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a54a23-0b3c-48cf-88ec-aedc7da853e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:06.442937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a54a23-0b3c-48cf-88ec-aedc7da853e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:06.444533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a54a23-0b3c-48cf-88ec-aedc7da853e9 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:06.453920 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1188/2386] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:08.322968 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13020704-db09-4520-ba6f-51638d5fd1b7 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:08.324506 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-13020704-db09-4520-ba6f-51638d5fd1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:08.381254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13020704-db09-4520-ba6f-51638d5fd1b7 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:08.385061 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bd946-85fc-4a8b-86f2-b2ced413a877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:08.385667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bd946-85fc-4a8b-86f2-b2ced413a877 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:08.385950 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bd946-85fc-4a8b-86f2-b2ced413a877 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:08.386225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bd946-85fc-4a8b-86f2-b2ced413a877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:08.396120 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bd946-85fc-4a8b-86f2-b2ced413a877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:08.397547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bd946-85fc-4a8b-86f2-b2ced413a877 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:08.406949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1199/2387] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:11.664775 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88f370-5091-4ab0-b991-e860ec5305f3 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:11.671435 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88f370-5091-4ab0-b991-e860ec5305f3 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:11.671435 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88f370-5091-4ab0-b991-e860ec5305f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:11.691530 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-ba88f370-5091-4ab0-b991-e860ec5305f3 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:11.692846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ba88f370-5091-4ab0-b991-e860ec5305f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:11.701080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1189/2388] 10.222.0.15 () {58 vars in 1016 bytes} [Mon Aug 29 22:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:11.719593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bd946-85fc-4a8b-86f2-b2ced413a877 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:11.729003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=85 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:11.739540 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bd946-85fc-4a8b-86f2-b2ced413a877 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:11.747173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12580173-7fa4-4ae8-a50f-72ee40e037d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:11.747941 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12580173-7fa4-4ae8-a50f-72ee40e037d7 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:11.747941 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12580173-7fa4-4ae8-a50f-72ee40e037d7 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:11.747941 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12580173-7fa4-4ae8-a50f-72ee40e037d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:11.758226 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12580173-7fa4-4ae8-a50f-72ee40e037d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:11.759937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12580173-7fa4-4ae8-a50f-72ee40e037d7 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:11.771037 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1200/2389] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:15.935625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76111a2-20d9-4791-8ca6-2d46e0508391 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:15.936150 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76111a2-20d9-4791-8ca6-2d46e0508391 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:15.936261 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76111a2-20d9-4791-8ca6-2d46e0508391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:15.944339 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=47 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:15.956303 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-f76111a2-20d9-4791-8ca6-2d46e0508391 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:15.957729 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-f76111a2-20d9-4791-8ca6-2d46e0508391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:15.966229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1190/2390] 10.222.0.15 () {58 vars in 1016 bytes} [Mon Aug 29 22:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:15.982644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12580173-7fa4-4ae8-a50f-72ee40e037d7 service nova] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:15.994115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12580173-7fa4-4ae8-a50f-72ee40e037d7 service nova] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:15.999460 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3ac0c-a0e4-484e-bba5-a0686af7c6e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:16.000045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3ac0c-a0e4-484e-bba5-a0686af7c6e2 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:16.000376 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3ac0c-a0e4-484e-bba5-a0686af7c6e2 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:16.000649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3ac0c-a0e4-484e-bba5-a0686af7c6e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:16.008527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3ac0c-a0e4-484e-bba5-a0686af7c6e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:16.010082 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3ac0c-a0e4-484e-bba5-a0686af7c6e2 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:16.019195 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1201/2391] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:54:25.973835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:26.015136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=11 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:42.192478 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4162b5-c2de-4bd4-b1b7-17c7db771da1 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:42.193005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4162b5-c2de-4bd4-b1b7-17c7db771da1 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:42.193124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4162b5-c2de-4bd4-b1b7-17c7db771da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:42.213791 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-4c4162b5-c2de-4bd4-b1b7-17c7db771da1 None None] MFA Rules not processed for user `702f1e3b8d0342fc999f63d701bc4772`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:42.215079 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-4c4162b5-c2de-4bd4-b1b7-17c7db771da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:42.268853 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1191/2392] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:54:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:44.085358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3ac0c-a0e4-484e-bba5-a0686af7c6e2 service nova] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:44.094849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3ac0c-a0e4-484e-bba5-a0686af7c6e2 service nova] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:44.098482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa5a3b-bab3-440c-9ae6-f7c4e7675b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:44.099067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa5a3b-bab3-440c-9ae6-f7c4e7675b7b service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:44.099343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa5a3b-bab3-440c-9ae6-f7c4e7675b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:44.099612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa5a3b-bab3-440c-9ae6-f7c4e7675b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:44.101309 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-81fa5a3b-bab3-440c-9ae6-f7c4e7675b7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:44.114244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa5a3b-bab3-440c-9ae6-f7c4e7675b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:44.115654 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa5a3b-bab3-440c-9ae6-f7c4e7675b7b service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:44.128045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1202/2393] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:46.793064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4162b5-c2de-4bd4-b1b7-17c7db771da1 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:46.803732 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4162b5-c2de-4bd4-b1b7-17c7db771da1 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:46.808547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53b328-c6b5-4fdc-85f0-93d0bd688b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:46.809168 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53b328-c6b5-4fdc-85f0-93d0bd688b21 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:46.809459 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53b328-c6b5-4fdc-85f0-93d0bd688b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:46.809716 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53b328-c6b5-4fdc-85f0-93d0bd688b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:46.811639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-ca53b328-c6b5-4fdc-85f0-93d0bd688b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:46.827408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53b328-c6b5-4fdc-85f0-93d0bd688b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:46.828920 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53b328-c6b5-4fdc-85f0-93d0bd688b21 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:46.841422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1192/2394] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:52.585677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa5a3b-bab3-440c-9ae6-f7c4e7675b7b service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:52.587274 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-81fa5a3b-bab3-440c-9ae6-f7c4e7675b7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:52.603701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa5a3b-bab3-440c-9ae6-f7c4e7675b7b service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:52.608634 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8055fe9-2c9b-4723-b7ee-6cdb5a0f58f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:52.609335 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8055fe9-2c9b-4723-b7ee-6cdb5a0f58f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:52.609627 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8055fe9-2c9b-4723-b7ee-6cdb5a0f58f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:52.609904 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8055fe9-2c9b-4723-b7ee-6cdb5a0f58f5 admin admin] PATH_INFO: `/v3/users/6e762e6e095148819279d742663659f2` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:52.611047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8055fe9-2c9b-4723-b7ee-6cdb5a0f58f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e762e6e095148819279d742663659f2)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:52.613254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8055fe9-2c9b-4723-b7ee-6cdb5a0f58f5 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:52.787140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8055fe9-2c9b-4723-b7ee-6cdb5a0f58f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e762e6e095148819279d742663659f2'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:52.787727 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8055fe9-2c9b-4723-b7ee-6cdb5a0f58f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e762e6e095148819279d742663659f2'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:52.847923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8055fe9-2c9b-4723-b7ee-6cdb5a0f58f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e762e6e095148819279d742663659f2'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:52.848572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8055fe9-2c9b-4723-b7ee-6cdb5a0f58f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e762e6e095148819279d742663659f2'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:52.862506 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8055fe9-2c9b-4723-b7ee-6cdb5a0f58f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e762e6e095148819279d742663659f2'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:52.876940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1203/2395] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:54:52 2022] DELETE /identity/v3/users/6e762e6e095148819279d742663659f2 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:54:53.124218 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53b328-c6b5-4fdc-85f0-93d0bd688b21 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:53.135024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53b328-c6b5-4fdc-85f0-93d0bd688b21 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:53.203288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ce1bd-2850-4cc4-add9-c2828038258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:53.203930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ce1bd-2850-4cc4-add9-c2828038258c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:53.204243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ce1bd-2850-4cc4-add9-c2828038258c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:53.204668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ce1bd-2850-4cc4-add9-c2828038258c admin admin] PATH_INFO: `/v3/projects/d8bb83d3bc304eda9e6490d1d2cb501d` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:53.205829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ce1bd-2850-4cc4-add9-c2828038258c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8bb83d3bc304eda9e6490d1d2cb501d)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:53.207794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ce1bd-2850-4cc4-add9-c2828038258c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:53.294864 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2b0ce1bd-2850-4cc4-add9-c2828038258c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8bb83d3bc304eda9e6490d1d2cb501d', 'request_id': 'req-2b0ce1bd-2850-4cc4-add9-c2828038258c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:53.339315 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2b0ce1bd-2850-4cc4-add9-c2828038258c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8bb83d3bc304eda9e6490d1d2cb501d', 'request_id': 'req-2b0ce1bd-2850-4cc4-add9-c2828038258c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:53.345486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2b0ce1bd-2850-4cc4-add9-c2828038258c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8bb83d3bc304eda9e6490d1d2cb501d', 'request_id': 'req-2b0ce1bd-2850-4cc4-add9-c2828038258c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:53.357635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2b0ce1bd-2850-4cc4-add9-c2828038258c admin admin] The token cache is being invalidate because project d8bb83d3bc304eda9e6490d1d2cb501d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:54:53.357921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2b0ce1bd-2850-4cc4-add9-c2828038258c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:53.358607 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-2b0ce1bd-2850-4cc4-add9-c2828038258c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:53.360103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1193/2396] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:54:53 2022] DELETE /identity/v3/projects/d8bb83d3bc304eda9e6490d1d2cb501d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:54:55.502112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8055fe9-2c9b-4723-b7ee-6cdb5a0f58f5 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:55.503614 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a8055fe9-2c9b-4723-b7ee-6cdb5a0f58f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:55.579562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8055fe9-2c9b-4723-b7ee-6cdb5a0f58f5 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:55.641189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:55.659475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8252bb-2af5-4083-b107-359a70ecf151 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:55.660138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8252bb-2af5-4083-b107-359a70ecf151 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:55.660419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8252bb-2af5-4083-b107-359a70ecf151 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:55.660695 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8252bb-2af5-4083-b107-359a70ecf151 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:55.662509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2f8252bb-2af5-4083-b107-359a70ecf151 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:55.726368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8252bb-2af5-4083-b107-359a70ecf151 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:55.728134 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8252bb-2af5-4083-b107-359a70ecf151 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:55.738380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1204/2397] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:55.812562 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ce1bd-2850-4cc4-add9-c2828038258c admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:55.814170 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-2b0ce1bd-2850-4cc4-add9-c2828038258c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:55.844389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:55.876555 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ce1bd-2850-4cc4-add9-c2828038258c admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:55.881605 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa4bd5-491e-4cb0-8d1e-f51394e65427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:55.882455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa4bd5-491e-4cb0-8d1e-f51394e65427 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:55.882734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa4bd5-491e-4cb0-8d1e-f51394e65427 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:55.883004 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa4bd5-491e-4cb0-8d1e-f51394e65427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:55.892649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa4bd5-491e-4cb0-8d1e-f51394e65427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:55.894069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa4bd5-491e-4cb0-8d1e-f51394e65427 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:55.903795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1194/2398] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:57.808877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8252bb-2af5-4083-b107-359a70ecf151 service nova] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:57.810288 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2f8252bb-2af5-4083-b107-359a70ecf151 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:57.824300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8252bb-2af5-4083-b107-359a70ecf151 service nova] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:57.829788 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651b1b3-c162-4e43-b9e5-6ea283966a20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:57.830381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651b1b3-c162-4e43-b9e5-6ea283966a20 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:57.830663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651b1b3-c162-4e43-b9e5-6ea283966a20 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:57.830938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651b1b3-c162-4e43-b9e5-6ea283966a20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:57.832646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2651b1b3-c162-4e43-b9e5-6ea283966a20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:57.890691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651b1b3-c162-4e43-b9e5-6ea283966a20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:57.892334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651b1b3-c162-4e43-b9e5-6ea283966a20 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:57.901238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1205/2399] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:05.636518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa4bd5-491e-4cb0-8d1e-f51394e65427 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:05.649238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa4bd5-491e-4cb0-8d1e-f51394e65427 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:05.653511 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc534d-3fc2-471d-a445-006ff2785c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:05.654146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc534d-3fc2-471d-a445-006ff2785c87 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:05.654451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc534d-3fc2-471d-a445-006ff2785c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:05.654707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc534d-3fc2-471d-a445-006ff2785c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:05.656523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-f7bc534d-3fc2-471d-a445-006ff2785c87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:05.719181 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc534d-3fc2-471d-a445-006ff2785c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:05.720649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc534d-3fc2-471d-a445-006ff2785c87 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:05.730906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1195/2400] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:07.897114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=58 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:09.440500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651b1b3-c162-4e43-b9e5-6ea283966a20 service nova] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:09.442002 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2651b1b3-c162-4e43-b9e5-6ea283966a20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:09.459961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651b1b3-c162-4e43-b9e5-6ea283966a20 service nova] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:09.465691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bf8e9-0c1e-4262-a8e2-93084d1fe330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:09.466331 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bf8e9-0c1e-4262-a8e2-93084d1fe330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:09.466612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bf8e9-0c1e-4262-a8e2-93084d1fe330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:09.466887 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bf8e9-0c1e-4262-a8e2-93084d1fe330 admin admin] PATH_INFO: `/v3/users/d4fbfe7d86aa42019a66868517eea7bd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:09.468030 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bf8e9-0c1e-4262-a8e2-93084d1fe330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4fbfe7d86aa42019a66868517eea7bd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:09.470119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bf8e9-0c1e-4262-a8e2-93084d1fe330 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:09.686276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b19bf8e9-0c1e-4262-a8e2-93084d1fe330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4fbfe7d86aa42019a66868517eea7bd'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:09.687826 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b19bf8e9-0c1e-4262-a8e2-93084d1fe330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4fbfe7d86aa42019a66868517eea7bd'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:09.739149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b19bf8e9-0c1e-4262-a8e2-93084d1fe330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4fbfe7d86aa42019a66868517eea7bd'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:09.739792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b19bf8e9-0c1e-4262-a8e2-93084d1fe330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4fbfe7d86aa42019a66868517eea7bd'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:09.752332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b19bf8e9-0c1e-4262-a8e2-93084d1fe330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4fbfe7d86aa42019a66868517eea7bd'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:09.766504 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1206/2401] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:55:09 2022] DELETE /identity/v3/users/d4fbfe7d86aa42019a66868517eea7bd => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:55:09.998109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc534d-3fc2-471d-a445-006ff2785c87 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:10.009315 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc534d-3fc2-471d-a445-006ff2785c87 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:10.074383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71200335-4af4-4992-9c2b-6693095d7522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:10.075012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71200335-4af4-4992-9c2b-6693095d7522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:10.075292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71200335-4af4-4992-9c2b-6693095d7522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:10.075563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71200335-4af4-4992-9c2b-6693095d7522 admin admin] PATH_INFO: `/v3/projects/5c198150daad4dc7a9248004e204392b` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:10.076740 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71200335-4af4-4992-9c2b-6693095d7522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c198150daad4dc7a9248004e204392b)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:10.078646 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71200335-4af4-4992-9c2b-6693095d7522 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:10.176215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-71200335-4af4-4992-9c2b-6693095d7522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c198150daad4dc7a9248004e204392b', 'request_id': 'req-71200335-4af4-4992-9c2b-6693095d7522'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:10.242111 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-71200335-4af4-4992-9c2b-6693095d7522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c198150daad4dc7a9248004e204392b', 'request_id': 'req-71200335-4af4-4992-9c2b-6693095d7522'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:10.247750 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:10.250195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-71200335-4af4-4992-9c2b-6693095d7522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c198150daad4dc7a9248004e204392b', 'request_id': 'req-71200335-4af4-4992-9c2b-6693095d7522'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:10.261795 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-71200335-4af4-4992-9c2b-6693095d7522 admin admin] The token cache is being invalidate because project 5c198150daad4dc7a9248004e204392b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:55:10.262084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-71200335-4af4-4992-9c2b-6693095d7522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:10.262751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-71200335-4af4-4992-9c2b-6693095d7522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:10.264254 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1196/2402] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:55:09 2022] DELETE /identity/v3/projects/5c198150daad4dc7a9248004e204392b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:55:10.270016 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff011419-fa6e-4e54-bc11-c00bd108dc7b None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:10.270308 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff011419-fa6e-4e54-bc11-c00bd108dc7b None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:10.270587 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff011419-fa6e-4e54-bc11-c00bd108dc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:10.290097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ff011419-fa6e-4e54-bc11-c00bd108dc7b None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:10.291329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ff011419-fa6e-4e54-bc11-c00bd108dc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:10.349366 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1207/2403] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:10.357093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97199c34-f274-4517-9cd7-e495a692fdda None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:10.357436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97199c34-f274-4517-9cd7-e495a692fdda None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:10.357713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97199c34-f274-4517-9cd7-e495a692fdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:10.379554 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-97199c34-f274-4517-9cd7-e495a692fdda None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:10.380791 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-97199c34-f274-4517-9cd7-e495a692fdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:10.389897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1197/2404] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:10.394149 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff011419-fa6e-4e54-bc11-c00bd108dc7b None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:10.404069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff011419-fa6e-4e54-bc11-c00bd108dc7b None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:10.408650 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cb0f5-b1ee-4eb7-b021-b055a88e4fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:10.409247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cb0f5-b1ee-4eb7-b021-b055a88e4fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:10.409527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cb0f5-b1ee-4eb7-b021-b055a88e4fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:10.409798 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cb0f5-b1ee-4eb7-b021-b055a88e4fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:10.410445 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cb0f5-b1ee-4eb7-b021-b055a88e4fc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:55:10.410749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cb0f5-b1ee-4eb7-b021-b055a88e4fc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:10.412485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cb0f5-b1ee-4eb7-b021-b055a88e4fc4 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:10.424462 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1208/2405] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:55:10.428967 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97199c34-f274-4517-9cd7-e495a692fdda None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:10.438752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97199c34-f274-4517-9cd7-e495a692fdda None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:10.443361 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ef18e-9110-4f62-8f0f-7c18ef0baf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:10.443951 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ef18e-9110-4f62-8f0f-7c18ef0baf44 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:10.444269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ef18e-9110-4f62-8f0f-7c18ef0baf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:10.444545 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ef18e-9110-4f62-8f0f-7c18ef0baf44 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:10.445181 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ef18e-9110-4f62-8f0f-7c18ef0baf44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:10.447052 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ef18e-9110-4f62-8f0f-7c18ef0baf44 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:10.558575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1198/2406] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:55:10 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:55:10.562939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cb0f5-b1ee-4eb7-b021-b055a88e4fc4 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:10.573565 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cb0f5-b1ee-4eb7-b021-b055a88e4fc4 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:10.633761 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43262554-5353-4094-9ea3-d153f9c02b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:10.634366 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43262554-5353-4094-9ea3-d153f9c02b93 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:10.634649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43262554-5353-4094-9ea3-d153f9c02b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:10.634926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43262554-5353-4094-9ea3-d153f9c02b93 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:10.635568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43262554-5353-4094-9ea3-d153f9c02b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:10.637575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43262554-5353-4094-9ea3-d153f9c02b93 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:10.645499 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:10.739546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1209/2407] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:55:10 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:55:10.743770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ef18e-9110-4f62-8f0f-7c18ef0baf44 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:10.754825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ef18e-9110-4f62-8f0f-7c18ef0baf44 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:10.759423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07fed7-a6d3-4b09-a406-9f7dfc86a171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:10.760020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07fed7-a6d3-4b09-a406-9f7dfc86a171 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:10.760351 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07fed7-a6d3-4b09-a406-9f7dfc86a171 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:10.760669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07fed7-a6d3-4b09-a406-9f7dfc86a171 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:10.767664 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07fed7-a6d3-4b09-a406-9f7dfc86a171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:10.767664 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07fed7-a6d3-4b09-a406-9f7dfc86a171 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:10.772818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1199/2408] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:55:10.777293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43262554-5353-4094-9ea3-d153f9c02b93 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:10.787154 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43262554-5353-4094-9ea3-d153f9c02b93 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:10.792421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636e527-c451-4275-93b7-cd890056a93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:10.793010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636e527-c451-4275-93b7-cd890056a93c admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:10.793292 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636e527-c451-4275-93b7-cd890056a93c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:10.793566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636e527-c451-4275-93b7-cd890056a93c admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:10.794212 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636e527-c451-4275-93b7-cd890056a93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:10.795813 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636e527-c451-4275-93b7-cd890056a93c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:10.806483 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1210/2409] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:55:10.810559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07fed7-a6d3-4b09-a406-9f7dfc86a171 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:10.820821 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07fed7-a6d3-4b09-a406-9f7dfc86a171 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:10.827193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610e5f9-318d-46d8-ab12-a257c6b35706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:10.827193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610e5f9-318d-46d8-ab12-a257c6b35706 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:10.827193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610e5f9-318d-46d8-ab12-a257c6b35706 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:10.827193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610e5f9-318d-46d8-ab12-a257c6b35706 admin admin] PATH_INFO: `/v3/projects/2593bbcc161e4c24ad6e7ef0094b67e7/users/1d73958b5e2d43ecad929b9720889cfe/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:10.841924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610e5f9-318d-46d8-ab12-a257c6b35706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2593bbcc161e4c24ad6e7ef0094b67e7, user_id=1d73958b5e2d43ecad929b9720889cfe, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:10.844766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610e5f9-318d-46d8-ab12-a257c6b35706 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:10.917341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1200/2410] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:55:10 2022] PUT /identity/v3/projects/2593bbcc161e4c24ad6e7ef0094b67e7/users/1d73958b5e2d43ecad929b9720889cfe/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:55:10.922427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1750486-9331-4078-9702-a7a7cc78a57c None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:10.922715 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1750486-9331-4078-9702-a7a7cc78a57c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:10.923010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1750486-9331-4078-9702-a7a7cc78a57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:10.942032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-a1750486-9331-4078-9702-a7a7cc78a57c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:10.943236 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a1750486-9331-4078-9702-a7a7cc78a57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:11.004885 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1211/2411] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:11.016781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610e5f9-318d-46d8-ab12-a257c6b35706 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:11.018640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-c610e5f9-318d-46d8-ab12-a257c6b35706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:11.079675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610e5f9-318d-46d8-ab12-a257c6b35706 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:11.083430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc462f5-264b-46ce-98c5-db20afec9a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:11.084037 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc462f5-264b-46ce-98c5-db20afec9a8e service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:11.084345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc462f5-264b-46ce-98c5-db20afec9a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:11.084623 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc462f5-264b-46ce-98c5-db20afec9a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:11.094074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc462f5-264b-46ce-98c5-db20afec9a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:11.095572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc462f5-264b-46ce-98c5-db20afec9a8e service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:11.105902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1201/2412] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:55:16.348552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade2526-a6e8-4534-86bf-dc35cb78c622 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:16.349435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade2526-a6e8-4534-86bf-dc35cb78c622 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:16.349435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade2526-a6e8-4534-86bf-dc35cb78c622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:16.391410 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-2ade2526-a6e8-4534-86bf-dc35cb78c622 None None] MFA Rules not processed for user `1d73958b5e2d43ecad929b9720889cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:16.392873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2ade2526-a6e8-4534-86bf-dc35cb78c622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:16.467807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1212/2413] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:55:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:16.484274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc462f5-264b-46ce-98c5-db20afec9a8e service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:16.485735 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-cbc462f5-264b-46ce-98c5-db20afec9a8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:16.563343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc462f5-264b-46ce-98c5-db20afec9a8e service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:16.568943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaaca3-3d14-4aa4-9c0c-4ffd8d053843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:16.569771 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaaca3-3d14-4aa4-9c0c-4ffd8d053843 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:16.569887 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaaca3-3d14-4aa4-9c0c-4ffd8d053843 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:16.570070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaaca3-3d14-4aa4-9c0c-4ffd8d053843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:16.578874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaaca3-3d14-4aa4-9c0c-4ffd8d053843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:16.580503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaaca3-3d14-4aa4-9c0c-4ffd8d053843 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:16.590390 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1202/2414] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:18.952793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e959dad-cc78-4ff0-bf51-28a713d8a8a1 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:18.953278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e959dad-cc78-4ff0-bf51-28a713d8a8a1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:18.953399 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e959dad-cc78-4ff0-bf51-28a713d8a8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:18.972911 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-0e959dad-cc78-4ff0-bf51-28a713d8a8a1 None None] MFA Rules not processed for user `1d73958b5e2d43ecad929b9720889cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:18.974468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0e959dad-cc78-4ff0-bf51-28a713d8a8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:18.988624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1213/2415] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:55:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:19.312718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaaca3-3d14-4aa4-9c0c-4ffd8d053843 service nova] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:19.322901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaaca3-3d14-4aa4-9c0c-4ffd8d053843 service nova] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:19.326770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c8468-b5dd-45be-b7e0-8154e689bf5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:19.327379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c8468-b5dd-45be-b7e0-8154e689bf5a service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:19.327759 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c8468-b5dd-45be-b7e0-8154e689bf5a service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:19.328043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c8468-b5dd-45be-b7e0-8154e689bf5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:19.330001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8b1c8468-b5dd-45be-b7e0-8154e689bf5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:19.341831 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c8468-b5dd-45be-b7e0-8154e689bf5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:19.343419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c8468-b5dd-45be-b7e0-8154e689bf5a service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:19.349527 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:19.354579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1203/2416] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:19.775902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e959dad-cc78-4ff0-bf51-28a713d8a8a1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:19.777547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0e959dad-cc78-4ff0-bf51-28a713d8a8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:19.867180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:19.876528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e959dad-cc78-4ff0-bf51-28a713d8a8a1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:19.884222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862cb91-688d-48aa-9292-1d0549eb0e3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2991c613878e4993901199434f384f49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:19.885207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862cb91-688d-48aa-9292-1d0549eb0e3b service placement] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:19.885391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862cb91-688d-48aa-9292-1d0549eb0e3b service placement] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:19.885652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862cb91-688d-48aa-9292-1d0549eb0e3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:19.887468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f862cb91-688d-48aa-9292-1d0549eb0e3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:19.902246 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862cb91-688d-48aa-9292-1d0549eb0e3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:19.903966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862cb91-688d-48aa-9292-1d0549eb0e3b service placement] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:19.931325 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1214/2417] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:21.932603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af337a-8d0c-4b77-946f-19bbb2e81697 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:21.935642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af337a-8d0c-4b77-946f-19bbb2e81697 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:21.935642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af337a-8d0c-4b77-946f-19bbb2e81697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:21.960747 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-01af337a-8d0c-4b77-946f-19bbb2e81697 None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:21.961896 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-01af337a-8d0c-4b77-946f-19bbb2e81697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:22.033367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1204/2418] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 29 22:55:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:22.180060 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862cb91-688d-48aa-9292-1d0549eb0e3b service placement] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:22.182280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f862cb91-688d-48aa-9292-1d0549eb0e3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:22.281107 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862cb91-688d-48aa-9292-1d0549eb0e3b service placement] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:22.286344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1e66c-e119-4ad4-be45-ef082da371ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:22.287000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1e66c-e119-4ad4-be45-ef082da371ca service swift] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:22.287285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1e66c-e119-4ad4-be45-ef082da371ca service swift] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:22.287577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1e66c-e119-4ad4-be45-ef082da371ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:22.298747 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1e66c-e119-4ad4-be45-ef082da371ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:22.298972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1e66c-e119-4ad4-be45-ef082da371ca service swift] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:22.310758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1215/2419] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:55:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:55:23.384339 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af337a-8d0c-4b77-946f-19bbb2e81697 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:23.395240 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af337a-8d0c-4b77-946f-19bbb2e81697 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:23.403484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea903f-fbd6-4709-b880-e6bf05e771cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:23.404360 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea903f-fbd6-4709-b880-e6bf05e771cf service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:23.404827 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea903f-fbd6-4709-b880-e6bf05e771cf service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:23.405243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea903f-fbd6-4709-b880-e6bf05e771cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:23.410026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-81ea903f-fbd6-4709-b880-e6bf05e771cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:23.425718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea903f-fbd6-4709-b880-e6bf05e771cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:23.433640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea903f-fbd6-4709-b880-e6bf05e771cf service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:23.436566 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1205/2420] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:55:24.349995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1e66c-e119-4ad4-be45-ef082da371ca service swift] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:24.351577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f2f1e66c-e119-4ad4-be45-ef082da371ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:24.372122 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1e66c-e119-4ad4-be45-ef082da371ca service swift] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:24.381421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534087b3-b4c1-4a65-80c8-62f7285244a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:24.383016 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534087b3-b4c1-4a65-80c8-62f7285244a2 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:24.384269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534087b3-b4c1-4a65-80c8-62f7285244a2 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:24.384827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534087b3-b4c1-4a65-80c8-62f7285244a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:24.388299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-534087b3-b4c1-4a65-80c8-62f7285244a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:24.403585 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534087b3-b4c1-4a65-80c8-62f7285244a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:24.405229 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534087b3-b4c1-4a65-80c8-62f7285244a2 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:24.428055 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1216/2421] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:33.432411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=31 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:34.360953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea903f-fbd6-4709-b880-e6bf05e771cf service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:34.376635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea903f-fbd6-4709-b880-e6bf05e771cf service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:34.382320 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe4cc5-a523-477d-9db4-525236211af4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:34.382943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe4cc5-a523-477d-9db4-525236211af4 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:34.383225 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe4cc5-a523-477d-9db4-525236211af4 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:34.383504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe4cc5-a523-477d-9db4-525236211af4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:34.385925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-abfe4cc5-a523-477d-9db4-525236211af4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:34.398356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe4cc5-a523-477d-9db4-525236211af4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:34.399951 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe4cc5-a523-477d-9db4-525236211af4 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:34.410546 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1206/2422] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:34.414110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=42 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:35.591432 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534087b3-b4c1-4a65-80c8-62f7285244a2 service nova] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:35.602687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534087b3-b4c1-4a65-80c8-62f7285244a2 service nova] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:35.608248 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad19758-6906-48d4-aecf-8d04a5c10cca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:35.608848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad19758-6906-48d4-aecf-8d04a5c10cca service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:35.609128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad19758-6906-48d4-aecf-8d04a5c10cca service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:35.609404 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad19758-6906-48d4-aecf-8d04a5c10cca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:35.611159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0ad19758-6906-48d4-aecf-8d04a5c10cca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:35.673399 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad19758-6906-48d4-aecf-8d04a5c10cca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:35.675278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad19758-6906-48d4-aecf-8d04a5c10cca service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:35.685152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1217/2423] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:35.728930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe4cc5-a523-477d-9db4-525236211af4 service nova] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:35.741751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe4cc5-a523-477d-9db4-525236211af4 service nova] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:35.748451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2d497-526d-4e78-9ce0-46bda4922296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:35.749066 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2d497-526d-4e78-9ce0-46bda4922296 service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:35.749442 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2d497-526d-4e78-9ce0-46bda4922296 service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:35.751808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2d497-526d-4e78-9ce0-46bda4922296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:35.751808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-63f2d497-526d-4e78-9ce0-46bda4922296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:35.765391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2d497-526d-4e78-9ce0-46bda4922296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:35.769056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2d497-526d-4e78-9ce0-46bda4922296 service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:35.778416 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1207/2424] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:43.662138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994ebb6-de6d-4648-b5a5-7fbe19f05c1c None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:43.662618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994ebb6-de6d-4648-b5a5-7fbe19f05c1c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:43.662712 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994ebb6-de6d-4648-b5a5-7fbe19f05c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:43.683238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-d994ebb6-de6d-4648-b5a5-7fbe19f05c1c None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:43.684527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d994ebb6-de6d-4648-b5a5-7fbe19f05c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:43.691624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1218/2425] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 29 22:55:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:43.703531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2d497-526d-4e78-9ce0-46bda4922296 service nova] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:43.714684 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2d497-526d-4e78-9ce0-46bda4922296 service nova] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:43.719656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33936f03-9abe-4dfc-814c-9f55fe7e161c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:43.720299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33936f03-9abe-4dfc-814c-9f55fe7e161c service swift] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:43.720583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33936f03-9abe-4dfc-814c-9f55fe7e161c service swift] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:43.720854 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33936f03-9abe-4dfc-814c-9f55fe7e161c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:43.729265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33936f03-9abe-4dfc-814c-9f55fe7e161c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:43.730818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33936f03-9abe-4dfc-814c-9f55fe7e161c service swift] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:43.738787 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1208/2426] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:55:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:55:53.677054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=31 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:53.735656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=18 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:57.898809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee0fed-ac8e-416f-a3b6-e0774f8a2391 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:57.899317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee0fed-ac8e-416f-a3b6-e0774f8a2391 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:57.899457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee0fed-ac8e-416f-a3b6-e0774f8a2391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:57.920752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-12ee0fed-ac8e-416f-a3b6-e0774f8a2391 None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:57.921980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-12ee0fed-ac8e-416f-a3b6-e0774f8a2391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:57.929866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1219/2427] 10.222.0.62 () {58 vars in 967 bytes} [Mon Aug 29 22:55:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:57.942630 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33936f03-9abe-4dfc-814c-9f55fe7e161c service swift] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:57.953881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33936f03-9abe-4dfc-814c-9f55fe7e161c service swift] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:57.959485 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6a2d8-5270-41ee-aec7-1842d05f665d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:57.963015 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6a2d8-5270-41ee-aec7-1842d05f665d service swift] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:57.963015 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6a2d8-5270-41ee-aec7-1842d05f665d service swift] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:57.963015 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6a2d8-5270-41ee-aec7-1842d05f665d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:57.971166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6a2d8-5270-41ee-aec7-1842d05f665d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:57.973053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6a2d8-5270-41ee-aec7-1842d05f665d service swift] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:57.985929 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1209/2428] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:55:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:56:00.359210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee0fed-ac8e-416f-a3b6-e0774f8a2391 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:00.368968 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee0fed-ac8e-416f-a3b6-e0774f8a2391 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:00.372484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c4df2-9f6a-4e9c-aef6-031a00771a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:00.373096 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c4df2-9f6a-4e9c-aef6-031a00771a56 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:00.373373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c4df2-9f6a-4e9c-aef6-031a00771a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:00.373645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c4df2-9f6a-4e9c-aef6-031a00771a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:00.375383 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-415c4df2-9f6a-4e9c-aef6-031a00771a56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:00.387226 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c4df2-9f6a-4e9c-aef6-031a00771a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:00.388677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c4df2-9f6a-4e9c-aef6-031a00771a56 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:00.397964 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1220/2429] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:03.797907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6a2d8-5270-41ee-aec7-1842d05f665d service swift] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:03.810306 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6a2d8-5270-41ee-aec7-1842d05f665d service swift] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:03.815880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353cbce-f40d-42bb-8578-6d8cf591f9d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2991c613878e4993901199434f384f49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:03.816679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353cbce-f40d-42bb-8578-6d8cf591f9d3 service placement] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:03.816968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353cbce-f40d-42bb-8578-6d8cf591f9d3 service placement] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:03.817239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353cbce-f40d-42bb-8578-6d8cf591f9d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:03.818972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5353cbce-f40d-42bb-8578-6d8cf591f9d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:03.831384 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353cbce-f40d-42bb-8578-6d8cf591f9d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:03.833020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353cbce-f40d-42bb-8578-6d8cf591f9d3 service placement] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:03.843661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1210/2430] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:03.948680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c4df2-9f6a-4e9c-aef6-031a00771a56 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:03.948680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-415c4df2-9f6a-4e9c-aef6-031a00771a56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:03.960318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c4df2-9f6a-4e9c-aef6-031a00771a56 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:03.965213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3434440-eaea-4370-b340-e9e8d3e036a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:03.965887 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3434440-eaea-4370-b340-e9e8d3e036a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:03.966148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3434440-eaea-4370-b340-e9e8d3e036a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:03.966424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3434440-eaea-4370-b340-e9e8d3e036a4 admin admin] PATH_INFO: `/v3/users/702f1e3b8d0342fc999f63d701bc4772` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:03.967548 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3434440-eaea-4370-b340-e9e8d3e036a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=702f1e3b8d0342fc999f63d701bc4772)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:03.969491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3434440-eaea-4370-b340-e9e8d3e036a4 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:04.107779 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e3434440-eaea-4370-b340-e9e8d3e036a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702f1e3b8d0342fc999f63d701bc4772'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:04.113835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e3434440-eaea-4370-b340-e9e8d3e036a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702f1e3b8d0342fc999f63d701bc4772'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:04.178525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e3434440-eaea-4370-b340-e9e8d3e036a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702f1e3b8d0342fc999f63d701bc4772'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:04.179182 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e3434440-eaea-4370-b340-e9e8d3e036a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702f1e3b8d0342fc999f63d701bc4772'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:04.191517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e3434440-eaea-4370-b340-e9e8d3e036a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702f1e3b8d0342fc999f63d701bc4772'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:04.203939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1221/2431] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:03 2022] DELETE /identity/v3/users/702f1e3b8d0342fc999f63d701bc4772 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:04.448900 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353cbce-f40d-42bb-8578-6d8cf591f9d3 service placement] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:04.459626 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353cbce-f40d-42bb-8578-6d8cf591f9d3 service placement] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:04.518469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bf73f-88e5-4bfc-b765-8bf4a9e5bb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:04.519103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bf73f-88e5-4bfc-b765-8bf4a9e5bb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:04.519386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bf73f-88e5-4bfc-b765-8bf4a9e5bb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:04.519663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bf73f-88e5-4bfc-b765-8bf4a9e5bb83 admin admin] PATH_INFO: `/v3/projects/4ccbcc79b7424deaa55628532129cfe4` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:04.520872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bf73f-88e5-4bfc-b765-8bf4a9e5bb83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ccbcc79b7424deaa55628532129cfe4)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:04.522782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bf73f-88e5-4bfc-b765-8bf4a9e5bb83 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:04.659247 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5c1bf73f-88e5-4bfc-b765-8bf4a9e5bb83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ccbcc79b7424deaa55628532129cfe4', 'request_id': 'req-5c1bf73f-88e5-4bfc-b765-8bf4a9e5bb83'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:04.733010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5c1bf73f-88e5-4bfc-b765-8bf4a9e5bb83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ccbcc79b7424deaa55628532129cfe4', 'request_id': 'req-5c1bf73f-88e5-4bfc-b765-8bf4a9e5bb83'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:04.739011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5c1bf73f-88e5-4bfc-b765-8bf4a9e5bb83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ccbcc79b7424deaa55628532129cfe4', 'request_id': 'req-5c1bf73f-88e5-4bfc-b765-8bf4a9e5bb83'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:04.751750 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5c1bf73f-88e5-4bfc-b765-8bf4a9e5bb83 admin admin] The token cache is being invalidate because project 4ccbcc79b7424deaa55628532129cfe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:04.759352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5c1bf73f-88e5-4bfc-b765-8bf4a9e5bb83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:04.759352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5c1bf73f-88e5-4bfc-b765-8bf4a9e5bb83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:04.759352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1211/2432] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:04 2022] DELETE /identity/v3/projects/4ccbcc79b7424deaa55628532129cfe4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:04.759620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db1c94-c48c-4a13-8ad7-f00e783fc4f5 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:04.759620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db1c94-c48c-4a13-8ad7-f00e783fc4f5 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:04.759620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db1c94-c48c-4a13-8ad7-f00e783fc4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:04.779738 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-04db1c94-c48c-4a13-8ad7-f00e783fc4f5 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:04.780994 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-04db1c94-c48c-4a13-8ad7-f00e783fc4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:04.839625 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1222/2433] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:04.848172 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f9db3-d02e-44e6-8d57-ced39cbabc01 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:04.848639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f9db3-d02e-44e6-8d57-ced39cbabc01 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:04.848756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f9db3-d02e-44e6-8d57-ced39cbabc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:04.869480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-8e7f9db3-d02e-44e6-8d57-ced39cbabc01 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:04.870680 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8e7f9db3-d02e-44e6-8d57-ced39cbabc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:04.878437 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1212/2434] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:04.882484 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db1c94-c48c-4a13-8ad7-f00e783fc4f5 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:04.892287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db1c94-c48c-4a13-8ad7-f00e783fc4f5 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:04.896824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db5cfc-7c24-4753-934f-8188d0bcd996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:04.897411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db5cfc-7c24-4753-934f-8188d0bcd996 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:04.897687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db5cfc-7c24-4753-934f-8188d0bcd996 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:04.897958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db5cfc-7c24-4753-934f-8188d0bcd996 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:04.898603 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db5cfc-7c24-4753-934f-8188d0bcd996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:56:04.899391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db5cfc-7c24-4753-934f-8188d0bcd996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:04.901029 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db5cfc-7c24-4753-934f-8188d0bcd996 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:04.912228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1223/2435] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:56:04.917131 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f9db3-d02e-44e6-8d57-ced39cbabc01 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:04.926577 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f9db3-d02e-44e6-8d57-ced39cbabc01 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:04.931156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b6706-efcc-436e-a6b1-30a3590ce0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:04.931746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b6706-efcc-436e-a6b1-30a3590ce0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:04.932026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b6706-efcc-436e-a6b1-30a3590ce0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:04.932336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b6706-efcc-436e-a6b1-30a3590ce0d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:04.932956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b6706-efcc-436e-a6b1-30a3590ce0d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:04.934839 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b6706-efcc-436e-a6b1-30a3590ce0d1 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:05.019630 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1213/2436] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:04 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:05.023541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db5cfc-7c24-4753-934f-8188d0bcd996 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:05.033999 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db5cfc-7c24-4753-934f-8188d0bcd996 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:05.071898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:05.092067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4b353-7b66-45c9-bcff-a89a5990315b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:05.092628 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4b353-7b66-45c9-bcff-a89a5990315b admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:05.092911 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4b353-7b66-45c9-bcff-a89a5990315b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:05.093188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4b353-7b66-45c9-bcff-a89a5990315b admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:05.093822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4b353-7b66-45c9-bcff-a89a5990315b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:05.095933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4b353-7b66-45c9-bcff-a89a5990315b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:05.196777 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1224/2437] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:05 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:05.200900 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b6706-efcc-436e-a6b1-30a3590ce0d1 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:05.212640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b6706-efcc-436e-a6b1-30a3590ce0d1 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:05.217439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92c542-e0c0-4a27-9e35-5ecb779452bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:05.218177 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92c542-e0c0-4a27-9e35-5ecb779452bc admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:05.218453 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92c542-e0c0-4a27-9e35-5ecb779452bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:05.218851 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92c542-e0c0-4a27-9e35-5ecb779452bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:05.219460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92c542-e0c0-4a27-9e35-5ecb779452bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:05.221072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92c542-e0c0-4a27-9e35-5ecb779452bc admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:05.232254 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1214/2438] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:05.236543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4b353-7b66-45c9-bcff-a89a5990315b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:05.247068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4b353-7b66-45c9-bcff-a89a5990315b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:05.252019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5d2b0-3cf9-4818-87c7-6efaaabf1f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:05.252674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5d2b0-3cf9-4818-87c7-6efaaabf1f24 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:05.252954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5d2b0-3cf9-4818-87c7-6efaaabf1f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:05.253230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5d2b0-3cf9-4818-87c7-6efaaabf1f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:05.253885 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5d2b0-3cf9-4818-87c7-6efaaabf1f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:05.255564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5d2b0-3cf9-4818-87c7-6efaaabf1f24 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:05.266180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1225/2439] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:05.270629 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92c542-e0c0-4a27-9e35-5ecb779452bc admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:05.281286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92c542-e0c0-4a27-9e35-5ecb779452bc admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:05.285926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a23ccf-3f68-43fa-b860-711aaf607c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:05.286568 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a23ccf-3f68-43fa-b860-711aaf607c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:05.286846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a23ccf-3f68-43fa-b860-711aaf607c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:05.287118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a23ccf-3f68-43fa-b860-711aaf607c5a admin admin] PATH_INFO: `/v3/projects/71d553d9c7204e17be8bdc1fc07c7b48/users/1fe9d614593f4e0296042da5442d6dc3/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:05.301690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a23ccf-3f68-43fa-b860-711aaf607c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d553d9c7204e17be8bdc1fc07c7b48, user_id=1fe9d614593f4e0296042da5442d6dc3, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:05.304397 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a23ccf-3f68-43fa-b860-711aaf607c5a admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:05.379844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:05.385042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1215/2440] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:05 2022] PUT /identity/v3/projects/71d553d9c7204e17be8bdc1fc07c7b48/users/1fe9d614593f4e0296042da5442d6dc3/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:05.395482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8441f-ccd7-4c93-8a43-7b0eeea56dc4 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:05.395864 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8441f-ccd7-4c93-8a43-7b0eeea56dc4 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:05.396276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8441f-ccd7-4c93-8a43-7b0eeea56dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:05.424700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-3cb8441f-ccd7-4c93-8a43-7b0eeea56dc4 None None] MFA Rules not processed for user `1fe9d614593f4e0296042da5442d6dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:05.426268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-3cb8441f-ccd7-4c93-8a43-7b0eeea56dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:05.490185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1226/2441] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:05.494901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a23ccf-3f68-43fa-b860-711aaf607c5a admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:05.561351 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a23ccf-3f68-43fa-b860-711aaf607c5a admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:05.566062 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac4af7-1acd-496b-8422-e528680b63fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:05.566653 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac4af7-1acd-496b-8422-e528680b63fb admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:05.566930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac4af7-1acd-496b-8422-e528680b63fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:05.567201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac4af7-1acd-496b-8422-e528680b63fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:05.567826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac4af7-1acd-496b-8422-e528680b63fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:05.569742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac4af7-1acd-496b-8422-e528680b63fb admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:05.683602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1216/2442] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:05 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:05.687635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8441f-ccd7-4c93-8a43-7b0eeea56dc4 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:05.699004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8441f-ccd7-4c93-8a43-7b0eeea56dc4 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:05.753660 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167c3d3-9688-4a91-b19c-2732a08aed45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:05.754260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167c3d3-9688-4a91-b19c-2732a08aed45 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:05.754542 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167c3d3-9688-4a91-b19c-2732a08aed45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:05.754823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167c3d3-9688-4a91-b19c-2732a08aed45 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:05.755443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167c3d3-9688-4a91-b19c-2732a08aed45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:05.757424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167c3d3-9688-4a91-b19c-2732a08aed45 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:05.834819 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1227/2443] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:05 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:05.838776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac4af7-1acd-496b-8422-e528680b63fb admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:05.848980 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac4af7-1acd-496b-8422-e528680b63fb admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:05.853546 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047ebaa-8354-49ac-8454-07218f864ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:05.854132 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047ebaa-8354-49ac-8454-07218f864ffb admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:05.854410 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047ebaa-8354-49ac-8454-07218f864ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:05.854680 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047ebaa-8354-49ac-8454-07218f864ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:05.855319 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047ebaa-8354-49ac-8454-07218f864ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:05.856933 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047ebaa-8354-49ac-8454-07218f864ffb admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:05.867232 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1217/2444] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:05.872256 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167c3d3-9688-4a91-b19c-2732a08aed45 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:05.882192 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167c3d3-9688-4a91-b19c-2732a08aed45 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:05.887776 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc4376-dbdd-48f8-940f-c1bae0667c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:05.888458 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc4376-dbdd-48f8-940f-c1bae0667c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:05.888764 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc4376-dbdd-48f8-940f-c1bae0667c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:05.889037 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc4376-dbdd-48f8-940f-c1bae0667c2b admin admin] PATH_INFO: `/v3/projects/1845a11f2e184b24b9067c8a37c49bee/users/95860bb18d8a46c696d1e884acd372d1/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:05.903941 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc4376-dbdd-48f8-940f-c1bae0667c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1845a11f2e184b24b9067c8a37c49bee, user_id=95860bb18d8a46c696d1e884acd372d1, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:05.906647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc4376-dbdd-48f8-940f-c1bae0667c2b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:05.954983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1228/2445] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:05 2022] PUT /identity/v3/projects/1845a11f2e184b24b9067c8a37c49bee/users/95860bb18d8a46c696d1e884acd372d1/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:05.958976 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047ebaa-8354-49ac-8454-07218f864ffb admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:05.969843 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047ebaa-8354-49ac-8454-07218f864ffb admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:06.026647 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b644e-649e-433e-831c-62541414c4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:06.027250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b644e-649e-433e-831c-62541414c4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:06.027531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b644e-649e-433e-831c-62541414c4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:06.027806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b644e-649e-433e-831c-62541414c4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:06.028476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b644e-649e-433e-831c-62541414c4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:06.030053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b644e-649e-433e-831c-62541414c4e9 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:06.040071 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1218/2446] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:06.044389 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc4376-dbdd-48f8-940f-c1bae0667c2b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:06.055092 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc4376-dbdd-48f8-940f-c1bae0667c2b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:06.060487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e9655-41c8-4a7f-af6a-e7487320b3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:06.061212 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e9655-41c8-4a7f-af6a-e7487320b3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:06.061564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e9655-41c8-4a7f-af6a-e7487320b3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:06.061942 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e9655-41c8-4a7f-af6a-e7487320b3bb admin admin] PATH_INFO: `/v3/projects/1845a11f2e184b24b9067c8a37c49bee/users/95860bb18d8a46c696d1e884acd372d1/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:06.064287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e9655-41c8-4a7f-af6a-e7487320b3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1845a11f2e184b24b9067c8a37c49bee, user_id=95860bb18d8a46c696d1e884acd372d1, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:06.067049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e9655-41c8-4a7f-af6a-e7487320b3bb admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:06.073528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:06.078681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1229/2447] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:06 2022] PUT /identity/v3/projects/1845a11f2e184b24b9067c8a37c49bee/users/95860bb18d8a46c696d1e884acd372d1/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:06.089322 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d2679-0d60-4eba-881d-d4768d2a321f None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:06.089635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d2679-0d60-4eba-881d-d4768d2a321f None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:06.089937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d2679-0d60-4eba-881d-d4768d2a321f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:06.118463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-553d2679-0d60-4eba-881d-d4768d2a321f None None] MFA Rules not processed for user `95860bb18d8a46c696d1e884acd372d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:06.119682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-553d2679-0d60-4eba-881d-d4768d2a321f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:06.179110 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:06.188794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1219/2448] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:06.200221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e9655-41c8-4a7f-af6a-e7487320b3bb admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:06.201964 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2c4e9655-41c8-4a7f-af6a-e7487320b3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:06.259661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e9655-41c8-4a7f-af6a-e7487320b3bb admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:06.263233 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7fe08-2aaa-41da-b636-b1de9aa3e429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:06.263831 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7fe08-2aaa-41da-b636-b1de9aa3e429 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:06.264199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7fe08-2aaa-41da-b636-b1de9aa3e429 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:06.264477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7fe08-2aaa-41da-b636-b1de9aa3e429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:06.273363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7fe08-2aaa-41da-b636-b1de9aa3e429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:06.275520 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7fe08-2aaa-41da-b636-b1de9aa3e429 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:06.285179 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1230/2449] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:06.466640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d2679-0d60-4eba-881d-d4768d2a321f None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:06.476225 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d2679-0d60-4eba-881d-d4768d2a321f None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:06.480573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e71671-8238-4a8a-8064-0492dad1d168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:06.481167 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e71671-8238-4a8a-8064-0492dad1d168 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:06.481446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e71671-8238-4a8a-8064-0492dad1d168 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:06.481717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e71671-8238-4a8a-8064-0492dad1d168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:06.538376 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e71671-8238-4a8a-8064-0492dad1d168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:06.540461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e71671-8238-4a8a-8064-0492dad1d168 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:06.549648 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1220/2450] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:14.703980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7fe08-2aaa-41da-b636-b1de9aa3e429 service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:14.766470 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7fe08-2aaa-41da-b636-b1de9aa3e429 service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:14.771028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307a12a-44e2-438a-b2e0-6b872543f889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:14.771655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307a12a-44e2-438a-b2e0-6b872543f889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:14.771937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307a12a-44e2-438a-b2e0-6b872543f889 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:14.772249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307a12a-44e2-438a-b2e0-6b872543f889 admin admin] PATH_INFO: `/v3/users/1fe9d614593f4e0296042da5442d6dc3` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:14.773371 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307a12a-44e2-438a-b2e0-6b872543f889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe9d614593f4e0296042da5442d6dc3)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:14.775349 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307a12a-44e2-438a-b2e0-6b872543f889 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:14.929251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f307a12a-44e2-438a-b2e0-6b872543f889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe9d614593f4e0296042da5442d6dc3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:14.930551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f307a12a-44e2-438a-b2e0-6b872543f889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe9d614593f4e0296042da5442d6dc3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:14.989526 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f307a12a-44e2-438a-b2e0-6b872543f889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe9d614593f4e0296042da5442d6dc3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:14.990196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f307a12a-44e2-438a-b2e0-6b872543f889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe9d614593f4e0296042da5442d6dc3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:15.006139 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f307a12a-44e2-438a-b2e0-6b872543f889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe9d614593f4e0296042da5442d6dc3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:15.019219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1231/2451] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:14 2022] DELETE /identity/v3/users/1fe9d614593f4e0296042da5442d6dc3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:15.024262 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadaee5-7e5d-40a7-ba07-374aa9810f44 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:15.024765 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadaee5-7e5d-40a7-ba07-374aa9810f44 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:15.024869 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadaee5-7e5d-40a7-ba07-374aa9810f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:15.047574 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-4fadaee5-7e5d-40a7-ba07-374aa9810f44 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:15.048913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-4fadaee5-7e5d-40a7-ba07-374aa9810f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:15.109577 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1221/2452] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:15.120506 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307a12a-44e2-438a-b2e0-6b872543f889 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:15.122075 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f307a12a-44e2-438a-b2e0-6b872543f889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:15.148904 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:15.181939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307a12a-44e2-438a-b2e0-6b872543f889 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:15.185811 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b025057-9080-4e6d-9492-797a39409d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:15.186451 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b025057-9080-4e6d-9492-797a39409d3f service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:15.186759 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b025057-9080-4e6d-9492-797a39409d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:15.187037 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b025057-9080-4e6d-9492-797a39409d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:15.196877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b025057-9080-4e6d-9492-797a39409d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:15.200862 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b025057-9080-4e6d-9492-797a39409d3f service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:15.208319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1232/2453] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:15.769027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadaee5-7e5d-40a7-ba07-374aa9810f44 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:15.770458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-4fadaee5-7e5d-40a7-ba07-374aa9810f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:15.784549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadaee5-7e5d-40a7-ba07-374aa9810f44 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:15.789402 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:15.790125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:15.790478 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:15.790822 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214 admin admin] PATH_INFO: `/v3/projects/71d553d9c7204e17be8bdc1fc07c7b48` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:15.793223 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d553d9c7204e17be8bdc1fc07c7b48)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:15.795291 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:15.915447 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d553d9c7204e17be8bdc1fc07c7b48', 'request_id': 'req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:16.012525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d553d9c7204e17be8bdc1fc07c7b48', 'request_id': 'req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:16.018758 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d553d9c7204e17be8bdc1fc07c7b48', 'request_id': 'req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:16.030695 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214 admin admin] The token cache is being invalidate because project 71d553d9c7204e17be8bdc1fc07c7b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:16.031261 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:16.031658 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:16.033385 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1222/2454] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:15 2022] DELETE /identity/v3/projects/71d553d9c7204e17be8bdc1fc07c7b48 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:16.037650 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b025057-9080-4e6d-9492-797a39409d3f service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:16.047388 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b025057-9080-4e6d-9492-797a39409d3f service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:16.111766 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d612f0e-13a7-44cc-9a92-2c790fcf7406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:16.112573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d612f0e-13a7-44cc-9a92-2c790fcf7406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:16.112680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d612f0e-13a7-44cc-9a92-2c790fcf7406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:16.112964 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d612f0e-13a7-44cc-9a92-2c790fcf7406 admin admin] PATH_INFO: `/v3/users/95860bb18d8a46c696d1e884acd372d1` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:16.114107 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d612f0e-13a7-44cc-9a92-2c790fcf7406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95860bb18d8a46c696d1e884acd372d1)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:16.116046 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d612f0e-13a7-44cc-9a92-2c790fcf7406 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:16.346203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7d612f0e-13a7-44cc-9a92-2c790fcf7406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95860bb18d8a46c696d1e884acd372d1'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:16.346866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7d612f0e-13a7-44cc-9a92-2c790fcf7406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95860bb18d8a46c696d1e884acd372d1'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:16.435283 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7d612f0e-13a7-44cc-9a92-2c790fcf7406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95860bb18d8a46c696d1e884acd372d1'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:16.435946 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7d612f0e-13a7-44cc-9a92-2c790fcf7406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95860bb18d8a46c696d1e884acd372d1'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:16.448485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-7d612f0e-13a7-44cc-9a92-2c790fcf7406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95860bb18d8a46c696d1e884acd372d1'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:16.460769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1233/2455] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:16 2022] DELETE /identity/v3/users/95860bb18d8a46c696d1e884acd372d1 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:16.882585 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:16.884128 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:16.897691 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e439a3e-7dc1-44cd-bd27-b56f8a70d214 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:16.911442 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:16.957596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b6d7e-ec4c-4069-930c-6137a2da5a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:16.958228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b6d7e-ec4c-4069-930c-6137a2da5a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:16.958509 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b6d7e-ec4c-4069-930c-6137a2da5a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:16.958784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b6d7e-ec4c-4069-930c-6137a2da5a2a admin admin] PATH_INFO: `/v3/projects/1845a11f2e184b24b9067c8a37c49bee` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:16.959902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b6d7e-ec4c-4069-930c-6137a2da5a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1845a11f2e184b24b9067c8a37c49bee)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:16.962417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b6d7e-ec4c-4069-930c-6137a2da5a2a admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:17.093655 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5f2b6d7e-ec4c-4069-930c-6137a2da5a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1845a11f2e184b24b9067c8a37c49bee', 'request_id': 'req-5f2b6d7e-ec4c-4069-930c-6137a2da5a2a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:17.155527 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5f2b6d7e-ec4c-4069-930c-6137a2da5a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1845a11f2e184b24b9067c8a37c49bee', 'request_id': 'req-5f2b6d7e-ec4c-4069-930c-6137a2da5a2a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:17.161512 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5f2b6d7e-ec4c-4069-930c-6137a2da5a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1845a11f2e184b24b9067c8a37c49bee', 'request_id': 'req-5f2b6d7e-ec4c-4069-930c-6137a2da5a2a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:17.173836 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5f2b6d7e-ec4c-4069-930c-6137a2da5a2a admin admin] The token cache is being invalidate because project 1845a11f2e184b24b9067c8a37c49bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:17.174129 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5f2b6d7e-ec4c-4069-930c-6137a2da5a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:17.174803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-5f2b6d7e-ec4c-4069-930c-6137a2da5a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:17.176925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1223/2456] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:16 2022] DELETE /identity/v3/projects/1845a11f2e184b24b9067c8a37c49bee => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:17.181924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d073d9a-92e3-4e0f-ba02-94269d4aa035 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:17.182468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d073d9a-92e3-4e0f-ba02-94269d4aa035 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:17.182781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d073d9a-92e3-4e0f-ba02-94269d4aa035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:17.205098 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-2d073d9a-92e3-4e0f-ba02-94269d4aa035 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:17.206344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2d073d9a-92e3-4e0f-ba02-94269d4aa035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:17.251179 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:17.271086 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1234/2457] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:17.279705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdbc46-ba2c-4813-9615-c07ecffa29f5 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:17.279984 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdbc46-ba2c-4813-9615-c07ecffa29f5 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:17.280292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdbc46-ba2c-4813-9615-c07ecffa29f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:17.301239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-e2fdbc46-ba2c-4813-9615-c07ecffa29f5 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:17.302455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e2fdbc46-ba2c-4813-9615-c07ecffa29f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:17.310671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1224/2458] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:56:17.315065 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d073d9a-92e3-4e0f-ba02-94269d4aa035 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:17.325661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d073d9a-92e3-4e0f-ba02-94269d4aa035 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:17.330493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8a42a-d938-443c-8e25-d129c4f7c0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:17.331117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8a42a-d938-443c-8e25-d129c4f7c0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:17.331382 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8a42a-d938-443c-8e25-d129c4f7c0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:17.331658 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8a42a-d938-443c-8e25-d129c4f7c0d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:17.332352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8a42a-d938-443c-8e25-d129c4f7c0d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:56:17.332659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8a42a-d938-443c-8e25-d129c4f7c0d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:17.334388 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8a42a-d938-443c-8e25-d129c4f7c0d2 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:17.350404 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1235/2459] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:56:17.351570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdbc46-ba2c-4813-9615-c07ecffa29f5 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:17.361531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdbc46-ba2c-4813-9615-c07ecffa29f5 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:17.366431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa156c1-fd8f-4db7-9008-478aed05b93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:17.367106 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa156c1-fd8f-4db7-9008-478aed05b93c admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:17.367411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa156c1-fd8f-4db7-9008-478aed05b93c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:17.367746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa156c1-fd8f-4db7-9008-478aed05b93c admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:17.368486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa156c1-fd8f-4db7-9008-478aed05b93c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:17.370417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa156c1-fd8f-4db7-9008-478aed05b93c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:17.469228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1225/2460] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:17 2022] POST /identity/v3/projects => generated 361 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:17.470417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8a42a-d938-443c-8e25-d129c4f7c0d2 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:17.480994 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8a42a-d938-443c-8e25-d129c4f7c0d2 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:17.543468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194bafb-daa1-4da5-a069-1a6efc77a335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:17.544105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194bafb-daa1-4da5-a069-1a6efc77a335 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:17.544386 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194bafb-daa1-4da5-a069-1a6efc77a335 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:17.544674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194bafb-daa1-4da5-a069-1a6efc77a335 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:17.545305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194bafb-daa1-4da5-a069-1a6efc77a335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:17.547500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194bafb-daa1-4da5-a069-1a6efc77a335 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:17.693561 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1236/2461] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:17 2022] POST /identity/v3/users => generated 281 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:17.698484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa156c1-fd8f-4db7-9008-478aed05b93c admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:17.710118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa156c1-fd8f-4db7-9008-478aed05b93c admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:17.714609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb217f-6654-48df-bb9a-df703cf68ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:17.715214 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb217f-6654-48df-bb9a-df703cf68ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:17.715493 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb217f-6654-48df-bb9a-df703cf68ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:17.715762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb217f-6654-48df-bb9a-df703cf68ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:17.716463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb217f-6654-48df-bb9a-df703cf68ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:17.718062 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb217f-6654-48df-bb9a-df703cf68ff1 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:17.728890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1226/2462] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:17.732915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194bafb-daa1-4da5-a069-1a6efc77a335 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:17.743873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194bafb-daa1-4da5-a069-1a6efc77a335 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:17.750189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc03e70-cf4f-40cb-acb5-9eef3376588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:17.750189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc03e70-cf4f-40cb-acb5-9eef3376588a admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:17.750189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc03e70-cf4f-40cb-acb5-9eef3376588a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:17.750189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc03e70-cf4f-40cb-acb5-9eef3376588a admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:17.750641 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc03e70-cf4f-40cb-acb5-9eef3376588a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:17.752259 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc03e70-cf4f-40cb-acb5-9eef3376588a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:17.763711 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1237/2463] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:17.768060 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb217f-6654-48df-bb9a-df703cf68ff1 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:17.778095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb217f-6654-48df-bb9a-df703cf68ff1 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:17.783050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36b9ec-c2d3-4448-9b96-e5008b11a76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:17.794806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36b9ec-c2d3-4448-9b96-e5008b11a76f admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:17.794806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36b9ec-c2d3-4448-9b96-e5008b11a76f admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:17.794806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36b9ec-c2d3-4448-9b96-e5008b11a76f admin admin] PATH_INFO: `/v3/projects/5701be306998479293c9afb73eb28fe2/users/47070e2ea9fe42fcbcc70737fb153544/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:17.799432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36b9ec-c2d3-4448-9b96-e5008b11a76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5701be306998479293c9afb73eb28fe2, user_id=47070e2ea9fe42fcbcc70737fb153544, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:17.802620 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36b9ec-c2d3-4448-9b96-e5008b11a76f admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:17.888448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1227/2464] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:17 2022] PUT /identity/v3/projects/5701be306998479293c9afb73eb28fe2/users/47070e2ea9fe42fcbcc70737fb153544/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:56:17.899677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1219bb1-f4bc-41a3-a9bd-2ec38121e933 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:17.899964 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1219bb1-f4bc-41a3-a9bd-2ec38121e933 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:17.900279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1219bb1-f4bc-41a3-a9bd-2ec38121e933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:17.928446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-b1219bb1-f4bc-41a3-a9bd-2ec38121e933 None None] MFA Rules not processed for user `47070e2ea9fe42fcbcc70737fb153544`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:17.929690 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b1219bb1-f4bc-41a3-a9bd-2ec38121e933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:17.995208 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1238/2465] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:17.999654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36b9ec-c2d3-4448-9b96-e5008b11a76f admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:18.045257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:18.061259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36b9ec-c2d3-4448-9b96-e5008b11a76f admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:18.065952 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5eb0f-3613-4dda-8b64-10e6d39cee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:18.066554 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5eb0f-3613-4dda-8b64-10e6d39cee13 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:18.066834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5eb0f-3613-4dda-8b64-10e6d39cee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:18.067107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5eb0f-3613-4dda-8b64-10e6d39cee13 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:18.067740 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5eb0f-3613-4dda-8b64-10e6d39cee13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:18.069683 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5eb0f-3613-4dda-8b64-10e6d39cee13 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:18.162796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1228/2466] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:17 2022] POST /identity/v3/projects => generated 363 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:56:18.166801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1219bb1-f4bc-41a3-a9bd-2ec38121e933 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:18.178028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1219bb1-f4bc-41a3-a9bd-2ec38121e933 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:18.216564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:18.234838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4f3b0-6402-4b1e-818b-5c1d4ebae400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:18.235384 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4f3b0-6402-4b1e-818b-5c1d4ebae400 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:18.235666 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4f3b0-6402-4b1e-818b-5c1d4ebae400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:18.235942 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4f3b0-6402-4b1e-818b-5c1d4ebae400 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:18.236687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4f3b0-6402-4b1e-818b-5c1d4ebae400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:18.238617 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4f3b0-6402-4b1e-818b-5c1d4ebae400 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:18.355400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1239/2467] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:18 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:18.359316 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5eb0f-3613-4dda-8b64-10e6d39cee13 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:18.370242 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5eb0f-3613-4dda-8b64-10e6d39cee13 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:18.374906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df6fc6-9634-40c7-a960-a0b9a0f51c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:18.375504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df6fc6-9634-40c7-a960-a0b9a0f51c34 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:18.375821 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df6fc6-9634-40c7-a960-a0b9a0f51c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:18.376107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df6fc6-9634-40c7-a960-a0b9a0f51c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:18.376804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df6fc6-9634-40c7-a960-a0b9a0f51c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:18.378389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df6fc6-9634-40c7-a960-a0b9a0f51c34 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:18.388926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1229/2468] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:18.392991 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4f3b0-6402-4b1e-818b-5c1d4ebae400 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:18.403031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4f3b0-6402-4b1e-818b-5c1d4ebae400 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:18.407610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ec5d3-1688-4dae-8d6e-fcfb6801a216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:18.408323 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ec5d3-1688-4dae-8d6e-fcfb6801a216 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:18.408619 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ec5d3-1688-4dae-8d6e-fcfb6801a216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:18.408893 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ec5d3-1688-4dae-8d6e-fcfb6801a216 admin admin] PATH_INFO: `/v3/projects/b9cec28f11694977aaa3cd4024855a23/users/7617b68891504beb8008eaf43d46c896/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:18.423314 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ec5d3-1688-4dae-8d6e-fcfb6801a216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9cec28f11694977aaa3cd4024855a23, user_id=7617b68891504beb8008eaf43d46c896, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:18.426261 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ec5d3-1688-4dae-8d6e-fcfb6801a216 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:18.492490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1240/2469] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:18 2022] PUT /identity/v3/projects/b9cec28f11694977aaa3cd4024855a23/users/7617b68891504beb8008eaf43d46c896/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:18.496313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df6fc6-9634-40c7-a960-a0b9a0f51c34 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:18.506535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df6fc6-9634-40c7-a960-a0b9a0f51c34 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:18.562826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123eb0f-1e7b-4882-9a3c-f73b44251784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:18.563430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123eb0f-1e7b-4882-9a3c-f73b44251784 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:18.563710 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123eb0f-1e7b-4882-9a3c-f73b44251784 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:18.563985 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123eb0f-1e7b-4882-9a3c-f73b44251784 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:18.564670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123eb0f-1e7b-4882-9a3c-f73b44251784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:18.566257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123eb0f-1e7b-4882-9a3c-f73b44251784 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:18.575965 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1230/2470] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:18.580138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ec5d3-1688-4dae-8d6e-fcfb6801a216 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:18.592997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ec5d3-1688-4dae-8d6e-fcfb6801a216 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:18.598170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be4a0a-e264-41bb-a2f6-74026d8f9a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:18.598843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be4a0a-e264-41bb-a2f6-74026d8f9a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:18.599125 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be4a0a-e264-41bb-a2f6-74026d8f9a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:18.599407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be4a0a-e264-41bb-a2f6-74026d8f9a58 admin admin] PATH_INFO: `/v3/projects/b9cec28f11694977aaa3cd4024855a23/users/7617b68891504beb8008eaf43d46c896/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:18.605014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be4a0a-e264-41bb-a2f6-74026d8f9a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9cec28f11694977aaa3cd4024855a23, user_id=7617b68891504beb8008eaf43d46c896, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:18.608036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be4a0a-e264-41bb-a2f6-74026d8f9a58 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:18.619757 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1241/2471] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:18 2022] PUT /identity/v3/projects/b9cec28f11694977aaa3cd4024855a23/users/7617b68891504beb8008eaf43d46c896/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:18.631070 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c5e9-dd10-4815-b2e1-a02f7a9accdd None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:18.631363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c5e9-dd10-4815-b2e1-a02f7a9accdd None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:18.631642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c5e9-dd10-4815-b2e1-a02f7a9accdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:18.661334 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-2a67c5e9-dd10-4815-b2e1-a02f7a9accdd None None] MFA Rules not processed for user `7617b68891504beb8008eaf43d46c896`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:18.662671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-2a67c5e9-dd10-4815-b2e1-a02f7a9accdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:18.734882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1231/2472] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:18.746515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be4a0a-e264-41bb-a2f6-74026d8f9a58 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:18.748222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f0be4a0a-e264-41bb-a2f6-74026d8f9a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:18.812157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be4a0a-e264-41bb-a2f6-74026d8f9a58 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:18.815830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed823e08-2e6c-4f6e-9083-1685d5b6725d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:18.816462 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed823e08-2e6c-4f6e-9083-1685d5b6725d service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:18.816742 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed823e08-2e6c-4f6e-9083-1685d5b6725d service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:18.817014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed823e08-2e6c-4f6e-9083-1685d5b6725d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:18.827004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed823e08-2e6c-4f6e-9083-1685d5b6725d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:18.828482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed823e08-2e6c-4f6e-9083-1685d5b6725d service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:18.838830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1242/2473] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:19.663882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67c5e9-dd10-4815-b2e1-a02f7a9accdd None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:19.708065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:19.728326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67c5e9-dd10-4815-b2e1-a02f7a9accdd None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:19.732942 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6d8fd-7dae-496d-b261-f7989547c779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:19.733577 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6d8fd-7dae-496d-b261-f7989547c779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:19.733875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6d8fd-7dae-496d-b261-f7989547c779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:19.734133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6d8fd-7dae-496d-b261-f7989547c779 admin admin] PATH_INFO: `/v3/users/47070e2ea9fe42fcbcc70737fb153544` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:19.735258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6d8fd-7dae-496d-b261-f7989547c779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47070e2ea9fe42fcbcc70737fb153544)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:19.737218 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6d8fd-7dae-496d-b261-f7989547c779 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:19.957146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-83c6d8fd-7dae-496d-b261-f7989547c779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47070e2ea9fe42fcbcc70737fb153544'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:19.970036 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-83c6d8fd-7dae-496d-b261-f7989547c779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47070e2ea9fe42fcbcc70737fb153544'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:20.052708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-83c6d8fd-7dae-496d-b261-f7989547c779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47070e2ea9fe42fcbcc70737fb153544'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:20.053399 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-83c6d8fd-7dae-496d-b261-f7989547c779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47070e2ea9fe42fcbcc70737fb153544'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:20.054029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-83c6d8fd-7dae-496d-b261-f7989547c779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47070e2ea9fe42fcbcc70737fb153544'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:20.068693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1232/2474] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:19 2022] DELETE /identity/v3/users/47070e2ea9fe42fcbcc70737fb153544 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:20.073194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d216abe-1df7-43a5-9e24-d0e42d3bb16c None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:20.073804 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d216abe-1df7-43a5-9e24-d0e42d3bb16c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:20.073804 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d216abe-1df7-43a5-9e24-d0e42d3bb16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:20.095832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-4d216abe-1df7-43a5-9e24-d0e42d3bb16c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:20.102693 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4d216abe-1df7-43a5-9e24-d0e42d3bb16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:20.188459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1243/2475] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:56:20.198844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6d8fd-7dae-496d-b261-f7989547c779 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:20.200388 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-83c6d8fd-7dae-496d-b261-f7989547c779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:20.260828 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6d8fd-7dae-496d-b261-f7989547c779 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:20.264438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97e3c2-f322-48eb-aa41-5e56d3bc3574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:20.265041 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97e3c2-f322-48eb-aa41-5e56d3bc3574 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:20.265324 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97e3c2-f322-48eb-aa41-5e56d3bc3574 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:20.265597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97e3c2-f322-48eb-aa41-5e56d3bc3574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:20.275178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97e3c2-f322-48eb-aa41-5e56d3bc3574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:20.276642 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97e3c2-f322-48eb-aa41-5e56d3bc3574 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:20.286271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1233/2476] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:20.677927 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d216abe-1df7-43a5-9e24-d0e42d3bb16c None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:20.679414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4d216abe-1df7-43a5-9e24-d0e42d3bb16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:20.693282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d216abe-1df7-43a5-9e24-d0e42d3bb16c None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:20.699045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9876c-cf97-48a3-afb3-ff0b661c130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:20.701200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9876c-cf97-48a3-afb3-ff0b661c130b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:20.701200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9876c-cf97-48a3-afb3-ff0b661c130b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:20.701200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9876c-cf97-48a3-afb3-ff0b661c130b admin admin] PATH_INFO: `/v3/projects/5701be306998479293c9afb73eb28fe2` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:20.701506 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9876c-cf97-48a3-afb3-ff0b661c130b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5701be306998479293c9afb73eb28fe2)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:20.704081 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9876c-cf97-48a3-afb3-ff0b661c130b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:20.783856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:20.796670 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6da9876c-cf97-48a3-afb3-ff0b661c130b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5701be306998479293c9afb73eb28fe2', 'request_id': 'req-6da9876c-cf97-48a3-afb3-ff0b661c130b'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:20.802961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6da9876c-cf97-48a3-afb3-ff0b661c130b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5701be306998479293c9afb73eb28fe2', 'request_id': 'req-6da9876c-cf97-48a3-afb3-ff0b661c130b'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:20.897819 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6da9876c-cf97-48a3-afb3-ff0b661c130b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5701be306998479293c9afb73eb28fe2', 'request_id': 'req-6da9876c-cf97-48a3-afb3-ff0b661c130b'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:20.908770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6da9876c-cf97-48a3-afb3-ff0b661c130b admin admin] The token cache is being invalidate because project 5701be306998479293c9afb73eb28fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:20.909113 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6da9876c-cf97-48a3-afb3-ff0b661c130b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:20.909824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6da9876c-cf97-48a3-afb3-ff0b661c130b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:20.911566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1244/2477] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:20 2022] DELETE /identity/v3/projects/5701be306998479293c9afb73eb28fe2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:20.916416 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97e3c2-f322-48eb-aa41-5e56d3bc3574 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:20.926362 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97e3c2-f322-48eb-aa41-5e56d3bc3574 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:20.983818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baf417-c446-4339-b884-34c76f4a121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:20.984472 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baf417-c446-4339-b884-34c76f4a121d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:20.984782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baf417-c446-4339-b884-34c76f4a121d admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:20.985061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baf417-c446-4339-b884-34c76f4a121d admin admin] PATH_INFO: `/v3/users/7617b68891504beb8008eaf43d46c896` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:20.986176 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baf417-c446-4339-b884-34c76f4a121d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7617b68891504beb8008eaf43d46c896)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:20.988103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baf417-c446-4339-b884-34c76f4a121d admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:20.990417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:21.134997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-94baf417-c446-4339-b884-34c76f4a121d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7617b68891504beb8008eaf43d46c896'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:21.146925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-94baf417-c446-4339-b884-34c76f4a121d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7617b68891504beb8008eaf43d46c896'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:21.241353 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-94baf417-c446-4339-b884-34c76f4a121d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7617b68891504beb8008eaf43d46c896'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:21.244579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-94baf417-c446-4339-b884-34c76f4a121d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7617b68891504beb8008eaf43d46c896'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:21.244579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-94baf417-c446-4339-b884-34c76f4a121d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7617b68891504beb8008eaf43d46c896'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:21.257144 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1234/2478] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:20 2022] DELETE /identity/v3/users/7617b68891504beb8008eaf43d46c896 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:21.745679 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9876c-cf97-48a3-afb3-ff0b661c130b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:21.747211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-6da9876c-cf97-48a3-afb3-ff0b661c130b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:21.761559 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9876c-cf97-48a3-afb3-ff0b661c130b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:21.822174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8bd55-2440-42c8-b086-a51bac4afa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:21.822807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8bd55-2440-42c8-b086-a51bac4afa17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:21.823089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8bd55-2440-42c8-b086-a51bac4afa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:21.823392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8bd55-2440-42c8-b086-a51bac4afa17 admin admin] PATH_INFO: `/v3/projects/b9cec28f11694977aaa3cd4024855a23` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:21.824534 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8bd55-2440-42c8-b086-a51bac4afa17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9cec28f11694977aaa3cd4024855a23)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:21.826443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8bd55-2440-42c8-b086-a51bac4afa17 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:21.920797 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8d8bd55-2440-42c8-b086-a51bac4afa17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9cec28f11694977aaa3cd4024855a23', 'request_id': 'req-a8d8bd55-2440-42c8-b086-a51bac4afa17'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:21.927716 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8d8bd55-2440-42c8-b086-a51bac4afa17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9cec28f11694977aaa3cd4024855a23', 'request_id': 'req-a8d8bd55-2440-42c8-b086-a51bac4afa17'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:21.995621 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8d8bd55-2440-42c8-b086-a51bac4afa17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9cec28f11694977aaa3cd4024855a23', 'request_id': 'req-a8d8bd55-2440-42c8-b086-a51bac4afa17'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:22.006795 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8d8bd55-2440-42c8-b086-a51bac4afa17 admin admin] The token cache is being invalidate because project b9cec28f11694977aaa3cd4024855a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:22.007085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8d8bd55-2440-42c8-b086-a51bac4afa17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:22.008259 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8d8bd55-2440-42c8-b086-a51bac4afa17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:22.009835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1245/2479] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:21 2022] DELETE /identity/v3/projects/b9cec28f11694977aaa3cd4024855a23 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:22.014724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b652e71-b077-4539-8219-8882c6130fd5 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:22.015195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b652e71-b077-4539-8219-8882c6130fd5 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:22.015309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b652e71-b077-4539-8219-8882c6130fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:22.035224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-7b652e71-b077-4539-8219-8882c6130fd5 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:22.036504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-7b652e71-b077-4539-8219-8882c6130fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:22.097887 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1235/2480] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:22.107276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de608af-249b-40bc-9cd6-a6a6d7ff56c1 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:22.107276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de608af-249b-40bc-9cd6-a6a6d7ff56c1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:22.107276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de608af-249b-40bc-9cd6-a6a6d7ff56c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:22.127313 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-7de608af-249b-40bc-9cd6-a6a6d7ff56c1 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:22.129707 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-7de608af-249b-40bc-9cd6-a6a6d7ff56c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:22.144674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1246/2481] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:22.148943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b652e71-b077-4539-8219-8882c6130fd5 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:22.160432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b652e71-b077-4539-8219-8882c6130fd5 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:22.165738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b94048-c8e2-45f9-bd5e-5a5dd6454ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:22.166388 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b94048-c8e2-45f9-bd5e-5a5dd6454ebe admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:22.166671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b94048-c8e2-45f9-bd5e-5a5dd6454ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:22.166948 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b94048-c8e2-45f9-bd5e-5a5dd6454ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:22.167607 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b94048-c8e2-45f9-bd5e-5a5dd6454ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:56:22.167916 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b94048-c8e2-45f9-bd5e-5a5dd6454ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:22.169583 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b94048-c8e2-45f9-bd5e-5a5dd6454ebe admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:22.182844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1236/2482] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:56:22.187205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de608af-249b-40bc-9cd6-a6a6d7ff56c1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:22.197272 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de608af-249b-40bc-9cd6-a6a6d7ff56c1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:22.202082 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0920f9-6a51-4f91-9aee-655dac4c12ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:22.202677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0920f9-6a51-4f91-9aee-655dac4c12ed admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:22.202959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0920f9-6a51-4f91-9aee-655dac4c12ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:22.203230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0920f9-6a51-4f91-9aee-655dac4c12ed admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:22.203896 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0920f9-6a51-4f91-9aee-655dac4c12ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:22.205890 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0920f9-6a51-4f91-9aee-655dac4c12ed admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:22.316807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1247/2483] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:22 2022] POST /identity/v3/projects => generated 355 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:22.321959 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b94048-c8e2-45f9-bd5e-5a5dd6454ebe admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:22.332033 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b94048-c8e2-45f9-bd5e-5a5dd6454ebe admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:22.390496 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d811b7-fb85-4ce3-8935-20dfa877d6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:22.393259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d811b7-fb85-4ce3-8935-20dfa877d6fb admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:22.393259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d811b7-fb85-4ce3-8935-20dfa877d6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:22.393259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d811b7-fb85-4ce3-8935-20dfa877d6fb admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:22.393259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d811b7-fb85-4ce3-8935-20dfa877d6fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:22.394462 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d811b7-fb85-4ce3-8935-20dfa877d6fb admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:22.470366 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:22.477419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1237/2484] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:22 2022] POST /identity/v3/users => generated 278 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:56:22.481380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0920f9-6a51-4f91-9aee-655dac4c12ed admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:22.492004 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0920f9-6a51-4f91-9aee-655dac4c12ed admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:22.497445 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4fc4b-5d00-4ab0-888d-f0c005be8e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:22.498053 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4fc4b-5d00-4ab0-888d-f0c005be8e3a admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:22.498328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4fc4b-5d00-4ab0-888d-f0c005be8e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:22.498601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4fc4b-5d00-4ab0-888d-f0c005be8e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:22.499243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4fc4b-5d00-4ab0-888d-f0c005be8e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:22.500877 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4fc4b-5d00-4ab0-888d-f0c005be8e3a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:22.512661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1248/2485] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:22.516719 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d811b7-fb85-4ce3-8935-20dfa877d6fb admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:22.527672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d811b7-fb85-4ce3-8935-20dfa877d6fb admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:22.537572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff16ca-1a83-4b47-a56d-7692acf7941e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:22.537572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff16ca-1a83-4b47-a56d-7692acf7941e admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:22.537572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff16ca-1a83-4b47-a56d-7692acf7941e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:22.537572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff16ca-1a83-4b47-a56d-7692acf7941e admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:22.538282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff16ca-1a83-4b47-a56d-7692acf7941e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:22.539986 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff16ca-1a83-4b47-a56d-7692acf7941e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:22.555531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1238/2486] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:56:22.561523 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4fc4b-5d00-4ab0-888d-f0c005be8e3a admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:22.572316 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4fc4b-5d00-4ab0-888d-f0c005be8e3a admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:22.576939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22deb2de-ab1e-4e19-a28e-0f0090793d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:22.577568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22deb2de-ab1e-4e19-a28e-0f0090793d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:22.577848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22deb2de-ab1e-4e19-a28e-0f0090793d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:22.578152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22deb2de-ab1e-4e19-a28e-0f0090793d5e admin admin] PATH_INFO: `/v3/projects/c0792811cf0a4559bc924ad69e057991/users/ba713dcebe214e19a3a8088362ddaa6d/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:22.582260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:22.598366 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22deb2de-ab1e-4e19-a28e-0f0090793d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0792811cf0a4559bc924ad69e057991, user_id=ba713dcebe214e19a3a8088362ddaa6d, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:22.601150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22deb2de-ab1e-4e19-a28e-0f0090793d5e admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:22.658476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1249/2487] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:22 2022] PUT /identity/v3/projects/c0792811cf0a4559bc924ad69e057991/users/ba713dcebe214e19a3a8088362ddaa6d/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:22.669398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe284c2-a03f-4d5a-b4ad-449cc9a1a6d0 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:22.669693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe284c2-a03f-4d5a-b4ad-449cc9a1a6d0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:22.669959 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe284c2-a03f-4d5a-b4ad-449cc9a1a6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:22.700697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-6fe284c2-a03f-4d5a-b4ad-449cc9a1a6d0 None None] MFA Rules not processed for user `ba713dcebe214e19a3a8088362ddaa6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:22.702021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6fe284c2-a03f-4d5a-b4ad-449cc9a1a6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:22.764997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1239/2488] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:22.769497 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22deb2de-ab1e-4e19-a28e-0f0090793d5e admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:22.830990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22deb2de-ab1e-4e19-a28e-0f0090793d5e admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:22.835511 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a65562-808b-4298-be4f-03a8ff3a98d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:22.836631 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a65562-808b-4298-be4f-03a8ff3a98d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:22.836911 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a65562-808b-4298-be4f-03a8ff3a98d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:22.837187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a65562-808b-4298-be4f-03a8ff3a98d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:22.837822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a65562-808b-4298-be4f-03a8ff3a98d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:22.839719 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a65562-808b-4298-be4f-03a8ff3a98d9 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:22.950837 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1250/2489] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:22 2022] POST /identity/v3/projects => generated 357 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:22.954960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe284c2-a03f-4d5a-b4ad-449cc9a1a6d0 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:22.966476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe284c2-a03f-4d5a-b4ad-449cc9a1a6d0 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:23.021670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eadfe8-5888-4d4e-9444-6cae6347f94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:23.022346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eadfe8-5888-4d4e-9444-6cae6347f94b admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:23.022549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eadfe8-5888-4d4e-9444-6cae6347f94b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:23.022825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eadfe8-5888-4d4e-9444-6cae6347f94b admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:23.023991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eadfe8-5888-4d4e-9444-6cae6347f94b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:23.026022 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eadfe8-5888-4d4e-9444-6cae6347f94b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:23.104574 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1240/2490] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:22 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:23.108477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a65562-808b-4298-be4f-03a8ff3a98d9 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:23.118688 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a65562-808b-4298-be4f-03a8ff3a98d9 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:23.123328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ada9da-b944-4dd8-ad7c-42b55cd4e2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:23.123917 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ada9da-b944-4dd8-ad7c-42b55cd4e2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:23.124243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ada9da-b944-4dd8-ad7c-42b55cd4e2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:23.124518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ada9da-b944-4dd8-ad7c-42b55cd4e2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:23.125157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ada9da-b944-4dd8-ad7c-42b55cd4e2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:23.126872 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ada9da-b944-4dd8-ad7c-42b55cd4e2e9 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:23.138310 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1251/2491] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:23.142448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eadfe8-5888-4d4e-9444-6cae6347f94b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:23.153281 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eadfe8-5888-4d4e-9444-6cae6347f94b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:23.157977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fc910-fafb-431f-82f4-bdd587d85a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:23.160126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fc910-fafb-431f-82f4-bdd587d85a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:23.160126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fc910-fafb-431f-82f4-bdd587d85a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:23.160126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fc910-fafb-431f-82f4-bdd587d85a75 admin admin] PATH_INFO: `/v3/projects/d58105bac79b4a318ebb167af45a28c7/users/e1937e426e8640ee93a05e4c7891b9cb/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:23.174456 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fc910-fafb-431f-82f4-bdd587d85a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58105bac79b4a318ebb167af45a28c7, user_id=e1937e426e8640ee93a05e4c7891b9cb, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:23.177558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fc910-fafb-431f-82f4-bdd587d85a75 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:23.276587 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1241/2492] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:23 2022] PUT /identity/v3/projects/d58105bac79b4a318ebb167af45a28c7/users/e1937e426e8640ee93a05e4c7891b9cb/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:23.280574 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ada9da-b944-4dd8-ad7c-42b55cd4e2e9 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:23.290657 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ada9da-b944-4dd8-ad7c-42b55cd4e2e9 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:23.347630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca678c-902d-4dd8-8569-442ea982b8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:23.348269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca678c-902d-4dd8-8569-442ea982b8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:23.348549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca678c-902d-4dd8-8569-442ea982b8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:23.348822 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca678c-902d-4dd8-8569-442ea982b8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:23.349459 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca678c-902d-4dd8-8569-442ea982b8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:23.351087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca678c-902d-4dd8-8569-442ea982b8e5 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:23.360583 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1252/2493] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:23.364627 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fc910-fafb-431f-82f4-bdd587d85a75 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:23.374863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fc910-fafb-431f-82f4-bdd587d85a75 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:23.379491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043aa56d-89ad-4078-802a-20bde11a5461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:23.380167 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aa56d-89ad-4078-802a-20bde11a5461 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:23.380449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aa56d-89ad-4078-802a-20bde11a5461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:23.380724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aa56d-89ad-4078-802a-20bde11a5461 admin admin] PATH_INFO: `/v3/projects/d58105bac79b4a318ebb167af45a28c7/users/e1937e426e8640ee93a05e4c7891b9cb/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:23.382620 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043aa56d-89ad-4078-802a-20bde11a5461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58105bac79b4a318ebb167af45a28c7, user_id=e1937e426e8640ee93a05e4c7891b9cb, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:23.385834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043aa56d-89ad-4078-802a-20bde11a5461 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:23.395893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1242/2494] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:23 2022] PUT /identity/v3/projects/d58105bac79b4a318ebb167af45a28c7/users/e1937e426e8640ee93a05e4c7891b9cb/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:23.407650 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfdef8-e144-43ba-893c-42942de094c2 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:23.407935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfdef8-e144-43ba-893c-42942de094c2 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:23.408247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfdef8-e144-43ba-893c-42942de094c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:23.435636 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-f0cfdef8-e144-43ba-893c-42942de094c2 None None] MFA Rules not processed for user `e1937e426e8640ee93a05e4c7891b9cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:23.436878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f0cfdef8-e144-43ba-893c-42942de094c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:23.480455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:23.504381 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1253/2495] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:23.516107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043aa56d-89ad-4078-802a-20bde11a5461 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:23.519279 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-043aa56d-89ad-4078-802a-20bde11a5461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:23.550521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:23.578087 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043aa56d-89ad-4078-802a-20bde11a5461 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:23.581932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c87a4-5b27-43bb-9cb3-7c4c7b8eb25f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:23.582596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c87a4-5b27-43bb-9cb3-7c4c7b8eb25f service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:23.582880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c87a4-5b27-43bb-9cb3-7c4c7b8eb25f service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:23.583156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c87a4-5b27-43bb-9cb3-7c4c7b8eb25f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:23.592729 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c87a4-5b27-43bb-9cb3-7c4c7b8eb25f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:23.594163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c87a4-5b27-43bb-9cb3-7c4c7b8eb25f service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:23.605064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1243/2496] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:23.810349 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfdef8-e144-43ba-893c-42942de094c2 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:23.820506 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfdef8-e144-43ba-893c-42942de094c2 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:23.824112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b563b8-d884-47c7-bf4f-c8d9e4eb3df7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:23.824848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b563b8-d884-47c7-bf4f-c8d9e4eb3df7 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:23.825187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b563b8-d884-47c7-bf4f-c8d9e4eb3df7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:23.825531 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b563b8-d884-47c7-bf4f-c8d9e4eb3df7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:23.882289 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b563b8-d884-47c7-bf4f-c8d9e4eb3df7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:23.884175 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b563b8-d884-47c7-bf4f-c8d9e4eb3df7 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:23.893008 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1254/2497] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:33.629862 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=13 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:33.889012 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=37 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:34.376560 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c87a4-5b27-43bb-9cb3-7c4c7b8eb25f service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:34.377994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9a8c87a4-5b27-43bb-9cb3-7c4c7b8eb25f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:34.437561 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c87a4-5b27-43bb-9cb3-7c4c7b8eb25f service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:34.441134 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066678bc-c23e-4f68-849d-568941c9bd41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:34.441733 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066678bc-c23e-4f68-849d-568941c9bd41 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:34.442013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066678bc-c23e-4f68-849d-568941c9bd41 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:34.442280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066678bc-c23e-4f68-849d-568941c9bd41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:34.443979 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-066678bc-c23e-4f68-849d-568941c9bd41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:34.453493 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066678bc-c23e-4f68-849d-568941c9bd41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:34.454881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066678bc-c23e-4f68-849d-568941c9bd41 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:34.462625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1244/2498] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:36.018651 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21eae1-774e-4790-9a25-83a0dca0362b None None] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:36.019215 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21eae1-774e-4790-9a25-83a0dca0362b None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:36.019448 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21eae1-774e-4790-9a25-83a0dca0362b None None] PATH_INFO: `/` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:36.021369 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1255/2499] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 29 22:56:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:56:36.028827 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed65523-c15c-4f7d-9740-5e3d0b2e67c2 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:36.028827 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed65523-c15c-4f7d-9740-5e3d0b2e67c2 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:36.028827 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed65523-c15c-4f7d-9740-5e3d0b2e67c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:36.066398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-9ed65523-c15c-4f7d-9740-5e3d0b2e67c2 None None] MFA Rules not processed for user `d8794e99a0024672974412ca4c045b63`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:36.068525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9ed65523-c15c-4f7d-9740-5e3d0b2e67c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:36.083746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1245/2500] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 29 22:56:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:36.101009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21eae1-774e-4790-9a25-83a0dca0362b None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:36.123823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21eae1-774e-4790-9a25-83a0dca0362b None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:36.128278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b9cb7-7fc7-40ea-8eb2-98871e356423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:36.129049 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b9cb7-7fc7-40ea-8eb2-98871e356423 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:36.129403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b9cb7-7fc7-40ea-8eb2-98871e356423 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:36.129748 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b9cb7-7fc7-40ea-8eb2-98871e356423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:36.140165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b9cb7-7fc7-40ea-8eb2-98871e356423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:36.141960 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b9cb7-7fc7-40ea-8eb2-98871e356423 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:36.152591 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1256/2501] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:36.321561 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27eb49-b649-4839-9e9a-bc0f34affc04 None None] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:36.321875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27eb49-b649-4839-9e9a-bc0f34affc04 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:36.322975 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27eb49-b649-4839-9e9a-bc0f34affc04 None None] PATH_INFO: `/` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:36.325001 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1246/2502] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 29 22:56:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:56:36.332489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d8e37-f6ab-41c7-85e9-f70b487e2eef None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:36.332779 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d8e37-f6ab-41c7-85e9-f70b487e2eef None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:36.333061 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d8e37-f6ab-41c7-85e9-f70b487e2eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:36.361168 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ba7d8e37-f6ab-41c7-85e9-f70b487e2eef None None] MFA Rules not processed for user `f06d910badb84c6aa6b48f3b56b91f82`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:36.362308 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ba7d8e37-f6ab-41c7-85e9-f70b487e2eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:36.481330 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1257/2503] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 29 22:56:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:36.489522 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27eb49-b649-4839-9e9a-bc0f34affc04 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:36.501290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27eb49-b649-4839-9e9a-bc0f34affc04 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:36.505121 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84ac0d-e8f4-4d96-a34d-5ae99a377a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:36.505718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84ac0d-e8f4-4d96-a34d-5ae99a377a96 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:36.505995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84ac0d-e8f4-4d96-a34d-5ae99a377a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:36.506267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84ac0d-e8f4-4d96-a34d-5ae99a377a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:36.518470 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84ac0d-e8f4-4d96-a34d-5ae99a377a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:36.519957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84ac0d-e8f4-4d96-a34d-5ae99a377a96 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:36.530928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1247/2504] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:56:40.881018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d8e37-f6ab-41c7-85e9-f70b487e2eef None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:40.882418 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ba7d8e37-f6ab-41c7-85e9-f70b487e2eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:40.894047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d8e37-f6ab-41c7-85e9-f70b487e2eef None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:40.897639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9df9e-c69a-4de3-b9fa-d7abcc667ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:40.898232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9df9e-c69a-4de3-b9fa-d7abcc667ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:40.898508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9df9e-c69a-4de3-b9fa-d7abcc667ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:40.898778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9df9e-c69a-4de3-b9fa-d7abcc667ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:40.901053 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-45d9df9e-c69a-4de3-b9fa-d7abcc667ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:40.966106 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9df9e-c69a-4de3-b9fa-d7abcc667ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:40.967541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9df9e-c69a-4de3-b9fa-d7abcc667ac1 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:40.977667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1258/2505] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:41.491466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84ac0d-e8f4-4d96-a34d-5ae99a377a96 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:41.502011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84ac0d-e8f4-4d96-a34d-5ae99a377a96 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:41.506525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ad7f4-f430-42dd-8377-f8eedeb01dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:41.507143 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ad7f4-f430-42dd-8377-f8eedeb01dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:41.507426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ad7f4-f430-42dd-8377-f8eedeb01dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:41.507697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ad7f4-f430-42dd-8377-f8eedeb01dc6 admin admin] PATH_INFO: `/v3/users/ba713dcebe214e19a3a8088362ddaa6d` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:41.511649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ad7f4-f430-42dd-8377-f8eedeb01dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba713dcebe214e19a3a8088362ddaa6d)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:41.511649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ad7f4-f430-42dd-8377-f8eedeb01dc6 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:41.757132 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d82ad7f4-f430-42dd-8377-f8eedeb01dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba713dcebe214e19a3a8088362ddaa6d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:41.769169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d82ad7f4-f430-42dd-8377-f8eedeb01dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba713dcebe214e19a3a8088362ddaa6d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:41.852510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d82ad7f4-f430-42dd-8377-f8eedeb01dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba713dcebe214e19a3a8088362ddaa6d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:41.853771 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d82ad7f4-f430-42dd-8377-f8eedeb01dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba713dcebe214e19a3a8088362ddaa6d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:41.854452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d82ad7f4-f430-42dd-8377-f8eedeb01dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba713dcebe214e19a3a8088362ddaa6d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:41.868148 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1248/2506] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:41 2022] DELETE /identity/v3/users/ba713dcebe214e19a3a8088362ddaa6d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:41.873307 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc2d2e-e9ef-4687-909c-67e1e499a36a None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:41.873638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc2d2e-e9ef-4687-909c-67e1e499a36a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:41.873925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc2d2e-e9ef-4687-909c-67e1e499a36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:41.894640 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-86bc2d2e-e9ef-4687-909c-67e1e499a36a None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:41.895831 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-86bc2d2e-e9ef-4687-909c-67e1e499a36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:41.978964 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1259/2507] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:41.994441 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ad7f4-f430-42dd-8377-f8eedeb01dc6 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:41.996337 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d82ad7f4-f430-42dd-8377-f8eedeb01dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:42.121501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ad7f4-f430-42dd-8377-f8eedeb01dc6 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:42.138320 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f814530-d7bd-4ea8-a7fc-7fae5c0b92bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:42.138969 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f814530-d7bd-4ea8-a7fc-7fae5c0b92bd service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:42.139285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f814530-d7bd-4ea8-a7fc-7fae5c0b92bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:42.139564 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f814530-d7bd-4ea8-a7fc-7fae5c0b92bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:42.171659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f814530-d7bd-4ea8-a7fc-7fae5c0b92bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:42.173928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f814530-d7bd-4ea8-a7fc-7fae5c0b92bd service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:42.179754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:42.188822 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1249/2508] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:42.899521 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc2d2e-e9ef-4687-909c-67e1e499a36a None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:42.902577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-86bc2d2e-e9ef-4687-909c-67e1e499a36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:42.921888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc2d2e-e9ef-4687-909c-67e1e499a36a None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:42.929909 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f2fc9-38fb-48d6-91bd-d65ddde78b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:42.930689 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f2fc9-38fb-48d6-91bd-d65ddde78b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:42.930990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f2fc9-38fb-48d6-91bd-d65ddde78b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:42.931846 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f2fc9-38fb-48d6-91bd-d65ddde78b69 admin admin] PATH_INFO: `/v3/projects/c0792811cf0a4559bc924ad69e057991` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:42.933015 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f2fc9-38fb-48d6-91bd-d65ddde78b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0792811cf0a4559bc924ad69e057991)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:42.936435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f2fc9-38fb-48d6-91bd-d65ddde78b69 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:42.946435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:43.066226 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-146f2fc9-38fb-48d6-91bd-d65ddde78b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0792811cf0a4559bc924ad69e057991', 'request_id': 'req-146f2fc9-38fb-48d6-91bd-d65ddde78b69'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:43.073860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-146f2fc9-38fb-48d6-91bd-d65ddde78b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0792811cf0a4559bc924ad69e057991', 'request_id': 'req-146f2fc9-38fb-48d6-91bd-d65ddde78b69'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:43.138005 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-146f2fc9-38fb-48d6-91bd-d65ddde78b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0792811cf0a4559bc924ad69e057991', 'request_id': 'req-146f2fc9-38fb-48d6-91bd-d65ddde78b69'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:43.151855 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-146f2fc9-38fb-48d6-91bd-d65ddde78b69 admin admin] The token cache is being invalidate because project c0792811cf0a4559bc924ad69e057991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:43.152265 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-146f2fc9-38fb-48d6-91bd-d65ddde78b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:43.152976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-146f2fc9-38fb-48d6-91bd-d65ddde78b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:43.154820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1260/2509] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:42 2022] DELETE /identity/v3/projects/c0792811cf0a4559bc924ad69e057991 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:43.158975 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f814530-d7bd-4ea8-a7fc-7fae5c0b92bd service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:43.170415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f814530-d7bd-4ea8-a7fc-7fae5c0b92bd service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:43.238321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40686cd-b8f2-4c48-8783-7858090e3008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:43.238907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40686cd-b8f2-4c48-8783-7858090e3008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:43.239275 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40686cd-b8f2-4c48-8783-7858090e3008 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:43.239562 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40686cd-b8f2-4c48-8783-7858090e3008 admin admin] PATH_INFO: `/v3/users/e1937e426e8640ee93a05e4c7891b9cb` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:43.240783 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40686cd-b8f2-4c48-8783-7858090e3008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1937e426e8640ee93a05e4c7891b9cb)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:43.242756 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40686cd-b8f2-4c48-8783-7858090e3008 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:43.474416 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c40686cd-b8f2-4c48-8783-7858090e3008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1937e426e8640ee93a05e4c7891b9cb'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:43.489059 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c40686cd-b8f2-4c48-8783-7858090e3008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1937e426e8640ee93a05e4c7891b9cb'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:43.552176 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c40686cd-b8f2-4c48-8783-7858090e3008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1937e426e8640ee93a05e4c7891b9cb'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:43.552176 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c40686cd-b8f2-4c48-8783-7858090e3008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1937e426e8640ee93a05e4c7891b9cb'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:43.552176 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c40686cd-b8f2-4c48-8783-7858090e3008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1937e426e8640ee93a05e4c7891b9cb'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:43.565196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1250/2510] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:43 2022] DELETE /identity/v3/users/e1937e426e8640ee93a05e4c7891b9cb => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:44.403114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f2fc9-38fb-48d6-91bd-d65ddde78b69 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:44.404671 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-146f2fc9-38fb-48d6-91bd-d65ddde78b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:44.417756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f2fc9-38fb-48d6-91bd-d65ddde78b69 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:44.510298 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef6ede-deb6-4457-9c9c-7937a55cfbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:44.514143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef6ede-deb6-4457-9c9c-7937a55cfbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:44.514143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef6ede-deb6-4457-9c9c-7937a55cfbda admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:44.514143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef6ede-deb6-4457-9c9c-7937a55cfbda admin admin] PATH_INFO: `/v3/projects/d58105bac79b4a318ebb167af45a28c7` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:44.523550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef6ede-deb6-4457-9c9c-7937a55cfbda admin admin] RBAC: Authorizing `identity:delete_project(project_id=d58105bac79b4a318ebb167af45a28c7)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:44.526179 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef6ede-deb6-4457-9c9c-7937a55cfbda admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:44.658176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-05ef6ede-deb6-4457-9c9c-7937a55cfbda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd58105bac79b4a318ebb167af45a28c7', 'request_id': 'req-05ef6ede-deb6-4457-9c9c-7937a55cfbda'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:44.667161 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-05ef6ede-deb6-4457-9c9c-7937a55cfbda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd58105bac79b4a318ebb167af45a28c7', 'request_id': 'req-05ef6ede-deb6-4457-9c9c-7937a55cfbda'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:44.745285 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-05ef6ede-deb6-4457-9c9c-7937a55cfbda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd58105bac79b4a318ebb167af45a28c7', 'request_id': 'req-05ef6ede-deb6-4457-9c9c-7937a55cfbda'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:44.760263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-05ef6ede-deb6-4457-9c9c-7937a55cfbda admin admin] The token cache is being invalidate because project d58105bac79b4a318ebb167af45a28c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:44.760659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-05ef6ede-deb6-4457-9c9c-7937a55cfbda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:44.762038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-05ef6ede-deb6-4457-9c9c-7937a55cfbda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:44.764530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1261/2511] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:44 2022] DELETE /identity/v3/projects/d58105bac79b4a318ebb167af45a28c7 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:44.769415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695416f-9976-40fa-9138-c86732b55737 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:44.769895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695416f-9976-40fa-9138-c86732b55737 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:44.769996 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695416f-9976-40fa-9138-c86732b55737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:44.791296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d695416f-9976-40fa-9138-c86732b55737 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:44.792856 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d695416f-9976-40fa-9138-c86732b55737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:44.885849 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1251/2512] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:44.893691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711164dd-776b-453f-a965-6546f515db5f None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:44.893974 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711164dd-776b-453f-a965-6546f515db5f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:44.894256 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711164dd-776b-453f-a965-6546f515db5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:44.914155 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-711164dd-776b-453f-a965-6546f515db5f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:44.915396 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-711164dd-776b-453f-a965-6546f515db5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:44.930503 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1262/2513] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:44.932455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695416f-9976-40fa-9138-c86732b55737 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:44.946039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695416f-9976-40fa-9138-c86732b55737 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:44.954634 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80bd72-a4e7-4c95-9485-05b630f444fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:44.956111 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80bd72-a4e7-4c95-9485-05b630f444fb admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:44.958374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80bd72-a4e7-4c95-9485-05b630f444fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:44.958374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80bd72-a4e7-4c95-9485-05b630f444fb admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:44.958374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80bd72-a4e7-4c95-9485-05b630f444fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:56:44.958892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80bd72-a4e7-4c95-9485-05b630f444fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:44.960120 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80bd72-a4e7-4c95-9485-05b630f444fb admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:44.984201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1252/2514] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:56:44.985403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711164dd-776b-453f-a965-6546f515db5f None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:45.011572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711164dd-776b-453f-a965-6546f515db5f None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:45.031864 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611f020-8c8f-4690-9f32-a7b7f0494801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:45.031864 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611f020-8c8f-4690-9f32-a7b7f0494801 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:45.031864 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611f020-8c8f-4690-9f32-a7b7f0494801 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:45.031864 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611f020-8c8f-4690-9f32-a7b7f0494801 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:45.033117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611f020-8c8f-4690-9f32-a7b7f0494801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:45.033117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611f020-8c8f-4690-9f32-a7b7f0494801 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:45.109953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:45.124081 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1263/2515] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:44 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:45.125196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80bd72-a4e7-4c95-9485-05b630f444fb admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:45.133271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:45.137638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80bd72-a4e7-4c95-9485-05b630f444fb admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:45.160813 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611f020-8c8f-4690-9f32-a7b7f0494801 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:45.162879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-7611f020-8c8f-4690-9f32-a7b7f0494801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:45.209035 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dea86-28a6-4119-9999-aca3a5ac3aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:45.209679 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dea86-28a6-4119-9999-aca3a5ac3aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:45.209971 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dea86-28a6-4119-9999-aca3a5ac3aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:45.210321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dea86-28a6-4119-9999-aca3a5ac3aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:45.210982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dea86-28a6-4119-9999-aca3a5ac3aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:45.213536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dea86-28a6-4119-9999-aca3a5ac3aa3 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:45.257320 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611f020-8c8f-4690-9f32-a7b7f0494801 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:45.263395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd46ff-7682-4599-88e7-5148f32a6770 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2991c613878e4993901199434f384f49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:45.267391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd46ff-7682-4599-88e7-5148f32a6770 service placement] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:45.267391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd46ff-7682-4599-88e7-5148f32a6770 service placement] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:45.267391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd46ff-7682-4599-88e7-5148f32a6770 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:45.267391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a7bd46ff-7682-4599-88e7-5148f32a6770 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:45.283841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd46ff-7682-4599-88e7-5148f32a6770 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:45.285462 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd46ff-7682-4599-88e7-5148f32a6770 service placement] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:45.296639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1264/2516] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:56:45.310954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1253/2517] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:45 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:45.311146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd46ff-7682-4599-88e7-5148f32a6770 service placement] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:45.311146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a7bd46ff-7682-4599-88e7-5148f32a6770 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:45.312028 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dea86-28a6-4119-9999-aca3a5ac3aa3 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:45.330898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd46ff-7682-4599-88e7-5148f32a6770 service placement] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:45.331032 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dea86-28a6-4119-9999-aca3a5ac3aa3 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:45.334931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc6103-6d5a-427d-aba9-55423b4a653d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:45.335566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6103-6d5a-427d-aba9-55423b4a653d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:45.335843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6103-6d5a-427d-aba9-55423b4a653d admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:45.336329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6103-6d5a-427d-aba9-55423b4a653d admin admin] PATH_INFO: `/v3/users/bd130bf777664a62ab043200c84ac8b7` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:45.337873 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc6103-6d5a-427d-aba9-55423b4a653d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd130bf777664a62ab043200c84ac8b7)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:45.338114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949b364-08df-4cb3-8798-de344b480fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:45.338917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949b364-08df-4cb3-8798-de344b480fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:45.339272 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949b364-08df-4cb3-8798-de344b480fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:45.339615 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949b364-08df-4cb3-8798-de344b480fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:45.340382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949b364-08df-4cb3-8798-de344b480fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:45.340485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc6103-6d5a-427d-aba9-55423b4a653d admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:45.342020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949b364-08df-4cb3-8798-de344b480fb3 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:45.353528 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1254/2518] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:45.357557 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949b364-08df-4cb3-8798-de344b480fb3 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:45.367356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949b364-08df-4cb3-8798-de344b480fb3 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:45.372625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a92df-da23-4a7d-acc6-8c85c63fe0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:45.373327 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a92df-da23-4a7d-acc6-8c85c63fe0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:45.373620 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a92df-da23-4a7d-acc6-8c85c63fe0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:45.373907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a92df-da23-4a7d-acc6-8c85c63fe0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:45.374536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a92df-da23-4a7d-acc6-8c85c63fe0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:45.376121 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a92df-da23-4a7d-acc6-8c85c63fe0e3 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:45.386926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1255/2519] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:56:45.391177 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a92df-da23-4a7d-acc6-8c85c63fe0e3 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:45.400539 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a92df-da23-4a7d-acc6-8c85c63fe0e3 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:45.405309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503d0f1-0cfe-4aef-984c-6347bd9d96a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:45.406081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503d0f1-0cfe-4aef-984c-6347bd9d96a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:45.406277 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503d0f1-0cfe-4aef-984c-6347bd9d96a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:45.406378 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503d0f1-0cfe-4aef-984c-6347bd9d96a6 admin admin] PATH_INFO: `/v3/projects/a84da0f559cd4ef083c03826201e7751/users/414bfa09e64c4231a7cc859f3651bcb1/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:45.420620 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503d0f1-0cfe-4aef-984c-6347bd9d96a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a84da0f559cd4ef083c03826201e7751, user_id=414bfa09e64c4231a7cc859f3651bcb1, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:45.423325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503d0f1-0cfe-4aef-984c-6347bd9d96a6 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:45.511708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1256/2520] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:45 2022] PUT /identity/v3/projects/a84da0f559cd4ef083c03826201e7751/users/414bfa09e64c4231a7cc859f3651bcb1/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:56:45.522810 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c7b38-1e67-4f5b-9cd3-8d871d98f72f None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:45.523100 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c7b38-1e67-4f5b-9cd3-8d871d98f72f None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:45.523380 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c7b38-1e67-4f5b-9cd3-8d871d98f72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:45.546242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a0dc6103-6d5a-427d-aba9-55423b4a653d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd130bf777664a62ab043200c84ac8b7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:45.547553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a0dc6103-6d5a-427d-aba9-55423b4a653d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd130bf777664a62ab043200c84ac8b7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:45.553023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-3a7c7b38-1e67-4f5b-9cd3-8d871d98f72f None None] MFA Rules not processed for user `414bfa09e64c4231a7cc859f3651bcb1`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:45.554322 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3a7c7b38-1e67-4f5b-9cd3-8d871d98f72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:45.624572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1257/2521] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:56:45.629230 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c7b38-1e67-4f5b-9cd3-8d871d98f72f None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:45.630221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a0dc6103-6d5a-427d-aba9-55423b4a653d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd130bf777664a62ab043200c84ac8b7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:45.630575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3a7c7b38-1e67-4f5b-9cd3-8d871d98f72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:45.631223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a0dc6103-6d5a-427d-aba9-55423b4a653d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd130bf777664a62ab043200c84ac8b7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:45.645257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a0dc6103-6d5a-427d-aba9-55423b4a653d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd130bf777664a62ab043200c84ac8b7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:45.660328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1265/2522] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:45 2022] DELETE /identity/v3/users/bd130bf777664a62ab043200c84ac8b7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:45.683121 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:45.707101 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c7b38-1e67-4f5b-9cd3-8d871d98f72f None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:45.766676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b420f78-cad6-46f3-9be0-3d09c4fca38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:45.767291 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420f78-cad6-46f3-9be0-3d09c4fca38b admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:45.767573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420f78-cad6-46f3-9be0-3d09c4fca38b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:45.768005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420f78-cad6-46f3-9be0-3d09c4fca38b admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:45.768687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b420f78-cad6-46f3-9be0-3d09c4fca38b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:45.770582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b420f78-cad6-46f3-9be0-3d09c4fca38b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:45.839336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1258/2523] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:45 2022] POST /identity/v3/projects => generated 367 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:56:45.840858 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc6103-6d5a-427d-aba9-55423b4a653d admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:45.850933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc6103-6d5a-427d-aba9-55423b4a653d admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:45.894348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b420f78-cad6-46f3-9be0-3d09c4fca38b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:45.896145 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8b420f78-cad6-46f3-9be0-3d09c4fca38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:45.916939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eec53b-2e2c-419a-9f61-f14806fd1375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:45.917628 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eec53b-2e2c-419a-9f61-f14806fd1375 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:45.917965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eec53b-2e2c-419a-9f61-f14806fd1375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:45.918243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eec53b-2e2c-419a-9f61-f14806fd1375 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:45.918889 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eec53b-2e2c-419a-9f61-f14806fd1375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:45.920939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eec53b-2e2c-419a-9f61-f14806fd1375 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:45.929931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:45.979109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b420f78-cad6-46f3-9be0-3d09c4fca38b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:45.986962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a84aa-8bd3-40d5-a79e-35ca5a13665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:45.987657 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a84aa-8bd3-40d5-a79e-35ca5a13665e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:45.987939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a84aa-8bd3-40d5-a79e-35ca5a13665e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:45.988249 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a84aa-8bd3-40d5-a79e-35ca5a13665e admin admin] PATH_INFO: `/v3/projects/38984b1146604a92847a5db3c209e062` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:45.989427 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a84aa-8bd3-40d5-a79e-35ca5a13665e admin admin] RBAC: Authorizing `identity:delete_project(project_id=38984b1146604a92847a5db3c209e062)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:45.994422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a84aa-8bd3-40d5-a79e-35ca5a13665e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:46.025402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1266/2524] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:45 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:46.026796 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eec53b-2e2c-419a-9f61-f14806fd1375 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:46.036925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eec53b-2e2c-419a-9f61-f14806fd1375 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:46.042189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d38bce-ee78-4570-9a78-3ec733449849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:46.042778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d38bce-ee78-4570-9a78-3ec733449849 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:46.043056 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d38bce-ee78-4570-9a78-3ec733449849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:46.043454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d38bce-ee78-4570-9a78-3ec733449849 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:46.044287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d38bce-ee78-4570-9a78-3ec733449849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:46.045884 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d38bce-ee78-4570-9a78-3ec733449849 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:46.056140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1267/2525] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:56:46.066121 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d38bce-ee78-4570-9a78-3ec733449849 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:46.076398 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d38bce-ee78-4570-9a78-3ec733449849 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:46.082108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39aaa7-8476-4099-a01b-89c3d71b110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:46.082780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39aaa7-8476-4099-a01b-89c3d71b110e admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:46.083067 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39aaa7-8476-4099-a01b-89c3d71b110e admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:46.083343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39aaa7-8476-4099-a01b-89c3d71b110e admin admin] PATH_INFO: `/v3/projects/b0c7d6de05cb47eeb1eb3b370cc9a7f3/users/026e364e086a4d52ab0917e6c74a8f57/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:46.099891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39aaa7-8476-4099-a01b-89c3d71b110e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c7d6de05cb47eeb1eb3b370cc9a7f3, user_id=026e364e086a4d52ab0917e6c74a8f57, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:46.102819 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39aaa7-8476-4099-a01b-89c3d71b110e admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:46.199527 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b74a84aa-8bd3-40d5-a79e-35ca5a13665e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38984b1146604a92847a5db3c209e062', 'request_id': 'req-b74a84aa-8bd3-40d5-a79e-35ca5a13665e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:46.205016 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1268/2526] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:46 2022] PUT /identity/v3/projects/b0c7d6de05cb47eeb1eb3b370cc9a7f3/users/026e364e086a4d52ab0917e6c74a8f57/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:56:46.210828 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39aaa7-8476-4099-a01b-89c3d71b110e admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:46.281227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39aaa7-8476-4099-a01b-89c3d71b110e admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:46.285918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d4bc1-28ed-44e8-8803-c1a129b72d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:46.286528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d4bc1-28ed-44e8-8803-c1a129b72d5d admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:46.286798 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b74a84aa-8bd3-40d5-a79e-35ca5a13665e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38984b1146604a92847a5db3c209e062', 'request_id': 'req-b74a84aa-8bd3-40d5-a79e-35ca5a13665e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:46.286914 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d4bc1-28ed-44e8-8803-c1a129b72d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:46.287072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d4bc1-28ed-44e8-8803-c1a129b72d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:46.287719 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d4bc1-28ed-44e8-8803-c1a129b72d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:46.289362 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d4bc1-28ed-44e8-8803-c1a129b72d5d admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:46.294901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b74a84aa-8bd3-40d5-a79e-35ca5a13665e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38984b1146604a92847a5db3c209e062', 'request_id': 'req-b74a84aa-8bd3-40d5-a79e-35ca5a13665e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:46.304071 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1269/2527] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:46.304290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:46.305113 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d4bc1-28ed-44e8-8803-c1a129b72d5d admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:46.307379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b74a84aa-8bd3-40d5-a79e-35ca5a13665e admin admin] The token cache is being invalidate because project 38984b1146604a92847a5db3c209e062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:46.307733 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b74a84aa-8bd3-40d5-a79e-35ca5a13665e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:46.308454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b74a84aa-8bd3-40d5-a79e-35ca5a13665e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:46.309979 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1259/2528] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:45 2022] DELETE /identity/v3/projects/38984b1146604a92847a5db3c209e062 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:46.314582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993ff77-f207-46fd-b63d-c5c34f42953f None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:46.314872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993ff77-f207-46fd-b63d-c5c34f42953f None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:46.315153 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993ff77-f207-46fd-b63d-c5c34f42953f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:46.315267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d4bc1-28ed-44e8-8803-c1a129b72d5d admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:46.319983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27075f-1318-4ca8-88f2-489494ee642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:46.320664 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27075f-1318-4ca8-88f2-489494ee642e admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:46.320949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27075f-1318-4ca8-88f2-489494ee642e admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:46.321226 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27075f-1318-4ca8-88f2-489494ee642e admin admin] PATH_INFO: `/v3/projects/b0c7d6de05cb47eeb1eb3b370cc9a7f3/users/026e364e086a4d52ab0917e6c74a8f57/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:46.323691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27075f-1318-4ca8-88f2-489494ee642e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c7d6de05cb47eeb1eb3b370cc9a7f3, user_id=026e364e086a4d52ab0917e6c74a8f57, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:46.326368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27075f-1318-4ca8-88f2-489494ee642e admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:46.339473 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1270/2529] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:46 2022] PUT /identity/v3/projects/b0c7d6de05cb47eeb1eb3b370cc9a7f3/users/026e364e086a4d52ab0917e6c74a8f57/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:56:46.339668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-1993ff77-f207-46fd-b63d-c5c34f42953f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:46.341102 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1993ff77-f207-46fd-b63d-c5c34f42953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:46.349667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82d60d-2b64-42ee-945c-d8746deeb4dc None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:46.350046 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82d60d-2b64-42ee-945c-d8746deeb4dc None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:46.350330 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82d60d-2b64-42ee-945c-d8746deeb4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:46.380853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-2a82d60d-2b64-42ee-945c-d8746deeb4dc None None] MFA Rules not processed for user `026e364e086a4d52ab0917e6c74a8f57`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:46.382078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2a82d60d-2b64-42ee-945c-d8746deeb4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:46.409252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1260/2530] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:56:46.417578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4550820-9ff3-4b57-ae65-e603fbd65eec None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:46.417866 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4550820-9ff3-4b57-ae65-e603fbd65eec None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:46.418152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4550820-9ff3-4b57-ae65-e603fbd65eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:46.437995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-f4550820-9ff3-4b57-ae65-e603fbd65eec None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:46.439206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-f4550820-9ff3-4b57-ae65-e603fbd65eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:46.447110 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1261/2531] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:56:46.451264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4550820-9ff3-4b57-ae65-e603fbd65eec None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:46.454118 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1271/2532] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:46.461444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4550820-9ff3-4b57-ae65-e603fbd65eec None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:46.465306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82d60d-2b64-42ee-945c-d8746deeb4dc None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:46.465652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278ad01-0db6-4828-943e-f34ba03adda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:46.466370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278ad01-0db6-4828-943e-f34ba03adda0 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:46.466692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278ad01-0db6-4828-943e-f34ba03adda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:46.466814 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2a82d60d-2b64-42ee-945c-d8746deeb4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:46.466972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278ad01-0db6-4828-943e-f34ba03adda0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:46.467625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278ad01-0db6-4828-943e-f34ba03adda0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:56:46.467983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278ad01-0db6-4828-943e-f34ba03adda0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:46.469610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278ad01-0db6-4828-943e-f34ba03adda0 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:46.482762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1262/2533] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:56:46.486875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278ad01-0db6-4828-943e-f34ba03adda0 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:46.495972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:46.498226 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278ad01-0db6-4828-943e-f34ba03adda0 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:46.503156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea4e3a-01a5-4221-92b4-900f948d0dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:46.503788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea4e3a-01a5-4221-92b4-900f948d0dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:46.504071 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea4e3a-01a5-4221-92b4-900f948d0dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:46.504384 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea4e3a-01a5-4221-92b4-900f948d0dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:46.505019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea4e3a-01a5-4221-92b4-900f948d0dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:46.506918 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea4e3a-01a5-4221-92b4-900f948d0dd0 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:46.527411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82d60d-2b64-42ee-945c-d8746deeb4dc None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:46.535949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f467-e39b-48e6-b642-fd8caec56d08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:46.535949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f467-e39b-48e6-b642-fd8caec56d08 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:46.535949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f467-e39b-48e6-b642-fd8caec56d08 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:46.535949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f467-e39b-48e6-b642-fd8caec56d08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:46.542574 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925f467-e39b-48e6-b642-fd8caec56d08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:46.544039 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925f467-e39b-48e6-b642-fd8caec56d08 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:46.557967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1272/2534] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:56:46.613752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1263/2535] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:46 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:56:46.617942 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f467-e39b-48e6-b642-fd8caec56d08 service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:46.629130 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f467-e39b-48e6-b642-fd8caec56d08 service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:46.686548 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc2c24-a17e-42db-b401-42dca8ec2452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:46.687152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc2c24-a17e-42db-b401-42dca8ec2452 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:46.687431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc2c24-a17e-42db-b401-42dca8ec2452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:46.687704 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc2c24-a17e-42db-b401-42dca8ec2452 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:46.688368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc2c24-a17e-42db-b401-42dca8ec2452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:46.690446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc2c24-a17e-42db-b401-42dca8ec2452 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:46.789912 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1273/2536] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:46 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:46.794627 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea4e3a-01a5-4221-92b4-900f948d0dd0 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:46.805290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea4e3a-01a5-4221-92b4-900f948d0dd0 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:46.811599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1da0d5-6cbb-4ba9-a946-13e513d0304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:46.812260 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1da0d5-6cbb-4ba9-a946-13e513d0304c admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:46.812540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1da0d5-6cbb-4ba9-a946-13e513d0304c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:46.812812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1da0d5-6cbb-4ba9-a946-13e513d0304c admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:46.813469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1da0d5-6cbb-4ba9-a946-13e513d0304c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:46.815507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1da0d5-6cbb-4ba9-a946-13e513d0304c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:46.825849 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1264/2537] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:46.829745 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc2c24-a17e-42db-b401-42dca8ec2452 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:46.841072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc2c24-a17e-42db-b401-42dca8ec2452 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:46.845684 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcbdec-5e07-4110-a3ea-f8bfeeedbcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:46.846276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcbdec-5e07-4110-a3ea-f8bfeeedbcd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:46.846555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcbdec-5e07-4110-a3ea-f8bfeeedbcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:46.846858 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcbdec-5e07-4110-a3ea-f8bfeeedbcd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:46.847500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcbdec-5e07-4110-a3ea-f8bfeeedbcd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:46.849124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcbdec-5e07-4110-a3ea-f8bfeeedbcd9 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:46.859667 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1274/2538] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:46.863834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1da0d5-6cbb-4ba9-a946-13e513d0304c admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:46.873923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1da0d5-6cbb-4ba9-a946-13e513d0304c admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:46.884510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5f610-1d4f-4c34-84f9-9b0dac442b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:46.884510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5f610-1d4f-4c34-84f9-9b0dac442b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:46.884510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5f610-1d4f-4c34-84f9-9b0dac442b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:46.884510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5f610-1d4f-4c34-84f9-9b0dac442b05 admin admin] PATH_INFO: `/v3/projects/9d3f9630bdbe471791821dfee408785b/users/47d526b4a4754091b754d93567987bb6/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:46.893906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5f610-1d4f-4c34-84f9-9b0dac442b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d3f9630bdbe471791821dfee408785b, user_id=47d526b4a4754091b754d93567987bb6, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:46.896567 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5f610-1d4f-4c34-84f9-9b0dac442b05 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:46.984622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1265/2539] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:46 2022] PUT /identity/v3/projects/9d3f9630bdbe471791821dfee408785b/users/47d526b4a4754091b754d93567987bb6/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:46.995317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294c2f2-7b19-4a4c-aeb1-33a672fcd0df None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:46.995610 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294c2f2-7b19-4a4c-aeb1-33a672fcd0df None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:46.995895 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294c2f2-7b19-4a4c-aeb1-33a672fcd0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:47.024470 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-c294c2f2-7b19-4a4c-aeb1-33a672fcd0df None None] MFA Rules not processed for user `47d526b4a4754091b754d93567987bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:47.026226 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c294c2f2-7b19-4a4c-aeb1-33a672fcd0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:47.094209 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1275/2540] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:47.098731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5f610-1d4f-4c34-84f9-9b0dac442b05 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:47.163491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5f610-1d4f-4c34-84f9-9b0dac442b05 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:47.168729 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0d1d8-9328-411d-9312-8904cde3952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:47.169341 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0d1d8-9328-411d-9312-8904cde3952f admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:47.169635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0d1d8-9328-411d-9312-8904cde3952f admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:47.169899 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0d1d8-9328-411d-9312-8904cde3952f admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:47.170621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0d1d8-9328-411d-9312-8904cde3952f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:47.172559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0d1d8-9328-411d-9312-8904cde3952f admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:47.257398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1266/2541] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:47 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:47.258497 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294c2f2-7b19-4a4c-aeb1-33a672fcd0df None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:47.270036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294c2f2-7b19-4a4c-aeb1-33a672fcd0df None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:47.303351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:47.337190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be24ba5-602d-4f76-aa9f-12efc7ed65af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:47.338519 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be24ba5-602d-4f76-aa9f-12efc7ed65af admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:47.339037 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be24ba5-602d-4f76-aa9f-12efc7ed65af admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:47.339465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be24ba5-602d-4f76-aa9f-12efc7ed65af admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:47.340338 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be24ba5-602d-4f76-aa9f-12efc7ed65af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:47.342568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be24ba5-602d-4f76-aa9f-12efc7ed65af admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:47.412767 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1276/2542] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:47 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:56:47.420761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0d1d8-9328-411d-9312-8904cde3952f admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:47.432178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0d1d8-9328-411d-9312-8904cde3952f admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:47.438315 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af6779-0c15-4e13-8dd8-df24b988fa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:47.438748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af6779-0c15-4e13-8dd8-df24b988fa78 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:47.439031 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af6779-0c15-4e13-8dd8-df24b988fa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:47.439310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af6779-0c15-4e13-8dd8-df24b988fa78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:47.440232 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af6779-0c15-4e13-8dd8-df24b988fa78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:47.441849 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af6779-0c15-4e13-8dd8-df24b988fa78 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:47.444158 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:47.454533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1267/2543] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:47.458736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be24ba5-602d-4f76-aa9f-12efc7ed65af admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:47.474081 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be24ba5-602d-4f76-aa9f-12efc7ed65af admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:47.479474 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a943c-4352-4ff1-9aed-8c05fe897232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:47.480170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a943c-4352-4ff1-9aed-8c05fe897232 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:47.480461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a943c-4352-4ff1-9aed-8c05fe897232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:47.480744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a943c-4352-4ff1-9aed-8c05fe897232 admin admin] PATH_INFO: `/v3/projects/83fc34f54fa24cf0b011517a3be9520d/users/f17731da60c749858abd4c90067bd0e0/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:47.496030 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a943c-4352-4ff1-9aed-8c05fe897232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83fc34f54fa24cf0b011517a3be9520d, user_id=f17731da60c749858abd4c90067bd0e0, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:47.498731 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a943c-4352-4ff1-9aed-8c05fe897232 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:47.619601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1277/2544] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:47 2022] PUT /identity/v3/projects/83fc34f54fa24cf0b011517a3be9520d/users/f17731da60c749858abd4c90067bd0e0/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:47.623438 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af6779-0c15-4e13-8dd8-df24b988fa78 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:47.634309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af6779-0c15-4e13-8dd8-df24b988fa78 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:47.690850 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6802cdd-f025-4c87-b090-4f69520fe995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:47.691452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6802cdd-f025-4c87-b090-4f69520fe995 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:47.691731 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6802cdd-f025-4c87-b090-4f69520fe995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:47.692004 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6802cdd-f025-4c87-b090-4f69520fe995 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:47.692670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6802cdd-f025-4c87-b090-4f69520fe995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:47.694238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6802cdd-f025-4c87-b090-4f69520fe995 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:47.704538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1268/2545] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:47.713385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a943c-4352-4ff1-9aed-8c05fe897232 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:47.719765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a943c-4352-4ff1-9aed-8c05fe897232 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:47.725176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f43d8d-671f-49c2-8372-e0e8b1afb875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:47.725176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f43d8d-671f-49c2-8372-e0e8b1afb875 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:47.725374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f43d8d-671f-49c2-8372-e0e8b1afb875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:47.725649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f43d8d-671f-49c2-8372-e0e8b1afb875 admin admin] PATH_INFO: `/v3/projects/83fc34f54fa24cf0b011517a3be9520d/users/f17731da60c749858abd4c90067bd0e0/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:47.727615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f43d8d-671f-49c2-8372-e0e8b1afb875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83fc34f54fa24cf0b011517a3be9520d, user_id=f17731da60c749858abd4c90067bd0e0, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:47.730875 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f43d8d-671f-49c2-8372-e0e8b1afb875 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:47.749655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1278/2546] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:47 2022] PUT /identity/v3/projects/83fc34f54fa24cf0b011517a3be9520d/users/f17731da60c749858abd4c90067bd0e0/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:47.753501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a630b78-8cb5-4d4e-b14b-d739e62d1433 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:47.753789 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a630b78-8cb5-4d4e-b14b-d739e62d1433 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:47.754064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a630b78-8cb5-4d4e-b14b-d739e62d1433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:47.781611 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-8a630b78-8cb5-4d4e-b14b-d739e62d1433 None None] MFA Rules not processed for user `f17731da60c749858abd4c90067bd0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:47.782818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8a630b78-8cb5-4d4e-b14b-d739e62d1433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:47.854099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1269/2547] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:47.867553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f43d8d-671f-49c2-8372-e0e8b1afb875 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:47.925708 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f43d8d-671f-49c2-8372-e0e8b1afb875 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:47.929328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26be2b5-ba9a-4142-8ff3-8ce4e554755c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:47.929924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26be2b5-ba9a-4142-8ff3-8ce4e554755c service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:47.930325 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26be2b5-ba9a-4142-8ff3-8ce4e554755c service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:47.930602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26be2b5-ba9a-4142-8ff3-8ce4e554755c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:47.939655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26be2b5-ba9a-4142-8ff3-8ce4e554755c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:47.941108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26be2b5-ba9a-4142-8ff3-8ce4e554755c service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:47.950846 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1279/2548] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:48.921073 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a630b78-8cb5-4d4e-b14b-d739e62d1433 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:48.930644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a630b78-8cb5-4d4e-b14b-d739e62d1433 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:48.936131 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc3d78-1aa1-4847-a662-dcf2e3b1799b tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17731da60c749858abd4c90067bd0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83fc34f54fa24cf0b011517a3be9520d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:48.936857 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc3d78-1aa1-4847-a662-dcf2e3b1799b tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:48.937151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc3d78-1aa1-4847-a662-dcf2e3b1799b tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:48.937436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc3d78-1aa1-4847-a662-dcf2e3b1799b tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:48.938106 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc3d78-1aa1-4847-a662-dcf2e3b1799b tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:56:48.938419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc3d78-1aa1-4847-a662-dcf2e3b1799b tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:48.940061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc3d78-1aa1-4847-a662-dcf2e3b1799b tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:48.956212 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1270/2549] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:56:48.957460 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26be2b5-ba9a-4142-8ff3-8ce4e554755c service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:48.967741 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26be2b5-ba9a-4142-8ff3-8ce4e554755c service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:48.972590 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edb41e-527c-46ff-8691-a428f716232a tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17731da60c749858abd4c90067bd0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83fc34f54fa24cf0b011517a3be9520d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:48.973229 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edb41e-527c-46ff-8691-a428f716232a tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:48.973566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edb41e-527c-46ff-8691-a428f716232a tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:48.973894 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edb41e-527c-46ff-8691-a428f716232a tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:48.974533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edb41e-527c-46ff-8691-a428f716232a tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:48.976581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edb41e-527c-46ff-8691-a428f716232a tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:49.057188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1280/2550] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:48 2022] POST /identity/v3/projects => generated 353 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:49.058650 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc3d78-1aa1-4847-a662-dcf2e3b1799b tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:49.069146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc3d78-1aa1-4847-a662-dcf2e3b1799b tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:49.132485 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2b71c-6316-42db-a532-26afa7645de4 tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17731da60c749858abd4c90067bd0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83fc34f54fa24cf0b011517a3be9520d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:49.133105 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2b71c-6316-42db-a532-26afa7645de4 tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:49.133392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2b71c-6316-42db-a532-26afa7645de4 tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:49.133735 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2b71c-6316-42db-a532-26afa7645de4 tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:49.134405 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2b71c-6316-42db-a532-26afa7645de4 tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:56:49.134709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2b71c-6316-42db-a532-26afa7645de4 tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:49.136445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2b71c-6316-42db-a532-26afa7645de4 tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:49.147717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:49.152741 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1271/2551] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:56:49.194874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edb41e-527c-46ff-8691-a428f716232a tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:49.205308 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edb41e-527c-46ff-8691-a428f716232a tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:49.209982 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e07cf-1bf7-481e-a971-d4260770519e tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17731da60c749858abd4c90067bd0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83fc34f54fa24cf0b011517a3be9520d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:49.210642 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e07cf-1bf7-481e-a971-d4260770519e tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:49.210929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e07cf-1bf7-481e-a971-d4260770519e tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:49.211206 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e07cf-1bf7-481e-a971-d4260770519e tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] PATH_INFO: `/v3/projects/73e250d0b84b4bf1911e2bb14dafd097` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:49.212896 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e07cf-1bf7-481e-a971-d4260770519e tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] RBAC: Authorizing `identity:delete_project(project_id=73e250d0b84b4bf1911e2bb14dafd097)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:49.214848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e07cf-1bf7-481e-a971-d4260770519e tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:49.267508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2b71c-6316-42db-a532-26afa7645de4 tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:49.272030 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-13a2b71c-6316-42db-a532-26afa7645de4 tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:49.335681 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4d7e07cf-1bf7-481e-a971-d4260770519e tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e250d0b84b4bf1911e2bb14dafd097', 'request_id': 'req-4d7e07cf-1bf7-481e-a971-d4260770519e'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:49.342391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4d7e07cf-1bf7-481e-a971-d4260770519e tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e250d0b84b4bf1911e2bb14dafd097', 'request_id': 'req-4d7e07cf-1bf7-481e-a971-d4260770519e'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:49.351627 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2b71c-6316-42db-a532-26afa7645de4 tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:49.414701 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d494e6-c3ff-4d95-9ffe-aeb5ed04935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:49.415256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d494e6-c3ff-4d95-9ffe-aeb5ed04935a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:49.416042 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d494e6-c3ff-4d95-9ffe-aeb5ed04935a admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:49.416352 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d494e6-c3ff-4d95-9ffe-aeb5ed04935a admin admin] PATH_INFO: `/v3/users/414bfa09e64c4231a7cc859f3651bcb1` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:49.417592 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d494e6-c3ff-4d95-9ffe-aeb5ed04935a admin admin] RBAC: Authorizing `identity:delete_user(user_id=414bfa09e64c4231a7cc859f3651bcb1)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:49.419639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d494e6-c3ff-4d95-9ffe-aeb5ed04935a admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:49.423629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4d7e07cf-1bf7-481e-a971-d4260770519e tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e250d0b84b4bf1911e2bb14dafd097', 'request_id': 'req-4d7e07cf-1bf7-481e-a971-d4260770519e'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:49.425576 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:DELETE=5 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:49.438127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4d7e07cf-1bf7-481e-a971-d4260770519e tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] The token cache is being invalidate because project 73e250d0b84b4bf1911e2bb14dafd097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:49.438446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4d7e07cf-1bf7-481e-a971-d4260770519e tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:49.439173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4d7e07cf-1bf7-481e-a971-d4260770519e tempest-VolumeQuotaClassesTest-549617098 tempest-VolumeQuotaClassesTest-549617098-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:49.440785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1281/2552] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:49 2022] DELETE /identity/v3/projects/73e250d0b84b4bf1911e2bb14dafd097 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:49.628280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-e7d494e6-c3ff-4d95-9ffe-aeb5ed04935a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '414bfa09e64c4231a7cc859f3651bcb1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:49.642320 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-e7d494e6-c3ff-4d95-9ffe-aeb5ed04935a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '414bfa09e64c4231a7cc859f3651bcb1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:49.738412 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-e7d494e6-c3ff-4d95-9ffe-aeb5ed04935a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '414bfa09e64c4231a7cc859f3651bcb1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:49.739055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-e7d494e6-c3ff-4d95-9ffe-aeb5ed04935a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '414bfa09e64c4231a7cc859f3651bcb1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:49.739774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-e7d494e6-c3ff-4d95-9ffe-aeb5ed04935a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '414bfa09e64c4231a7cc859f3651bcb1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:49.759126 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1272/2553] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:49 2022] DELETE /identity/v3/users/414bfa09e64c4231a7cc859f3651bcb1 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:56:49.763708 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb8bfd-2627-4d45-a8a8-d98632d5cccd None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:49.767021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb8bfd-2627-4d45-a8a8-d98632d5cccd None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:49.767021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb8bfd-2627-4d45-a8a8-d98632d5cccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:49.783898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-60bb8bfd-2627-4d45-a8a8-d98632d5cccd None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:49.790045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-60bb8bfd-2627-4d45-a8a8-d98632d5cccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:49.847915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1282/2554] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:56:49.863725 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d494e6-c3ff-4d95-9ffe-aeb5ed04935a admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:49.865186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e7d494e6-c3ff-4d95-9ffe-aeb5ed04935a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:49.899177 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:49.926747 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d494e6-c3ff-4d95-9ffe-aeb5ed04935a admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:49.930300 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7fbbe-ecfd-43ab-bfdc-0e2b909e091d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:49.930954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7fbbe-ecfd-43ab-bfdc-0e2b909e091d service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:49.931231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7fbbe-ecfd-43ab-bfdc-0e2b909e091d service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:49.931504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7fbbe-ecfd-43ab-bfdc-0e2b909e091d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:49.940507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7fbbe-ecfd-43ab-bfdc-0e2b909e091d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:49.941982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7fbbe-ecfd-43ab-bfdc-0e2b909e091d service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:49.951863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1273/2555] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:50.136891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb8bfd-2627-4d45-a8a8-d98632d5cccd None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:50.138413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-60bb8bfd-2627-4d45-a8a8-d98632d5cccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:50.151622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb8bfd-2627-4d45-a8a8-d98632d5cccd None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:50.156298 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daec552-d4c8-4220-87da-0805d21a6c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:50.157046 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daec552-d4c8-4220-87da-0805d21a6c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:50.157274 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daec552-d4c8-4220-87da-0805d21a6c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:50.162656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daec552-d4c8-4220-87da-0805d21a6c2b admin admin] PATH_INFO: `/v3/users/47d526b4a4754091b754d93567987bb6` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:50.162656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daec552-d4c8-4220-87da-0805d21a6c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d526b4a4754091b754d93567987bb6)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:50.162656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daec552-d4c8-4220-87da-0805d21a6c2b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:50.301172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4daec552-d4c8-4220-87da-0805d21a6c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d526b4a4754091b754d93567987bb6'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:50.301774 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4daec552-d4c8-4220-87da-0805d21a6c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d526b4a4754091b754d93567987bb6'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:50.355213 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7fbbe-ecfd-43ab-bfdc-0e2b909e091d service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:50.356893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-cae7fbbe-ecfd-43ab-bfdc-0e2b909e091d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:50.372283 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4daec552-d4c8-4220-87da-0805d21a6c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d526b4a4754091b754d93567987bb6'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:50.372878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4daec552-d4c8-4220-87da-0805d21a6c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d526b4a4754091b754d93567987bb6'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:50.375675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7fbbe-ecfd-43ab-bfdc-0e2b909e091d service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:50.388920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4daec552-d4c8-4220-87da-0805d21a6c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d526b4a4754091b754d93567987bb6'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:50.389445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:50.389721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:50.389972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:50.390293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7 admin admin] PATH_INFO: `/v3/projects/a84da0f559cd4ef083c03826201e7751` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:50.391502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a84da0f559cd4ef083c03826201e7751)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:50.393848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:50.401769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1283/2556] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:50 2022] DELETE /identity/v3/users/47d526b4a4754091b754d93567987bb6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:50.406487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d9a4d-21c3-4835-b23b-79c596f80413 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:50.406856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d9a4d-21c3-4835-b23b-79c596f80413 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:50.407204 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d9a4d-21c3-4835-b23b-79c596f80413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:50.427805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-639d9a4d-21c3-4835-b23b-79c596f80413 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:50.429035 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-639d9a4d-21c3-4835-b23b-79c596f80413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:50.489867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1284/2557] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:50.494044 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a84da0f559cd4ef083c03826201e7751', 'request_id': 'req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:50.499513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d9a4d-21c3-4835-b23b-79c596f80413 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:50.501011 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-639d9a4d-21c3-4835-b23b-79c596f80413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:50.506126 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:50.549670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a84da0f559cd4ef083c03826201e7751', 'request_id': 'req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:50.556602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a84da0f559cd4ef083c03826201e7751', 'request_id': 'req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:50.563129 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d9a4d-21c3-4835-b23b-79c596f80413 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:50.568743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7 admin admin] The token cache is being invalidate because project a84da0f559cd4ef083c03826201e7751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:50.569031 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:50.569675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:50.574096 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1274/2558] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:50 2022] DELETE /identity/v3/projects/a84da0f559cd4ef083c03826201e7751 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:50.584419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:50.584419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:50.620849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9df9c5-2fd5-43e0-8eba-81c7fc972b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:50.621573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9df9c5-2fd5-43e0-8eba-81c7fc972b07 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:50.621862 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9df9c5-2fd5-43e0-8eba-81c7fc972b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:50.622136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9df9c5-2fd5-43e0-8eba-81c7fc972b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:50.624072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9f9df9c5-2fd5-43e0-8eba-81c7fc972b07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:50.669222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eaec97-1fd3-4a99-b7b5-56dbb7c9a1f7 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:50.674151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616229d-ad12-4b76-83ed-78e9cb7594b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:50.675079 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616229d-ad12-4b76-83ed-78e9cb7594b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:50.675628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616229d-ad12-4b76-83ed-78e9cb7594b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:50.675909 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616229d-ad12-4b76-83ed-78e9cb7594b6 admin admin] PATH_INFO: `/v3/users/026e364e086a4d52ab0917e6c74a8f57` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:50.677094 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616229d-ad12-4b76-83ed-78e9cb7594b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=026e364e086a4d52ab0917e6c74a8f57)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:50.679021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616229d-ad12-4b76-83ed-78e9cb7594b6 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:50.688707 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9df9c5-2fd5-43e0-8eba-81c7fc972b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:50.690243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9df9c5-2fd5-43e0-8eba-81c7fc972b07 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:50.699937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1285/2559] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:56:51.049339 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9616229d-ad12-4b76-83ed-78e9cb7594b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026e364e086a4d52ab0917e6c74a8f57'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.054804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:51.062193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9616229d-ad12-4b76-83ed-78e9cb7594b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026e364e086a4d52ab0917e6c74a8f57'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.109415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9616229d-ad12-4b76-83ed-78e9cb7594b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026e364e086a4d52ab0917e6c74a8f57'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.110046 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9616229d-ad12-4b76-83ed-78e9cb7594b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026e364e086a4d52ab0917e6c74a8f57'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.110646 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-9616229d-ad12-4b76-83ed-78e9cb7594b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026e364e086a4d52ab0917e6c74a8f57'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.124432 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1275/2560] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:50 2022] DELETE /identity/v3/users/026e364e086a4d52ab0917e6c74a8f57 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:51.170353 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9df9c5-2fd5-43e0-8eba-81c7fc972b07 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:51.172582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9f9df9c5-2fd5-43e0-8eba-81c7fc972b07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:51.185559 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9df9c5-2fd5-43e0-8eba-81c7fc972b07 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:51.259680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9a124-4dd7-4eac-9e18-86690b2ebc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:51.260368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9a124-4dd7-4eac-9e18-86690b2ebc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:51.260650 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9a124-4dd7-4eac-9e18-86690b2ebc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:51.260927 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9a124-4dd7-4eac-9e18-86690b2ebc82 admin admin] PATH_INFO: `/v3/projects/9d3f9630bdbe471791821dfee408785b` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:51.262078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9a124-4dd7-4eac-9e18-86690b2ebc82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d3f9630bdbe471791821dfee408785b)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:51.264022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9a124-4dd7-4eac-9e18-86690b2ebc82 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:51.274561 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:51.370370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1af9a124-4dd7-4eac-9e18-86690b2ebc82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d3f9630bdbe471791821dfee408785b', 'request_id': 'req-1af9a124-4dd7-4eac-9e18-86690b2ebc82'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.376916 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1af9a124-4dd7-4eac-9e18-86690b2ebc82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d3f9630bdbe471791821dfee408785b', 'request_id': 'req-1af9a124-4dd7-4eac-9e18-86690b2ebc82'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.434449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1af9a124-4dd7-4eac-9e18-86690b2ebc82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d3f9630bdbe471791821dfee408785b', 'request_id': 'req-1af9a124-4dd7-4eac-9e18-86690b2ebc82'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.445586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1af9a124-4dd7-4eac-9e18-86690b2ebc82 admin admin] The token cache is being invalidate because project 9d3f9630bdbe471791821dfee408785b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:51.445879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1af9a124-4dd7-4eac-9e18-86690b2ebc82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.448039 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-1af9a124-4dd7-4eac-9e18-86690b2ebc82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.449966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1286/2561] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:51 2022] DELETE /identity/v3/projects/9d3f9630bdbe471791821dfee408785b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:51.454904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616229d-ad12-4b76-83ed-78e9cb7594b6 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:51.456581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9616229d-ad12-4b76-83ed-78e9cb7594b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:51.471330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616229d-ad12-4b76-83ed-78e9cb7594b6 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:51.526749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c39fab-7552-4f16-a18a-3700a6566d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:51.527385 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c39fab-7552-4f16-a18a-3700a6566d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:51.527664 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c39fab-7552-4f16-a18a-3700a6566d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:51.527937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c39fab-7552-4f16-a18a-3700a6566d24 admin admin] PATH_INFO: `/v3/users/f17731da60c749858abd4c90067bd0e0` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:51.529116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c39fab-7552-4f16-a18a-3700a6566d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17731da60c749858abd4c90067bd0e0)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:51.531033 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c39fab-7552-4f16-a18a-3700a6566d24 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:51.631167 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9a124-4dd7-4eac-9e18-86690b2ebc82 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:51.638108 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-1af9a124-4dd7-4eac-9e18-86690b2ebc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:51.646647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9a124-4dd7-4eac-9e18-86690b2ebc82 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:51.652225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf571ca7-41eb-4172-8e0b-910ccb256cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:51.652861 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf571ca7-41eb-4172-8e0b-910ccb256cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:51.653153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf571ca7-41eb-4172-8e0b-910ccb256cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:51.653433 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf571ca7-41eb-4172-8e0b-910ccb256cb0 admin admin] PATH_INFO: `/v3/projects/b0c7d6de05cb47eeb1eb3b370cc9a7f3` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:51.654580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf571ca7-41eb-4172-8e0b-910ccb256cb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c7d6de05cb47eeb1eb3b370cc9a7f3)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:51.656894 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf571ca7-41eb-4172-8e0b-910ccb256cb0 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:51.804375 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-17c39fab-7552-4f16-a18a-3700a6566d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17731da60c749858abd4c90067bd0e0'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.808896 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bf571ca7-41eb-4172-8e0b-910ccb256cb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c7d6de05cb47eeb1eb3b370cc9a7f3', 'request_id': 'req-bf571ca7-41eb-4172-8e0b-910ccb256cb0'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.815842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bf571ca7-41eb-4172-8e0b-910ccb256cb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c7d6de05cb47eeb1eb3b370cc9a7f3', 'request_id': 'req-bf571ca7-41eb-4172-8e0b-910ccb256cb0'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.817482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-17c39fab-7552-4f16-a18a-3700a6566d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17731da60c749858abd4c90067bd0e0'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.880544 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bf571ca7-41eb-4172-8e0b-910ccb256cb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c7d6de05cb47eeb1eb3b370cc9a7f3', 'request_id': 'req-bf571ca7-41eb-4172-8e0b-910ccb256cb0'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.891431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bf571ca7-41eb-4172-8e0b-910ccb256cb0 admin admin] The token cache is being invalidate because project b0c7d6de05cb47eeb1eb3b370cc9a7f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:51.891716 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bf571ca7-41eb-4172-8e0b-910ccb256cb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.892361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bf571ca7-41eb-4172-8e0b-910ccb256cb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.893871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1287/2562] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:51 2022] DELETE /identity/v3/projects/b0c7d6de05cb47eeb1eb3b370cc9a7f3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:56:51.898807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cb50c-7d42-4efc-a54b-dd0bc8aeb15c None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:51.902147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cb50c-7d42-4efc-a54b-dd0bc8aeb15c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:51.902147 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cb50c-7d42-4efc-a54b-dd0bc8aeb15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:51.918849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-7f3cb50c-7d42-4efc-a54b-dd0bc8aeb15c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:51.920155 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-7f3cb50c-7d42-4efc-a54b-dd0bc8aeb15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:51.949723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-17c39fab-7552-4f16-a18a-3700a6566d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17731da60c749858abd4c90067bd0e0'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.950350 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-17c39fab-7552-4f16-a18a-3700a6566d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17731da60c749858abd4c90067bd0e0'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.951051 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-17c39fab-7552-4f16-a18a-3700a6566d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17731da60c749858abd4c90067bd0e0'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:51.964439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1276/2563] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:51 2022] DELETE /identity/v3/users/f17731da60c749858abd4c90067bd0e0 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:51.983163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1288/2564] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:56:51.995662 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe7355-1097-4bcc-b789-79c9caeab74d None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:51.995997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe7355-1097-4bcc-b789-79c9caeab74d None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:51.996316 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe7355-1097-4bcc-b789-79c9caeab74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.018670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-6afe7355-1097-4bcc-b789-79c9caeab74d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:52.020191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6afe7355-1097-4bcc-b789-79c9caeab74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:52.067416 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:52.082019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1277/2565] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:52.086348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cb50c-7d42-4efc-a54b-dd0bc8aeb15c None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:52.096594 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cb50c-7d42-4efc-a54b-dd0bc8aeb15c None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:52.101249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b357d2b-d300-424a-a7f6-2487949e065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:52.101845 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b357d2b-d300-424a-a7f6-2487949e065b admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:52.102135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b357d2b-d300-424a-a7f6-2487949e065b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:52.102402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b357d2b-d300-424a-a7f6-2487949e065b admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.103701 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b357d2b-d300-424a-a7f6-2487949e065b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:56:52.104009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b357d2b-d300-424a-a7f6-2487949e065b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:52.105642 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b357d2b-d300-424a-a7f6-2487949e065b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:52.117251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1289/2566] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:56:52.122314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe7355-1097-4bcc-b789-79c9caeab74d None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:52.131619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe7355-1097-4bcc-b789-79c9caeab74d None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:52.136335 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9805e3-d9a6-4f47-afcb-c47de4f57ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:52.136971 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9805e3-d9a6-4f47-afcb-c47de4f57ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:52.137279 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9805e3-d9a6-4f47-afcb-c47de4f57ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:52.137524 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9805e3-d9a6-4f47-afcb-c47de4f57ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.138188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9805e3-d9a6-4f47-afcb-c47de4f57ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:52.140164 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9805e3-d9a6-4f47-afcb-c47de4f57ab2 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:52.237029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1278/2567] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:52 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:52.241349 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b357d2b-d300-424a-a7f6-2487949e065b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:52.252503 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b357d2b-d300-424a-a7f6-2487949e065b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:52.257364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:52.310155 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91486edb-c4c8-40b5-a3e9-60d11aed8ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:52.310785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91486edb-c4c8-40b5-a3e9-60d11aed8ffb admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:52.311051 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91486edb-c4c8-40b5-a3e9-60d11aed8ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:52.311331 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91486edb-c4c8-40b5-a3e9-60d11aed8ffb admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.311958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91486edb-c4c8-40b5-a3e9-60d11aed8ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:52.314032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91486edb-c4c8-40b5-a3e9-60d11aed8ffb admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:52.374271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9805e3-d9a6-4f47-afcb-c47de4f57ab2 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:52.378768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-2b9805e3-d9a6-4f47-afcb-c47de4f57ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:52.389217 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9805e3-d9a6-4f47-afcb-c47de4f57ab2 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:52.404228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1290/2568] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:52 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:56:52.404452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210608b8-06de-4e92-82d6-aedce1b8843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:52.404452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210608b8-06de-4e92-82d6-aedce1b8843a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:52.404452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210608b8-06de-4e92-82d6-aedce1b8843a admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:52.404452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210608b8-06de-4e92-82d6-aedce1b8843a admin admin] PATH_INFO: `/v3/projects/83fc34f54fa24cf0b011517a3be9520d` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.405814 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91486edb-c4c8-40b5-a3e9-60d11aed8ffb admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:52.406449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210608b8-06de-4e92-82d6-aedce1b8843a admin admin] RBAC: Authorizing `identity:delete_project(project_id=83fc34f54fa24cf0b011517a3be9520d)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:52.408663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210608b8-06de-4e92-82d6-aedce1b8843a admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:52.419668 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91486edb-c4c8-40b5-a3e9-60d11aed8ffb admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:52.430009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3838c5-c9e9-464f-8c57-3d8051db510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:52.430009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3838c5-c9e9-464f-8c57-3d8051db510a admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:52.430009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3838c5-c9e9-464f-8c57-3d8051db510a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:52.430009 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3838c5-c9e9-464f-8c57-3d8051db510a admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.430421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3838c5-c9e9-464f-8c57-3d8051db510a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:52.430421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3838c5-c9e9-464f-8c57-3d8051db510a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:52.440474 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1291/2569] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:56:52.444506 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3838c5-c9e9-464f-8c57-3d8051db510a admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:52.454163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3838c5-c9e9-464f-8c57-3d8051db510a admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:52.458839 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d2829-5b03-42ad-b5e6-5e5c5bc44a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:52.459414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d2829-5b03-42ad-b5e6-5e5c5bc44a31 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:52.459697 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d2829-5b03-42ad-b5e6-5e5c5bc44a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:52.459977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d2829-5b03-42ad-b5e6-5e5c5bc44a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.460631 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d2829-5b03-42ad-b5e6-5e5c5bc44a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:52.462318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d2829-5b03-42ad-b5e6-5e5c5bc44a31 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:52.472835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1292/2570] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:56:52.476861 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d2829-5b03-42ad-b5e6-5e5c5bc44a31 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:52.486857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d2829-5b03-42ad-b5e6-5e5c5bc44a31 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:52.491505 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe9c92-26cf-4a09-ab14-9aa56df7df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:52.492141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe9c92-26cf-4a09-ab14-9aa56df7df87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:52.492429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe9c92-26cf-4a09-ab14-9aa56df7df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:52.492706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe9c92-26cf-4a09-ab14-9aa56df7df87 admin admin] PATH_INFO: `/v3/projects/ee80dec2aab64277a907845481e6fa53/users/61a48728d49741be9eea763beea03adb/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.508299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe9c92-26cf-4a09-ab14-9aa56df7df87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee80dec2aab64277a907845481e6fa53, user_id=61a48728d49741be9eea763beea03adb, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:52.511550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe9c92-26cf-4a09-ab14-9aa56df7df87 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:52.517398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-210608b8-06de-4e92-82d6-aedce1b8843a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83fc34f54fa24cf0b011517a3be9520d', 'request_id': 'req-210608b8-06de-4e92-82d6-aedce1b8843a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:52.584051 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1293/2571] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:52 2022] PUT /identity/v3/projects/ee80dec2aab64277a907845481e6fa53/users/61a48728d49741be9eea763beea03adb/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:56:52.594180 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68708e-055d-4756-920e-039acc5b2c93 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:52.594469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68708e-055d-4756-920e-039acc5b2c93 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:52.594737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68708e-055d-4756-920e-039acc5b2c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.594913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-210608b8-06de-4e92-82d6-aedce1b8843a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83fc34f54fa24cf0b011517a3be9520d', 'request_id': 'req-210608b8-06de-4e92-82d6-aedce1b8843a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:52.601588 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-210608b8-06de-4e92-82d6-aedce1b8843a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83fc34f54fa24cf0b011517a3be9520d', 'request_id': 'req-210608b8-06de-4e92-82d6-aedce1b8843a'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:52.621121 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-210608b8-06de-4e92-82d6-aedce1b8843a admin admin] The token cache is being invalidate because project 83fc34f54fa24cf0b011517a3be9520d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:52.621695 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-210608b8-06de-4e92-82d6-aedce1b8843a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:52.622961 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-210608b8-06de-4e92-82d6-aedce1b8843a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:52.625282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-9c68708e-055d-4756-920e-039acc5b2c93 None None] MFA Rules not processed for user `61a48728d49741be9eea763beea03adb`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:52.625708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1279/2572] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:52 2022] DELETE /identity/v3/projects/83fc34f54fa24cf0b011517a3be9520d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:56:52.626579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9c68708e-055d-4756-920e-039acc5b2c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:52.630957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ed8e6-8920-41c4-b1ed-80ef580e0fc6 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:52.631265 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ed8e6-8920-41c4-b1ed-80ef580e0fc6 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:52.631540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ed8e6-8920-41c4-b1ed-80ef580e0fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.656061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-540ed8e6-8920-41c4-b1ed-80ef580e0fc6 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:52.657485 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-540ed8e6-8920-41c4-b1ed-80ef580e0fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:52.693924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1294/2573] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:56:52.698370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68708e-055d-4756-920e-039acc5b2c93 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:52.699712 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9c68708e-055d-4756-920e-039acc5b2c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:52.722511 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1280/2574] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:56:52.730829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732abd83-acdf-4b94-83a9-714f89b988fa None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:52.731198 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732abd83-acdf-4b94-83a9-714f89b988fa None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:52.731474 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732abd83-acdf-4b94-83a9-714f89b988fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.747810 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:52.750880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-732abd83-acdf-4b94-83a9-714f89b988fa None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:52.752104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-732abd83-acdf-4b94-83a9-714f89b988fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:52.760210 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1281/2575] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:56:52.768257 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68708e-055d-4756-920e-039acc5b2c93 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:52.769614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732abd83-acdf-4b94-83a9-714f89b988fa None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:52.773838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31938a75-b83a-4e87-8312-8b983dc8c281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:52.774497 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31938a75-b83a-4e87-8312-8b983dc8c281 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:52.775296 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31938a75-b83a-4e87-8312-8b983dc8c281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:52.775577 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31938a75-b83a-4e87-8312-8b983dc8c281 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.776248 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31938a75-b83a-4e87-8312-8b983dc8c281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:52.778187 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31938a75-b83a-4e87-8312-8b983dc8c281 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:52.779371 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732abd83-acdf-4b94-83a9-714f89b988fa None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:52.784227 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a2e32-71b7-4d3f-90d6-d016aaddabf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:52.784872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a2e32-71b7-4d3f-90d6-d016aaddabf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:52.785151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a2e32-71b7-4d3f-90d6-d016aaddabf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:52.785424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a2e32-71b7-4d3f-90d6-d016aaddabf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.786074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a2e32-71b7-4d3f-90d6-d016aaddabf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:56:52.786378 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a2e32-71b7-4d3f-90d6-d016aaddabf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:52.787953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a2e32-71b7-4d3f-90d6-d016aaddabf3 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:52.801903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1282/2576] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:56:52.806312 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a2e32-71b7-4d3f-90d6-d016aaddabf3 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:52.816773 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a2e32-71b7-4d3f-90d6-d016aaddabf3 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:52.821990 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0cf1e-a961-434f-aa24-5839c90d594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:52.822594 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0cf1e-a961-434f-aa24-5839c90d594d admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:52.822874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0cf1e-a961-434f-aa24-5839c90d594d admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:52.823149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0cf1e-a961-434f-aa24-5839c90d594d admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.823776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0cf1e-a961-434f-aa24-5839c90d594d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:52.825754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0cf1e-a961-434f-aa24-5839c90d594d admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:52.862379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1295/2577] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:52 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:56:52.863425 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31938a75-b83a-4e87-8312-8b983dc8c281 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:52.905844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1283/2578] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:52 2022] POST /identity/v3/projects => generated 407 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:56:52.909883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0cf1e-a961-434f-aa24-5839c90d594d admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:52.922944 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:52.927345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31938a75-b83a-4e87-8312-8b983dc8c281 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:52.980578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0cf1e-a961-434f-aa24-5839c90d594d admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:52.985526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348a144-b83a-4c87-b7be-245aee624582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:52.986144 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348a144-b83a-4c87-b7be-245aee624582 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:52.986429 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348a144-b83a-4c87-b7be-245aee624582 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:52.986704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348a144-b83a-4c87-b7be-245aee624582 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.987415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348a144-b83a-4c87-b7be-245aee624582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:52.989475 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348a144-b83a-4c87-b7be-245aee624582 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:52.995111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9e6b-2bc3-46c3-a112-b43e7891d5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:52.995825 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9e6b-2bc3-46c3-a112-b43e7891d5fd admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:52.996036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9e6b-2bc3-46c3-a112-b43e7891d5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:52.996295 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9e6b-2bc3-46c3-a112-b43e7891d5fd admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:52.996923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c9e6b-2bc3-46c3-a112-b43e7891d5fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:52.999706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c9e6b-2bc3-46c3-a112-b43e7891d5fd admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.087777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1284/2579] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:52 2022] POST /identity/v3/users => generated 304 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:56:53.092068 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348a144-b83a-4c87-b7be-245aee624582 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:53.098391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1296/2580] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:52 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:53.102306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9e6b-2bc3-46c3-a112-b43e7891d5fd admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:53.102560 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348a144-b83a-4c87-b7be-245aee624582 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:53.107238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c4b08-c222-494e-9131-bfd22fbc8406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:53.107825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c4b08-c222-494e-9131-bfd22fbc8406 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.108138 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c4b08-c222-494e-9131-bfd22fbc8406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.108418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c4b08-c222-494e-9131-bfd22fbc8406 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.109083 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c4b08-c222-494e-9131-bfd22fbc8406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:53.110743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c4b08-c222-494e-9131-bfd22fbc8406 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.112487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9e6b-2bc3-46c3-a112-b43e7891d5fd admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:53.117554 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17c8c5-2157-40bf-989e-642d3f3ccf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:53.118153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17c8c5-2157-40bf-989e-642d3f3ccf86 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.118437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17c8c5-2157-40bf-989e-642d3f3ccf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.118716 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17c8c5-2157-40bf-989e-642d3f3ccf86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.119372 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17c8c5-2157-40bf-989e-642d3f3ccf86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:53.121061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1285/2581] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:56:53.121251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17c8c5-2157-40bf-989e-642d3f3ccf86 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.124869 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c4b08-c222-494e-9131-bfd22fbc8406 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:53.135122 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1297/2582] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:56:53.135291 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c4b08-c222-494e-9131-bfd22fbc8406 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:53.136117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17c8c5-2157-40bf-989e-642d3f3ccf86 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:53.139556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642a488-718d-406a-bb61-20ea3ad853fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:53.140167 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642a488-718d-406a-bb61-20ea3ad853fe admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.140488 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642a488-718d-406a-bb61-20ea3ad853fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.140836 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642a488-718d-406a-bb61-20ea3ad853fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.141338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642a488-718d-406a-bb61-20ea3ad853fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:53.142888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642a488-718d-406a-bb61-20ea3ad853fe admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.145612 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17c8c5-2157-40bf-989e-642d3f3ccf86 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:53.151547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786edd9-d649-4c3f-827c-a20a1f26c1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:53.152225 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786edd9-d649-4c3f-827c-a20a1f26c1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.152511 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786edd9-d649-4c3f-827c-a20a1f26c1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.152789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786edd9-d649-4c3f-827c-a20a1f26c1c4 admin admin] PATH_INFO: `/v3/projects/1a334223cccd47cea10fc45692b1c4ed/users/2ad83739ae4e41c29d589d18bb23c34d/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.155198 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1286/2583] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:56:53.159344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642a488-718d-406a-bb61-20ea3ad853fe admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:53.168590 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786edd9-d649-4c3f-827c-a20a1f26c1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a334223cccd47cea10fc45692b1c4ed, user_id=2ad83739ae4e41c29d589d18bb23c34d, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:53.169108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642a488-718d-406a-bb61-20ea3ad853fe admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:53.171247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786edd9-d649-4c3f-827c-a20a1f26c1c4 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.173710 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fe0b9-c801-4cd3-972c-d121f335d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:53.174348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fe0b9-c801-4cd3-972c-d121f335d478 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.174625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fe0b9-c801-4cd3-972c-d121f335d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.174899 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fe0b9-c801-4cd3-972c-d121f335d478 admin admin] PATH_INFO: `/v3/projects/788bac4d48d14edd9ba5b15fc34dd469/users/e33ac9a102fd40e19809c708a0b5c664/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.189292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fe0b9-c801-4cd3-972c-d121f335d478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=788bac4d48d14edd9ba5b15fc34dd469, user_id=e33ac9a102fd40e19809c708a0b5c664, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:53.191924 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fe0b9-c801-4cd3-972c-d121f335d478 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.235374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1298/2584] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:53 2022] PUT /identity/v3/projects/1a334223cccd47cea10fc45692b1c4ed/users/2ad83739ae4e41c29d589d18bb23c34d/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:53.239267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786edd9-d649-4c3f-827c-a20a1f26c1c4 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:53.253597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1287/2585] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:53 2022] PUT /identity/v3/projects/788bac4d48d14edd9ba5b15fc34dd469/users/e33ac9a102fd40e19809c708a0b5c664/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:56:53.264356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f1f3c-b94a-4000-b581-3b14bedc5552 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.264640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f1f3c-b94a-4000-b581-3b14bedc5552 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.264915 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f1f3c-b94a-4000-b581-3b14bedc5552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.273090 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:53.293174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-b48f1f3c-b94a-4000-b581-3b14bedc5552 None None] MFA Rules not processed for user `e33ac9a102fd40e19809c708a0b5c664`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:53.294393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b48f1f3c-b94a-4000-b581-3b14bedc5552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:53.305419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786edd9-d649-4c3f-827c-a20a1f26c1c4 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:53.361889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1288/2586] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:53 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:56:53.365302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9c94a-19a2-4b54-960d-1b101d95b22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:53.366024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9c94a-19a2-4b54-960d-1b101d95b22e admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.366211 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f1f3c-b94a-4000-b581-3b14bedc5552 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:53.366330 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9c94a-19a2-4b54-960d-1b101d95b22e admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.366569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9c94a-19a2-4b54-960d-1b101d95b22e admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.367214 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9c94a-19a2-4b54-960d-1b101d95b22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:53.369665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9c94a-19a2-4b54-960d-1b101d95b22e admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.377367 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f1f3c-b94a-4000-b581-3b14bedc5552 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:53.380181 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1299/2587] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:56:53.384300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9c94a-19a2-4b54-960d-1b101d95b22e admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:53.385343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d0a33-26d1-4d3e-8df3-11376adebd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:53.385952 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d0a33-26d1-4d3e-8df3-11376adebd59 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.386370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d0a33-26d1-4d3e-8df3-11376adebd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.386669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d0a33-26d1-4d3e-8df3-11376adebd59 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.387333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d0a33-26d1-4d3e-8df3-11376adebd59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:53.389309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d0a33-26d1-4d3e-8df3-11376adebd59 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.393959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9c94a-19a2-4b54-960d-1b101d95b22e admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:53.398514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93a6e8-4bf4-4425-a22f-bfc81d5472f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:53.399153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93a6e8-4bf4-4425-a22f-bfc81d5472f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.399435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93a6e8-4bf4-4425-a22f-bfc81d5472f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.399736 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93a6e8-4bf4-4425-a22f-bfc81d5472f9 admin admin] PATH_INFO: `/v3/projects/1a334223cccd47cea10fc45692b1c4ed/users/2ad83739ae4e41c29d589d18bb23c34d/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.401778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93a6e8-4bf4-4425-a22f-bfc81d5472f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a334223cccd47cea10fc45692b1c4ed, user_id=2ad83739ae4e41c29d589d18bb23c34d, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:53.404451 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93a6e8-4bf4-4425-a22f-bfc81d5472f9 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.414792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1300/2588] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:53 2022] PUT /identity/v3/projects/1a334223cccd47cea10fc45692b1c4ed/users/2ad83739ae4e41c29d589d18bb23c34d/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:56:53.428624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557a676-7efe-479d-a161-5977d69b0a0d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.428910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557a676-7efe-479d-a161-5977d69b0a0d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.429183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557a676-7efe-479d-a161-5977d69b0a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.456454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-a557a676-7efe-479d-a161-5977d69b0a0d None None] MFA Rules not processed for user `2ad83739ae4e41c29d589d18bb23c34d`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:53.457675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a557a676-7efe-479d-a161-5977d69b0a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:53.489389 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1289/2589] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:53 2022] POST /identity/v3/projects => generated 407 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:56:53.493469 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d0a33-26d1-4d3e-8df3-11376adebd59 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:53.519584 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:53.531823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1301/2590] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:56:53.543665 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557a676-7efe-479d-a161-5977d69b0a0d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:53.545793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a557a676-7efe-479d-a161-5977d69b0a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:53.559180 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d0a33-26d1-4d3e-8df3-11376adebd59 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:53.564201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57039976-99d4-4005-90ed-32c2359b3310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:53.564986 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57039976-99d4-4005-90ed-32c2359b3310 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.565473 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57039976-99d4-4005-90ed-32c2359b3310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.565920 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57039976-99d4-4005-90ed-32c2359b3310 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.567222 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57039976-99d4-4005-90ed-32c2359b3310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:53.569274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57039976-99d4-4005-90ed-32c2359b3310 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.591691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:53.602386 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557a676-7efe-479d-a161-5977d69b0a0d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:53.641725 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1290/2591] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:53 2022] POST /identity/v3/users => generated 310 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:56:53.646289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57039976-99d4-4005-90ed-32c2359b3310 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:53.655243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8f0fd-5b20-4833-8618-781b8b2cbf66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:53.655860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8f0fd-5b20-4833-8618-781b8b2cbf66 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.656205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8f0fd-5b20-4833-8618-781b8b2cbf66 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.656485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8f0fd-5b20-4833-8618-781b8b2cbf66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.656643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57039976-99d4-4005-90ed-32c2359b3310 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:53.661269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c37da6-246c-4f30-b804-da5285daaafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:53.661857 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c37da6-246c-4f30-b804-da5285daaafa admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.662140 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c37da6-246c-4f30-b804-da5285daaafa admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.662534 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c37da6-246c-4f30-b804-da5285daaafa admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.663178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c37da6-246c-4f30-b804-da5285daaafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:53.664802 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c37da6-246c-4f30-b804-da5285daaafa admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.676072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1291/2592] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:56:53.680113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c37da6-246c-4f30-b804-da5285daaafa admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:53.690309 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c37da6-246c-4f30-b804-da5285daaafa admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:53.694969 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d39bfd-ed7a-4ebc-b172-53d4b738dd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:53.695603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d39bfd-ed7a-4ebc-b172-53d4b738dd15 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.695892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d39bfd-ed7a-4ebc-b172-53d4b738dd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.696194 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d39bfd-ed7a-4ebc-b172-53d4b738dd15 admin admin] PATH_INFO: `/v3/projects/597c25761dc747dfad2d0b2d84834a51/users/3e5e5b89407645b0b00af8e217badd38/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.711196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d39bfd-ed7a-4ebc-b172-53d4b738dd15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=597c25761dc747dfad2d0b2d84834a51, user_id=3e5e5b89407645b0b00af8e217badd38, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:53.714514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d39bfd-ed7a-4ebc-b172-53d4b738dd15 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.721109 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8f0fd-5b20-4833-8618-781b8b2cbf66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:53.722572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8f0fd-5b20-4833-8618-781b8b2cbf66 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.732801 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1302/2593] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:56:53.778578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1292/2594] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:53 2022] PUT /identity/v3/projects/597c25761dc747dfad2d0b2d84834a51/users/3e5e5b89407645b0b00af8e217badd38/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:56:53.782705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8f0fd-5b20-4833-8618-781b8b2cbf66 service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:53.793906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8f0fd-5b20-4833-8618-781b8b2cbf66 service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:53.801589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d39bfd-ed7a-4ebc-b172-53d4b738dd15 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:53.856509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cc059-84d2-4bc9-b3ac-cdd73a97d38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:53.857230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cc059-84d2-4bc9-b3ac-cdd73a97d38c admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.857506 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cc059-84d2-4bc9-b3ac-cdd73a97d38c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.857836 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cc059-84d2-4bc9-b3ac-cdd73a97d38c admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.858906 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cc059-84d2-4bc9-b3ac-cdd73a97d38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:53.860618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cc059-84d2-4bc9-b3ac-cdd73a97d38c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.865291 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d39bfd-ed7a-4ebc-b172-53d4b738dd15 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:53.870534 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4217393-1f12-4361-b59c-0d030fb33fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:53.871316 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217393-1f12-4361-b59c-0d030fb33fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.871452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1303/2595] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:53.874586 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217393-1f12-4361-b59c-0d030fb33fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.874873 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217393-1f12-4361-b59c-0d030fb33fd8 admin admin] PATH_INFO: `/v3/users/61a48728d49741be9eea763beea03adb` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.875337 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cc059-84d2-4bc9-b3ac-cdd73a97d38c admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:53.876151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4217393-1f12-4361-b59c-0d030fb33fd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a48728d49741be9eea763beea03adb)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:53.878093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4217393-1f12-4361-b59c-0d030fb33fd8 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.886223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cc059-84d2-4bc9-b3ac-cdd73a97d38c admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:53.891509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7074d-c4aa-4167-bf4a-bde5cfeeeeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:53.892240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7074d-c4aa-4167-bf4a-bde5cfeeeeb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.892472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7074d-c4aa-4167-bf4a-bde5cfeeeeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.892754 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7074d-c4aa-4167-bf4a-bde5cfeeeeb1 admin admin] PATH_INFO: `/v3/projects/597c25761dc747dfad2d0b2d84834a51/users/3e5e5b89407645b0b00af8e217badd38/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:53.894668 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7074d-c4aa-4167-bf4a-bde5cfeeeeb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=597c25761dc747dfad2d0b2d84834a51, user_id=3e5e5b89407645b0b00af8e217badd38, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:53.897341 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7074d-c4aa-4167-bf4a-bde5cfeeeeb1 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:53.908237 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1304/2596] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:53 2022] PUT /identity/v3/projects/597c25761dc747dfad2d0b2d84834a51/users/3e5e5b89407645b0b00af8e217badd38/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:56:53.919442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5688e-721c-4af1-82d4-fa46ce96f65d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:53.921871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5688e-721c-4af1-82d4-fa46ce96f65d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:53.921871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5688e-721c-4af1-82d4-fa46ce96f65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:54.067010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b4217393-1f12-4361-b59c-0d030fb33fd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a48728d49741be9eea763beea03adb'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:54.067261 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-d2c5688e-721c-4af1-82d4-fa46ce96f65d None None] MFA Rules not processed for user `3e5e5b89407645b0b00af8e217badd38`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:54.068492 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d2c5688e-721c-4af1-82d4-fa46ce96f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:54.080541 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b4217393-1f12-4361-b59c-0d030fb33fd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a48728d49741be9eea763beea03adb'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:54.089331 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:54.137182 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1305/2597] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:53 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:56:54.147368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b4217393-1f12-4361-b59c-0d030fb33fd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a48728d49741be9eea763beea03adb'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:54.147368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b4217393-1f12-4361-b59c-0d030fb33fd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a48728d49741be9eea763beea03adb'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:54.147368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b4217393-1f12-4361-b59c-0d030fb33fd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a48728d49741be9eea763beea03adb'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:54.147973 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5688e-721c-4af1-82d4-fa46ce96f65d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:54.152543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:54.159790 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1293/2598] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:53 2022] DELETE /identity/v3/users/61a48728d49741be9eea763beea03adb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:54.164305 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938269b-22ba-4a32-8e1a-b70773aa3330 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:54.164593 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938269b-22ba-4a32-8e1a-b70773aa3330 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:54.165434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938269b-22ba-4a32-8e1a-b70773aa3330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:54.184324 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-6938269b-22ba-4a32-8e1a-b70773aa3330 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:54.187320 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6938269b-22ba-4a32-8e1a-b70773aa3330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:54.202178 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5688e-721c-4af1-82d4-fa46ce96f65d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:54.245107 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1294/2599] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:56:54.253420 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecd614-0315-4663-95af-aaa4c86a9e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:54.254086 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecd614-0315-4663-95af-aaa4c86a9e5a service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:54.254374 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecd614-0315-4663-95af-aaa4c86a9e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:54.254647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecd614-0315-4663-95af-aaa4c86a9e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:54.255287 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938269b-22ba-4a32-8e1a-b70773aa3330 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:54.256443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a1ecd614-0315-4663-95af-aaa4c86a9e5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:54.256706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6938269b-22ba-4a32-8e1a-b70773aa3330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:54.321129 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938269b-22ba-4a32-8e1a-b70773aa3330 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:54.323112 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecd614-0315-4663-95af-aaa4c86a9e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:54.324694 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecd614-0315-4663-95af-aaa4c86a9e5a service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:54.325635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52196eb8-65fd-4ff5-bd98-f96ae55ab7e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:54.326244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52196eb8-65fd-4ff5-bd98-f96ae55ab7e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:54.326519 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52196eb8-65fd-4ff5-bd98-f96ae55ab7e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:54.326791 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52196eb8-65fd-4ff5-bd98-f96ae55ab7e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:54.334714 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1306/2600] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:54 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:56:54.336045 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52196eb8-65fd-4ff5-bd98-f96ae55ab7e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:54.337565 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52196eb8-65fd-4ff5-bd98-f96ae55ab7e9 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:54.348079 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1295/2601] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:54.703044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecd614-0315-4663-95af-aaa4c86a9e5a service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:54.704504 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a1ecd614-0315-4663-95af-aaa4c86a9e5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:54.715750 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecd614-0315-4663-95af-aaa4c86a9e5a service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:54.719830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf0944-b4d1-4a2b-abab-9d49e79ec14b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:54.720465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf0944-b4d1-4a2b-abab-9d49e79ec14b service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:54.720746 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf0944-b4d1-4a2b-abab-9d49e79ec14b service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:54.721021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf0944-b4d1-4a2b-abab-9d49e79ec14b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:54.723168 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-a4cf0944-b4d1-4a2b-abab-9d49e79ec14b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:54.744247 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:54.782935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52196eb8-65fd-4ff5-bd98-f96ae55ab7e9 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:54.786461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-52196eb8-65fd-4ff5-bd98-f96ae55ab7e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:54.789197 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf0944-b4d1-4a2b-abab-9d49e79ec14b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:54.790897 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf0944-b4d1-4a2b-abab-9d49e79ec14b service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:54.801075 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1307/2602] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:54 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:54.816514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52196eb8-65fd-4ff5-bd98-f96ae55ab7e9 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:54.824638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:54.825751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:54.826314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:54.826676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef admin admin] PATH_INFO: `/v3/projects/ee80dec2aab64277a907845481e6fa53` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:54.828408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee80dec2aab64277a907845481e6fa53)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:54.830705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:54.950088 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee80dec2aab64277a907845481e6fa53', 'request_id': 'req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:55.024330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee80dec2aab64277a907845481e6fa53', 'request_id': 'req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:55.030863 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee80dec2aab64277a907845481e6fa53', 'request_id': 'req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:55.043685 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef admin admin] The token cache is being invalidate because project ee80dec2aab64277a907845481e6fa53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:55.043968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:55.044633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:55.046166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1296/2603] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:54 2022] DELETE /identity/v3/projects/ee80dec2aab64277a907845481e6fa53 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:55.050517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf0944-b4d1-4a2b-abab-9d49e79ec14b service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:55.061169 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf0944-b4d1-4a2b-abab-9d49e79ec14b service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:55.116951 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad87c01-ead0-48bd-9c6a-2ce531817528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:55.117603 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad87c01-ead0-48bd-9c6a-2ce531817528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:55.117868 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad87c01-ead0-48bd-9c6a-2ce531817528 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:55.118141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad87c01-ead0-48bd-9c6a-2ce531817528 admin admin] PATH_INFO: `/v3/users/2ad83739ae4e41c29d589d18bb23c34d` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:55.119322 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad87c01-ead0-48bd-9c6a-2ce531817528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad83739ae4e41c29d589d18bb23c34d)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:55.121290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad87c01-ead0-48bd-9c6a-2ce531817528 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:55.311016 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bad87c01-ead0-48bd-9c6a-2ce531817528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad83739ae4e41c29d589d18bb23c34d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:55.311672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bad87c01-ead0-48bd-9c6a-2ce531817528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad83739ae4e41c29d589d18bb23c34d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:55.383756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bad87c01-ead0-48bd-9c6a-2ce531817528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad83739ae4e41c29d589d18bb23c34d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:55.384479 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bad87c01-ead0-48bd-9c6a-2ce531817528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad83739ae4e41c29d589d18bb23c34d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:55.397656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-bad87c01-ead0-48bd-9c6a-2ce531817528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad83739ae4e41c29d589d18bb23c34d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:55.410204 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1308/2604] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:55 2022] DELETE /identity/v3/users/2ad83739ae4e41c29d589d18bb23c34d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:55.819464 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:55.821051 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:55.837572 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc8f99-e887-40d4-bcc5-72f1d9f31bef admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:55.856743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:55.894484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb8b47-7fd9-4607-86a0-c307c8f46d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:55.895133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8b47-7fd9-4607-86a0-c307c8f46d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:55.895418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8b47-7fd9-4607-86a0-c307c8f46d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:55.895697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8b47-7fd9-4607-86a0-c307c8f46d8d admin admin] PATH_INFO: `/v3/projects/1a334223cccd47cea10fc45692b1c4ed` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:55.896860 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb8b47-7fd9-4607-86a0-c307c8f46d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a334223cccd47cea10fc45692b1c4ed)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:55.898782 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb8b47-7fd9-4607-86a0-c307c8f46d8d admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:55.989206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c4bb8b47-7fd9-4607-86a0-c307c8f46d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a334223cccd47cea10fc45692b1c4ed', 'request_id': 'req-c4bb8b47-7fd9-4607-86a0-c307c8f46d8d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:56.041020 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c4bb8b47-7fd9-4607-86a0-c307c8f46d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a334223cccd47cea10fc45692b1c4ed', 'request_id': 'req-c4bb8b47-7fd9-4607-86a0-c307c8f46d8d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:56.046845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c4bb8b47-7fd9-4607-86a0-c307c8f46d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a334223cccd47cea10fc45692b1c4ed', 'request_id': 'req-c4bb8b47-7fd9-4607-86a0-c307c8f46d8d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:56.058715 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c4bb8b47-7fd9-4607-86a0-c307c8f46d8d admin admin] The token cache is being invalidate because project 1a334223cccd47cea10fc45692b1c4ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:56.059745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c4bb8b47-7fd9-4607-86a0-c307c8f46d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:56.059745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c4bb8b47-7fd9-4607-86a0-c307c8f46d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:56.061177 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1297/2605] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:55 2022] DELETE /identity/v3/projects/1a334223cccd47cea10fc45692b1c4ed => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:56.066212 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbc90a-407e-4c84-8547-862b092b3de0 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:56.066499 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbc90a-407e-4c84-8547-862b092b3de0 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:56.066778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbc90a-407e-4c84-8547-862b092b3de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:56.093818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-f5cbc90a-407e-4c84-8547-862b092b3de0 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:56.095078 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f5cbc90a-407e-4c84-8547-862b092b3de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:56.135582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:56.156440 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1309/2606] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:56.220210 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1315b85-9ca2-4d0b-8242-52d470f87984 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:56.220500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1315b85-9ca2-4d0b-8242-52d470f87984 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:56.220790 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1315b85-9ca2-4d0b-8242-52d470f87984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:56.240439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d1315b85-9ca2-4d0b-8242-52d470f87984 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:56.241643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d1315b85-9ca2-4d0b-8242-52d470f87984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:56.249601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1298/2607] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:56.253816 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbc90a-407e-4c84-8547-862b092b3de0 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:56.264212 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbc90a-407e-4c84-8547-862b092b3de0 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:56.268815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe036a-0200-4556-973e-e6b11a8f3f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:56.269407 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe036a-0200-4556-973e-e6b11a8f3f97 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:56.270617 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe036a-0200-4556-973e-e6b11a8f3f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:56.270617 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe036a-0200-4556-973e-e6b11a8f3f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:56.270617 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe036a-0200-4556-973e-e6b11a8f3f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:56:56.270898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe036a-0200-4556-973e-e6b11a8f3f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:56.272562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe036a-0200-4556-973e-e6b11a8f3f97 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:56.284455 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1310/2608] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:56:56.288646 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1315b85-9ca2-4d0b-8242-52d470f87984 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:56.297703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1315b85-9ca2-4d0b-8242-52d470f87984 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:56.302662 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b4ffd-14d0-4f4c-b6bd-00be3455fd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:56.303252 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b4ffd-14d0-4f4c-b6bd-00be3455fd81 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:56.303533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b4ffd-14d0-4f4c-b6bd-00be3455fd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:56.303808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b4ffd-14d0-4f4c-b6bd-00be3455fd81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:56.304475 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b4ffd-14d0-4f4c-b6bd-00be3455fd81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:56.306371 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b4ffd-14d0-4f4c-b6bd-00be3455fd81 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:56.395950 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1299/2609] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:56 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:56.399940 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe036a-0200-4556-973e-e6b11a8f3f97 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:56.409947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe036a-0200-4556-973e-e6b11a8f3f97 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:56.467513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374c39e-b8af-4a3c-b257-737a559bbcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:56.468570 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374c39e-b8af-4a3c-b257-737a559bbcdc admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:56.468855 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374c39e-b8af-4a3c-b257-737a559bbcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:56.469126 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374c39e-b8af-4a3c-b257-737a559bbcdc admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:56.469761 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374c39e-b8af-4a3c-b257-737a559bbcdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:56.471653 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374c39e-b8af-4a3c-b257-737a559bbcdc admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:56.572978 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1311/2610] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:56 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:56.577156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b4ffd-14d0-4f4c-b6bd-00be3455fd81 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:56.587982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b4ffd-14d0-4f4c-b6bd-00be3455fd81 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:56.592659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41342b1f-42f2-457f-89a8-512dc04e0727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:56.593263 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41342b1f-42f2-457f-89a8-512dc04e0727 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:56.593618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41342b1f-42f2-457f-89a8-512dc04e0727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:56.593901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41342b1f-42f2-457f-89a8-512dc04e0727 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:56.594600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41342b1f-42f2-457f-89a8-512dc04e0727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:56.596219 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41342b1f-42f2-457f-89a8-512dc04e0727 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:56.606942 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1300/2611] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:56:56.611481 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374c39e-b8af-4a3c-b257-737a559bbcdc admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:56.622053 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374c39e-b8af-4a3c-b257-737a559bbcdc admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:56.627444 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83551e36-3551-4d5f-b277-370aa6f299d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:56.628070 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83551e36-3551-4d5f-b277-370aa6f299d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:56.628378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83551e36-3551-4d5f-b277-370aa6f299d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:56.628653 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83551e36-3551-4d5f-b277-370aa6f299d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:56.629294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83551e36-3551-4d5f-b277-370aa6f299d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:56.630890 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83551e36-3551-4d5f-b277-370aa6f299d8 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:56.642069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1312/2612] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:56.646490 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41342b1f-42f2-457f-89a8-512dc04e0727 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:56.657157 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41342b1f-42f2-457f-89a8-512dc04e0727 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:56.661874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe2110-5c5d-4c07-881b-615aa78d30c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:56.662521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe2110-5c5d-4c07-881b-615aa78d30c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:56.663715 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe2110-5c5d-4c07-881b-615aa78d30c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:56.663715 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe2110-5c5d-4c07-881b-615aa78d30c8 admin admin] PATH_INFO: `/v3/projects/9f308d7e0461427498afebb0ebc6afea/users/1935b5d3410046359023341c53abc3b7/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:56.678121 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe2110-5c5d-4c07-881b-615aa78d30c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f308d7e0461427498afebb0ebc6afea, user_id=1935b5d3410046359023341c53abc3b7, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:56.680825 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe2110-5c5d-4c07-881b-615aa78d30c8 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:56.743876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1301/2613] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:56 2022] PUT /identity/v3/projects/9f308d7e0461427498afebb0ebc6afea/users/1935b5d3410046359023341c53abc3b7/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:56.753862 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bde62-e404-43d1-ae5f-09144ab87f5d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:56.754148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bde62-e404-43d1-ae5f-09144ab87f5d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:56.754456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bde62-e404-43d1-ae5f-09144ab87f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:56.781896 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ef2bde62-e404-43d1-ae5f-09144ab87f5d None None] MFA Rules not processed for user `1935b5d3410046359023341c53abc3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:56.783103 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ef2bde62-e404-43d1-ae5f-09144ab87f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:56.847914 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1313/2614] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:56.852538 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe2110-5c5d-4c07-881b-615aa78d30c8 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:56.901444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:56.914218 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe2110-5c5d-4c07-881b-615aa78d30c8 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:56.920179 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e3069-39da-4ff2-b387-34674780c9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:56.920744 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e3069-39da-4ff2-b387-34674780c9a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:56.921411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e3069-39da-4ff2-b387-34674780c9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:56.921411 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e3069-39da-4ff2-b387-34674780c9a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:56.921919 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e3069-39da-4ff2-b387-34674780c9a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:56.923829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e3069-39da-4ff2-b387-34674780c9a8 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:57.049178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1302/2615] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:56:56 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:57.053431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bde62-e404-43d1-ae5f-09144ab87f5d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:57.065575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bde62-e404-43d1-ae5f-09144ab87f5d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:57.098581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:57.122223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21191a-1117-4f59-9933-d0bc7ad0be7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:57.122834 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21191a-1117-4f59-9933-d0bc7ad0be7f admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:57.123118 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21191a-1117-4f59-9933-d0bc7ad0be7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:57.123398 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21191a-1117-4f59-9933-d0bc7ad0be7f admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:57.124026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21191a-1117-4f59-9933-d0bc7ad0be7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:57.125975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21191a-1117-4f59-9933-d0bc7ad0be7f admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:57.212683 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1314/2616] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:56:57 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:56:57.216573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e3069-39da-4ff2-b387-34674780c9a8 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:57.226972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e3069-39da-4ff2-b387-34674780c9a8 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:57.232108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe0770-4418-45d4-98e3-9f97c48e84be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:57.232748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe0770-4418-45d4-98e3-9f97c48e84be admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:57.233027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe0770-4418-45d4-98e3-9f97c48e84be admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:57.233298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe0770-4418-45d4-98e3-9f97c48e84be admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:57.233938 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe0770-4418-45d4-98e3-9f97c48e84be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:57.235500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe0770-4418-45d4-98e3-9f97c48e84be admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:57.245953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1303/2617] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:56:57.249996 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21191a-1117-4f59-9933-d0bc7ad0be7f admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:57.259915 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21191a-1117-4f59-9933-d0bc7ad0be7f admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:57.264511 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07933ed8-25c6-4702-a99e-45d581e2fc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:57.265155 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07933ed8-25c6-4702-a99e-45d581e2fc63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:57.265437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07933ed8-25c6-4702-a99e-45d581e2fc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:57.265717 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07933ed8-25c6-4702-a99e-45d581e2fc63 admin admin] PATH_INFO: `/v3/projects/20bc3e1a443e4964bfe8623d7b200414/users/01e44dcd6f6f478ca0e29e4cf40cf49a/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:57.280720 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07933ed8-25c6-4702-a99e-45d581e2fc63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20bc3e1a443e4964bfe8623d7b200414, user_id=01e44dcd6f6f478ca0e29e4cf40cf49a, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:57.283371 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07933ed8-25c6-4702-a99e-45d581e2fc63 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:57.366607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1315/2618] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:57 2022] PUT /identity/v3/projects/20bc3e1a443e4964bfe8623d7b200414/users/01e44dcd6f6f478ca0e29e4cf40cf49a/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:56:57.370727 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe0770-4418-45d4-98e3-9f97c48e84be admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:57.380602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe0770-4418-45d4-98e3-9f97c48e84be admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:57.437681 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561a2b3-3e5d-432c-8b07-fee13882989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:57.438286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561a2b3-3e5d-432c-8b07-fee13882989c admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:57.438620 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561a2b3-3e5d-432c-8b07-fee13882989c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:57.438899 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561a2b3-3e5d-432c-8b07-fee13882989c admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:57.439544 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561a2b3-3e5d-432c-8b07-fee13882989c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:57.441172 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561a2b3-3e5d-432c-8b07-fee13882989c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:57.450797 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1304/2619] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:56:57.454933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07933ed8-25c6-4702-a99e-45d581e2fc63 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:57.471119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07933ed8-25c6-4702-a99e-45d581e2fc63 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:57.471119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0a9ee-6cbe-4a26-96ca-c3d756964eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:57.471475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0a9ee-6cbe-4a26-96ca-c3d756964eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:57.471753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0a9ee-6cbe-4a26-96ca-c3d756964eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:57.472024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0a9ee-6cbe-4a26-96ca-c3d756964eb8 admin admin] PATH_INFO: `/v3/projects/20bc3e1a443e4964bfe8623d7b200414/users/01e44dcd6f6f478ca0e29e4cf40cf49a/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:57.474012 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0a9ee-6cbe-4a26-96ca-c3d756964eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20bc3e1a443e4964bfe8623d7b200414, user_id=01e44dcd6f6f478ca0e29e4cf40cf49a, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:57.476649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0a9ee-6cbe-4a26-96ca-c3d756964eb8 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:57.487324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1316/2620] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:56:57 2022] PUT /identity/v3/projects/20bc3e1a443e4964bfe8623d7b200414/users/01e44dcd6f6f478ca0e29e4cf40cf49a/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:57.499701 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5abbbc-7440-49cf-8574-16eff4361b6e None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:57.499998 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5abbbc-7440-49cf-8574-16eff4361b6e None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:57.500311 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5abbbc-7440-49cf-8574-16eff4361b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:57.528811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-9f5abbbc-7440-49cf-8574-16eff4361b6e None None] MFA Rules not processed for user `01e44dcd6f6f478ca0e29e4cf40cf49a`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:57.530056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-9f5abbbc-7440-49cf-8574-16eff4361b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:57.597719 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1305/2621] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:57.610429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0a9ee-6cbe-4a26-96ca-c3d756964eb8 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:57.612263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c8b0a9ee-6cbe-4a26-96ca-c3d756964eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:57.670348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0a9ee-6cbe-4a26-96ca-c3d756964eb8 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:57.673985 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd91ac-1aef-47b7-97c2-27fe051f302a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:57.674574 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd91ac-1aef-47b7-97c2-27fe051f302a service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:57.674852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd91ac-1aef-47b7-97c2-27fe051f302a service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:57.675124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd91ac-1aef-47b7-97c2-27fe051f302a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:57.684917 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd91ac-1aef-47b7-97c2-27fe051f302a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:57.686344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd91ac-1aef-47b7-97c2-27fe051f302a service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:57.695820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1317/2622] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:57.872196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5abbbc-7440-49cf-8574-16eff4361b6e None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:57.881847 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5abbbc-7440-49cf-8574-16eff4361b6e None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:57.885488 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c901d9-f616-4a44-9db2-1d68560e3e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:57.886088 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c901d9-f616-4a44-9db2-1d68560e3e9d service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:57.886373 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c901d9-f616-4a44-9db2-1d68560e3e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:57.886650 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c901d9-f616-4a44-9db2-1d68560e3e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:57.928346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:57.943034 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c901d9-f616-4a44-9db2-1d68560e3e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:57.944516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c901d9-f616-4a44-9db2-1d68560e3e9d service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:57.953284 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1306/2623] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:58.370103 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd91ac-1aef-47b7-97c2-27fe051f302a service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:58.432525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd91ac-1aef-47b7-97c2-27fe051f302a service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:58.437024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d96f3-8893-45c0-a023-5e50f020249a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:58.437645 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d96f3-8893-45c0-a023-5e50f020249a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:58.437947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d96f3-8893-45c0-a023-5e50f020249a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:58.438217 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d96f3-8893-45c0-a023-5e50f020249a admin admin] PATH_INFO: `/v3/users/1935b5d3410046359023341c53abc3b7` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:58.439458 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d96f3-8893-45c0-a023-5e50f020249a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1935b5d3410046359023341c53abc3b7)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:58.442023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d96f3-8893-45c0-a023-5e50f020249a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:58.588972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:58.597914 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-fe9d96f3-8893-45c0-a023-5e50f020249a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1935b5d3410046359023341c53abc3b7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:58.598564 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-fe9d96f3-8893-45c0-a023-5e50f020249a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1935b5d3410046359023341c53abc3b7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:58.687066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-fe9d96f3-8893-45c0-a023-5e50f020249a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1935b5d3410046359023341c53abc3b7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:58.687845 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-fe9d96f3-8893-45c0-a023-5e50f020249a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1935b5d3410046359023341c53abc3b7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:58.700863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-fe9d96f3-8893-45c0-a023-5e50f020249a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1935b5d3410046359023341c53abc3b7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:58.713495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1318/2624] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:58 2022] DELETE /identity/v3/users/1935b5d3410046359023341c53abc3b7 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:58.720361 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76420aa8-a971-4826-bb68-1bdb56d9ba21 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:58.720654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76420aa8-a971-4826-bb68-1bdb56d9ba21 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:58.720962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76420aa8-a971-4826-bb68-1bdb56d9ba21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:58.741721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-76420aa8-a971-4826-bb68-1bdb56d9ba21 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:56:58.742866 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-76420aa8-a971-4826-bb68-1bdb56d9ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:58.804345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1307/2625] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:56:58.814172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d96f3-8893-45c0-a023-5e50f020249a admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:58.815607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-fe9d96f3-8893-45c0-a023-5e50f020249a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:58.873403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d96f3-8893-45c0-a023-5e50f020249a admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:58.877189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d0767-f7a1-438c-b921-d8b0e2f8cef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:58.877830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d0767-f7a1-438c-b921-d8b0e2f8cef7 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:58.878105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d0767-f7a1-438c-b921-d8b0e2f8cef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:58.878378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d0767-f7a1-438c-b921-d8b0e2f8cef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:58.887464 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d0767-f7a1-438c-b921-d8b0e2f8cef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:58.888961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d0767-f7a1-438c-b921-d8b0e2f8cef7 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:58.898495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1319/2626] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:59.345508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76420aa8-a971-4826-bb68-1bdb56d9ba21 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:59.357757 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-76420aa8-a971-4826-bb68-1bdb56d9ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:59.361714 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76420aa8-a971-4826-bb68-1bdb56d9ba21 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:59.366484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540aec0-bd2b-42ff-982a-573bb283ba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:59.368990 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540aec0-bd2b-42ff-982a-573bb283ba95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:59.369276 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540aec0-bd2b-42ff-982a-573bb283ba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:59.369551 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540aec0-bd2b-42ff-982a-573bb283ba95 admin admin] PATH_INFO: `/v3/projects/9f308d7e0461427498afebb0ebc6afea` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:59.370721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540aec0-bd2b-42ff-982a-573bb283ba95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f308d7e0461427498afebb0ebc6afea)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:59.372792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540aec0-bd2b-42ff-982a-573bb283ba95 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:59.487617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-1540aec0-bd2b-42ff-982a-573bb283ba95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f308d7e0461427498afebb0ebc6afea', 'request_id': 'req-1540aec0-bd2b-42ff-982a-573bb283ba95'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:59.583942 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-1540aec0-bd2b-42ff-982a-573bb283ba95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f308d7e0461427498afebb0ebc6afea', 'request_id': 'req-1540aec0-bd2b-42ff-982a-573bb283ba95'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:59.591663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-1540aec0-bd2b-42ff-982a-573bb283ba95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f308d7e0461427498afebb0ebc6afea', 'request_id': 'req-1540aec0-bd2b-42ff-982a-573bb283ba95'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:59.604206 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-1540aec0-bd2b-42ff-982a-573bb283ba95 admin admin] The token cache is being invalidate because project 9f308d7e0461427498afebb0ebc6afea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:56:59.604661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-1540aec0-bd2b-42ff-982a-573bb283ba95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:59.605174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-1540aec0-bd2b-42ff-982a-573bb283ba95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:59.606667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1308/2627] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:56:59 2022] DELETE /identity/v3/projects/9f308d7e0461427498afebb0ebc6afea => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:59.611022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d0767-f7a1-438c-b921-d8b0e2f8cef7 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:59.621438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d0767-f7a1-438c-b921-d8b0e2f8cef7 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:59.679456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc9c7c-e005-49d5-9dbc-dbc91f88ba5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:59.680076 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9c7c-e005-49d5-9dbc-dbc91f88ba5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:59.680380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9c7c-e005-49d5-9dbc-dbc91f88ba5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:59.680691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9c7c-e005-49d5-9dbc-dbc91f88ba5e admin admin] PATH_INFO: `/v3/users/01e44dcd6f6f478ca0e29e4cf40cf49a` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:59.681784 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc9c7c-e005-49d5-9dbc-dbc91f88ba5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e44dcd6f6f478ca0e29e4cf40cf49a)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:59.683818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc9c7c-e005-49d5-9dbc-dbc91f88ba5e admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:59.859783 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-76fc9c7c-e005-49d5-9dbc-dbc91f88ba5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e44dcd6f6f478ca0e29e4cf40cf49a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:59.860397 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-76fc9c7c-e005-49d5-9dbc-dbc91f88ba5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e44dcd6f6f478ca0e29e4cf40cf49a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:59.928303 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-76fc9c7c-e005-49d5-9dbc-dbc91f88ba5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e44dcd6f6f478ca0e29e4cf40cf49a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:59.928303 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-76fc9c7c-e005-49d5-9dbc-dbc91f88ba5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e44dcd6f6f478ca0e29e4cf40cf49a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:59.929590 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:59.941312 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-76fc9c7c-e005-49d5-9dbc-dbc91f88ba5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e44dcd6f6f478ca0e29e4cf40cf49a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:56:59.953750 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1320/2628] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:56:59 2022] DELETE /identity/v3/users/01e44dcd6f6f478ca0e29e4cf40cf49a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:00.328994 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540aec0-bd2b-42ff-982a-573bb283ba95 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:00.330590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1540aec0-bd2b-42ff-982a-573bb283ba95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:00.346550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540aec0-bd2b-42ff-982a-573bb283ba95 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:00.405930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9783ec-4e50-444f-86b8-6e169e30dab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:00.406494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9783ec-4e50-444f-86b8-6e169e30dab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:00.406807 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9783ec-4e50-444f-86b8-6e169e30dab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:00.407085 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9783ec-4e50-444f-86b8-6e169e30dab8 admin admin] PATH_INFO: `/v3/projects/20bc3e1a443e4964bfe8623d7b200414` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:00.408294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9783ec-4e50-444f-86b8-6e169e30dab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20bc3e1a443e4964bfe8623d7b200414)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:00.410228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9783ec-4e50-444f-86b8-6e169e30dab8 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:00.418064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:00.498095 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-1e9783ec-4e50-444f-86b8-6e169e30dab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20bc3e1a443e4964bfe8623d7b200414', 'request_id': 'req-1e9783ec-4e50-444f-86b8-6e169e30dab8'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:00.554999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-1e9783ec-4e50-444f-86b8-6e169e30dab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20bc3e1a443e4964bfe8623d7b200414', 'request_id': 'req-1e9783ec-4e50-444f-86b8-6e169e30dab8'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:00.561173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-1e9783ec-4e50-444f-86b8-6e169e30dab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20bc3e1a443e4964bfe8623d7b200414', 'request_id': 'req-1e9783ec-4e50-444f-86b8-6e169e30dab8'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:00.573639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-1e9783ec-4e50-444f-86b8-6e169e30dab8 admin admin] The token cache is being invalidate because project 20bc3e1a443e4964bfe8623d7b200414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:57:00.573925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-1e9783ec-4e50-444f-86b8-6e169e30dab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:00.574579 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-1e9783ec-4e50-444f-86b8-6e169e30dab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:00.576217 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1309/2629] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:57:00 2022] DELETE /identity/v3/projects/20bc3e1a443e4964bfe8623d7b200414 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:00.581949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01047c9c-f866-4421-8838-29ac5b409164 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:00.586306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01047c9c-f866-4421-8838-29ac5b409164 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:00.586306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01047c9c-f866-4421-8838-29ac5b409164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:00.615642 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-01047c9c-f866-4421-8838-29ac5b409164 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:00.616893 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-01047c9c-f866-4421-8838-29ac5b409164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:00.689045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1321/2630] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:00.697244 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12461dd-b807-45d9-a36f-abb57c0e1bbf None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:00.697535 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12461dd-b807-45d9-a36f-abb57c0e1bbf None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:00.697812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12461dd-b807-45d9-a36f-abb57c0e1bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:00.717813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d12461dd-b807-45d9-a36f-abb57c0e1bbf None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:00.719103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d12461dd-b807-45d9-a36f-abb57c0e1bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:00.727052 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1310/2631] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:00.731957 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01047c9c-f866-4421-8838-29ac5b409164 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:00.741597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01047c9c-f866-4421-8838-29ac5b409164 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:00.746935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacf630-e94a-409f-a79f-ce9c7233bb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:00.747542 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacf630-e94a-409f-a79f-ce9c7233bb35 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:00.747824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacf630-e94a-409f-a79f-ce9c7233bb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:00.748114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacf630-e94a-409f-a79f-ce9c7233bb35 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:00.748792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacf630-e94a-409f-a79f-ce9c7233bb35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:57:00.749094 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacf630-e94a-409f-a79f-ce9c7233bb35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:00.750678 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacf630-e94a-409f-a79f-ce9c7233bb35 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:00.762341 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1322/2632] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:57:00.766844 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12461dd-b807-45d9-a36f-abb57c0e1bbf None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:00.776178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12461dd-b807-45d9-a36f-abb57c0e1bbf None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:00.780855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce0e76-6d65-4c3e-8480-d6069a671701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:00.781450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce0e76-6d65-4c3e-8480-d6069a671701 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:00.781734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce0e76-6d65-4c3e-8480-d6069a671701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:00.782013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce0e76-6d65-4c3e-8480-d6069a671701 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:00.782652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce0e76-6d65-4c3e-8480-d6069a671701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:00.784587 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce0e76-6d65-4c3e-8480-d6069a671701 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:00.893633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1311/2633] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:00 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:57:00.897921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacf630-e94a-409f-a79f-ce9c7233bb35 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:00.908026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacf630-e94a-409f-a79f-ce9c7233bb35 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:00.964817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108f48a-837d-4ec2-bbac-0190efc84b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:00.965383 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108f48a-837d-4ec2-bbac-0190efc84b93 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:00.965668 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108f48a-837d-4ec2-bbac-0190efc84b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:00.965943 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108f48a-837d-4ec2-bbac-0190efc84b93 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:00.966565 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108f48a-837d-4ec2-bbac-0190efc84b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:00.968530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108f48a-837d-4ec2-bbac-0190efc84b93 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:01.042091 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1323/2634] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:00 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:01.051379 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce0e76-6d65-4c3e-8480-d6069a671701 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:01.056923 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce0e76-6d65-4c3e-8480-d6069a671701 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:01.061694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1800fa0-53af-4fec-a6eb-eaade39b56b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:01.062329 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1800fa0-53af-4fec-a6eb-eaade39b56b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:01.062623 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1800fa0-53af-4fec-a6eb-eaade39b56b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:01.062898 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1800fa0-53af-4fec-a6eb-eaade39b56b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:01.063587 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1800fa0-53af-4fec-a6eb-eaade39b56b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:01.065193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1800fa0-53af-4fec-a6eb-eaade39b56b0 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:01.075200 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1312/2635] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:57:01.079324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108f48a-837d-4ec2-bbac-0190efc84b93 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:01.090356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108f48a-837d-4ec2-bbac-0190efc84b93 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:01.095123 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32514bf5-4bc4-4bf0-bb64-1cd24f8d0c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:01.095719 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32514bf5-4bc4-4bf0-bb64-1cd24f8d0c8f admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:01.096002 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32514bf5-4bc4-4bf0-bb64-1cd24f8d0c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:01.096356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32514bf5-4bc4-4bf0-bb64-1cd24f8d0c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:01.097006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32514bf5-4bc4-4bf0-bb64-1cd24f8d0c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:01.098590 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32514bf5-4bc4-4bf0-bb64-1cd24f8d0c8f admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:01.110069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1324/2636] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:01.114212 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1800fa0-53af-4fec-a6eb-eaade39b56b0 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:01.124262 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1800fa0-53af-4fec-a6eb-eaade39b56b0 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:01.129062 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fef827-d3e6-438f-b936-f3c832c66541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:01.129714 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef827-d3e6-438f-b936-f3c832c66541 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:01.129997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef827-d3e6-438f-b936-f3c832c66541 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:01.130275 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef827-d3e6-438f-b936-f3c832c66541 admin admin] PATH_INFO: `/v3/projects/92dfe6a7a5bc4513945f3d2ec89848ee/users/cc2eae43d6204498951822d3acceec5f/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:01.145218 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fef827-d3e6-438f-b936-f3c832c66541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92dfe6a7a5bc4513945f3d2ec89848ee, user_id=cc2eae43d6204498951822d3acceec5f, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:01.147934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fef827-d3e6-438f-b936-f3c832c66541 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:01.211521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1313/2637] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:01 2022] PUT /identity/v3/projects/92dfe6a7a5bc4513945f3d2ec89848ee/users/cc2eae43d6204498951822d3acceec5f/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:01.222633 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da90c7-21ae-48d9-897b-fcfd39753c7c None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:01.222842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da90c7-21ae-48d9-897b-fcfd39753c7c None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:01.223117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da90c7-21ae-48d9-897b-fcfd39753c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:01.251206 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-08da90c7-21ae-48d9-897b-fcfd39753c7c None None] MFA Rules not processed for user `cc2eae43d6204498951822d3acceec5f`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:01.252478 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-08da90c7-21ae-48d9-897b-fcfd39753c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:01.281678 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:01.316631 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1325/2638] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:01.322115 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fef827-d3e6-438f-b936-f3c832c66541 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:01.384146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fef827-d3e6-438f-b936-f3c832c66541 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:01.388913 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470fff8-3aa0-4983-bb9c-3bf74335aaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:01.389520 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470fff8-3aa0-4983-bb9c-3bf74335aaa4 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:01.389802 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470fff8-3aa0-4983-bb9c-3bf74335aaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:01.390079 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470fff8-3aa0-4983-bb9c-3bf74335aaa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:01.390705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470fff8-3aa0-4983-bb9c-3bf74335aaa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:01.392631 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470fff8-3aa0-4983-bb9c-3bf74335aaa4 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:01.507047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da90c7-21ae-48d9-897b-fcfd39753c7c None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:01.507552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1314/2639] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:01 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:01.508792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-08da90c7-21ae-48d9-897b-fcfd39753c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:01.511418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470fff8-3aa0-4983-bb9c-3bf74335aaa4 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:01.522765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da90c7-21ae-48d9-897b-fcfd39753c7c None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:01.531792 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:01.576025 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470fff8-3aa0-4983-bb9c-3bf74335aaa4 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:01.580774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cfa92-aa44-4e50-9f09-c057af84a42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:01.581399 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cfa92-aa44-4e50-9f09-c057af84a42e admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:01.581686 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cfa92-aa44-4e50-9f09-c057af84a42e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:01.581878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f43635-e183-4143-af81-9b8f3b2f39c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:01.582023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cfa92-aa44-4e50-9f09-c057af84a42e admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:01.582477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f43635-e183-4143-af81-9b8f3b2f39c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:01.582758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f43635-e183-4143-af81-9b8f3b2f39c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:01.583034 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f43635-e183-4143-af81-9b8f3b2f39c5 admin admin] PATH_INFO: `/v3/users/e33ac9a102fd40e19809c708a0b5c664` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:01.584212 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f43635-e183-4143-af81-9b8f3b2f39c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e33ac9a102fd40e19809c708a0b5c664)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:01.584770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cfa92-aa44-4e50-9f09-c057af84a42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:01.586294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f43635-e183-4143-af81-9b8f3b2f39c5 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:01.586984 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cfa92-aa44-4e50-9f09-c057af84a42e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:01.668772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1315/2640] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:01 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:57:01.672763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cfa92-aa44-4e50-9f09-c057af84a42e admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:01.682641 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cfa92-aa44-4e50-9f09-c057af84a42e admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:01.687446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6736c08-460f-44c0-928b-414dacaa5518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:01.688055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6736c08-460f-44c0-928b-414dacaa5518 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:01.688365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6736c08-460f-44c0-928b-414dacaa5518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:01.688663 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6736c08-460f-44c0-928b-414dacaa5518 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:01.689348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6736c08-460f-44c0-928b-414dacaa5518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:01.690976 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6736c08-460f-44c0-928b-414dacaa5518 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:01.702372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1316/2641] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:57:01.706235 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6736c08-460f-44c0-928b-414dacaa5518 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:01.715993 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6736c08-460f-44c0-928b-414dacaa5518 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:01.720748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e98a4-fbb5-4ff8-9efe-e6f66190b65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:01.721361 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e98a4-fbb5-4ff8-9efe-e6f66190b65b admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:01.721639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e98a4-fbb5-4ff8-9efe-e6f66190b65b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:01.721910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e98a4-fbb5-4ff8-9efe-e6f66190b65b admin admin] PATH_INFO: `/v3/projects/12aace7cc40748a0899b8f34f4289198/users/2cc037f2387744ef979d5a1ced10fb41/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:01.736191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e98a4-fbb5-4ff8-9efe-e6f66190b65b admin admin] RBAC: Authorizing `identity:create_grant(project_id=12aace7cc40748a0899b8f34f4289198, user_id=2cc037f2387744ef979d5a1ced10fb41, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:01.738786 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e98a4-fbb5-4ff8-9efe-e6f66190b65b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:01.769366 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b4f43635-e183-4143-af81-9b8f3b2f39c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e33ac9a102fd40e19809c708a0b5c664'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:01.770090 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b4f43635-e183-4143-af81-9b8f3b2f39c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e33ac9a102fd40e19809c708a0b5c664'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:01.829653 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1317/2642] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:01 2022] PUT /identity/v3/projects/12aace7cc40748a0899b8f34f4289198/users/2cc037f2387744ef979d5a1ced10fb41/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:57:01.833633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e98a4-fbb5-4ff8-9efe-e6f66190b65b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:01.834672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b4f43635-e183-4143-af81-9b8f3b2f39c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e33ac9a102fd40e19809c708a0b5c664'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:01.837081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a25e98a4-fbb5-4ff8-9efe-e6f66190b65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:01.837198 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b4f43635-e183-4143-af81-9b8f3b2f39c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e33ac9a102fd40e19809c708a0b5c664'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:01.848191 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b4f43635-e183-4143-af81-9b8f3b2f39c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e33ac9a102fd40e19809c708a0b5c664'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:01.860938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1326/2643] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:57:01 2022] DELETE /identity/v3/users/e33ac9a102fd40e19809c708a0b5c664 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:01.865340 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b938a-22db-4ff6-a1cb-1d7285e9e687 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:01.865630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b938a-22db-4ff6-a1cb-1d7285e9e687 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:01.866057 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b938a-22db-4ff6-a1cb-1d7285e9e687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:01.885984 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-182b938a-22db-4ff6-a1cb-1d7285e9e687 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:01.887199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-182b938a-22db-4ff6-a1cb-1d7285e9e687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:01.900490 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e98a4-fbb5-4ff8-9efe-e6f66190b65b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:01.930313 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:01.945631 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1327/2644] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:57:01.955939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b938a-22db-4ff6-a1cb-1d7285e9e687 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:01.957318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-182b938a-22db-4ff6-a1cb-1d7285e9e687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:01.959428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef6111-aac5-4451-8125-4189903ea348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:01.960197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef6111-aac5-4451-8125-4189903ea348 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:01.960487 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef6111-aac5-4451-8125-4189903ea348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:01.960764 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef6111-aac5-4451-8125-4189903ea348 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:01.961422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef6111-aac5-4451-8125-4189903ea348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:01.963575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef6111-aac5-4451-8125-4189903ea348 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:01.973598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1318/2645] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:57:01.978459 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef6111-aac5-4451-8125-4189903ea348 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:01.991758 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef6111-aac5-4451-8125-4189903ea348 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:01.997047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76346b2-8949-4e52-a1d5-68ea25d6ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:02.000047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76346b2-8949-4e52-a1d5-68ea25d6ede5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:02.000047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76346b2-8949-4e52-a1d5-68ea25d6ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:02.000047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76346b2-8949-4e52-a1d5-68ea25d6ede5 admin admin] PATH_INFO: `/v3/projects/12aace7cc40748a0899b8f34f4289198/users/2cc037f2387744ef979d5a1ced10fb41/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:02.000407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76346b2-8949-4e52-a1d5-68ea25d6ede5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12aace7cc40748a0899b8f34f4289198, user_id=2cc037f2387744ef979d5a1ced10fb41, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:02.003060 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76346b2-8949-4e52-a1d5-68ea25d6ede5 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:02.014033 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1319/2646] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:01 2022] PUT /identity/v3/projects/12aace7cc40748a0899b8f34f4289198/users/2cc037f2387744ef979d5a1ced10fb41/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:02.020757 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b938a-22db-4ff6-a1cb-1d7285e9e687 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:02.025690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46103569-6eca-4a2c-9499-ba211d37bccb None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:02.028772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46103569-6eca-4a2c-9499-ba211d37bccb None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:02.028772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46103569-6eca-4a2c-9499-ba211d37bccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:02.034262 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:02.055602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-46103569-6eca-4a2c-9499-ba211d37bccb None None] MFA Rules not processed for user `2cc037f2387744ef979d5a1ced10fb41`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:02.056858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-46103569-6eca-4a2c-9499-ba211d37bccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:02.068712 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4a904-7854-4f62-ae95-31d0b50d6862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:02.069324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4a904-7854-4f62-ae95-31d0b50d6862 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:02.069607 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4a904-7854-4f62-ae95-31d0b50d6862 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:02.069882 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4a904-7854-4f62-ae95-31d0b50d6862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:02.126738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1320/2647] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:57:02.132662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4a904-7854-4f62-ae95-31d0b50d6862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:02.134825 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4a904-7854-4f62-ae95-31d0b50d6862 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:02.138384 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46103569-6eca-4a2c-9499-ba211d37bccb None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:02.139763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-46103569-6eca-4a2c-9499-ba211d37bccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:02.144881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1328/2648] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:57:02.205275 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46103569-6eca-4a2c-9499-ba211d37bccb None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:02.210294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2ded3-f40b-41bc-8bd1-2b4d2d4629b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:02.210971 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2ded3-f40b-41bc-8bd1-2b4d2d4629b0 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:02.211260 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2ded3-f40b-41bc-8bd1-2b4d2d4629b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:02.211529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2ded3-f40b-41bc-8bd1-2b4d2d4629b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:02.213396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b5d2ded3-f40b-41bc-8bd1-2b4d2d4629b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:02.276921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2ded3-f40b-41bc-8bd1-2b4d2d4629b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:02.279135 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2ded3-f40b-41bc-8bd1-2b4d2d4629b0 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:02.288839 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1321/2649] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:57:02.552662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4a904-7854-4f62-ae95-31d0b50d6862 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:02.554856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ded4a904-7854-4f62-ae95-31d0b50d6862 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:02.574231 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4a904-7854-4f62-ae95-31d0b50d6862 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:02.579528 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:02.579891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:02.580284 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:02.580616 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b admin admin] PATH_INFO: `/v3/projects/788bac4d48d14edd9ba5b15fc34dd469` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:02.585260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b admin admin] RBAC: Authorizing `identity:delete_project(project_id=788bac4d48d14edd9ba5b15fc34dd469)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:02.585260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:02.773270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '788bac4d48d14edd9ba5b15fc34dd469', 'request_id': 'req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:02.774984 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:02.781262 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '788bac4d48d14edd9ba5b15fc34dd469', 'request_id': 'req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:02.903571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '788bac4d48d14edd9ba5b15fc34dd469', 'request_id': 'req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:02.915243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b admin admin] The token cache is being invalidate because project 788bac4d48d14edd9ba5b15fc34dd469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:57:02.916919 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:02.916919 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:02.917686 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1329/2650] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:57:02 2022] DELETE /identity/v3/projects/788bac4d48d14edd9ba5b15fc34dd469 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:02.921739 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2ded3-f40b-41bc-8bd1-2b4d2d4629b0 service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:02.932824 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2ded3-f40b-41bc-8bd1-2b4d2d4629b0 service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:02.980229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:02.997214 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bcbe3-e673-4702-baad-67569ef02ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:02.997848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bcbe3-e673-4702-baad-67569ef02ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:02.998125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bcbe3-e673-4702-baad-67569ef02ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:02.998398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bcbe3-e673-4702-baad-67569ef02ffc admin admin] PATH_INFO: `/v3/users/3e5e5b89407645b0b00af8e217badd38` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:02.999919 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bcbe3-e673-4702-baad-67569ef02ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5e5b89407645b0b00af8e217badd38)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:03.001925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bcbe3-e673-4702-baad-67569ef02ffc admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:03.254702 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b76bcbe3-e673-4702-baad-67569ef02ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5e5b89407645b0b00af8e217badd38'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:03.267451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b76bcbe3-e673-4702-baad-67569ef02ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5e5b89407645b0b00af8e217badd38'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:03.355010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b76bcbe3-e673-4702-baad-67569ef02ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5e5b89407645b0b00af8e217badd38'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:03.355638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b76bcbe3-e673-4702-baad-67569ef02ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5e5b89407645b0b00af8e217badd38'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:03.356269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b76bcbe3-e673-4702-baad-67569ef02ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5e5b89407645b0b00af8e217badd38'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:03.370021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1322/2651] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:57:02 2022] DELETE /identity/v3/users/3e5e5b89407645b0b00af8e217badd38 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:03.780356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:03.781862 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:03.795409 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e928cc-0c8d-448f-b8d0-6ec8bc93542b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:03.858322 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3210ceb-2824-436a-9280-d2bd6d2fad41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:03.858961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3210ceb-2824-436a-9280-d2bd6d2fad41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:03.859271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3210ceb-2824-436a-9280-d2bd6d2fad41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:03.859566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3210ceb-2824-436a-9280-d2bd6d2fad41 admin admin] PATH_INFO: `/v3/projects/597c25761dc747dfad2d0b2d84834a51` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:03.860708 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3210ceb-2824-436a-9280-d2bd6d2fad41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=597c25761dc747dfad2d0b2d84834a51)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:03.862845 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3210ceb-2824-436a-9280-d2bd6d2fad41 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:03.986757 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e3210ceb-2824-436a-9280-d2bd6d2fad41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '597c25761dc747dfad2d0b2d84834a51', 'request_id': 'req-e3210ceb-2824-436a-9280-d2bd6d2fad41'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:03.993555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e3210ceb-2824-436a-9280-d2bd6d2fad41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '597c25761dc747dfad2d0b2d84834a51', 'request_id': 'req-e3210ceb-2824-436a-9280-d2bd6d2fad41'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:04.075393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e3210ceb-2824-436a-9280-d2bd6d2fad41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '597c25761dc747dfad2d0b2d84834a51', 'request_id': 'req-e3210ceb-2824-436a-9280-d2bd6d2fad41'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:04.090563 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e3210ceb-2824-436a-9280-d2bd6d2fad41 admin admin] The token cache is being invalidate because project 597c25761dc747dfad2d0b2d84834a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:57:04.090947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e3210ceb-2824-436a-9280-d2bd6d2fad41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:04.091691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e3210ceb-2824-436a-9280-d2bd6d2fad41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:04.093438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1330/2652] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:57:03 2022] DELETE /identity/v3/projects/597c25761dc747dfad2d0b2d84834a51 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:04.098074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20856e2-b0ea-480a-acdf-502bdca813de None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:04.099971 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20856e2-b0ea-480a-acdf-502bdca813de None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:04.100294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20856e2-b0ea-480a-acdf-502bdca813de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:04.123103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d20856e2-b0ea-480a-acdf-502bdca813de None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:04.126238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d20856e2-b0ea-480a-acdf-502bdca813de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:04.195084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1323/2653] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:04.203628 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbffb4-45a7-45cb-b613-20e9c288679d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:04.204269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbffb4-45a7-45cb-b613-20e9c288679d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:04.204752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbffb4-45a7-45cb-b613-20e9c288679d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:04.228627 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-19cbffb4-45a7-45cb-b613-20e9c288679d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:04.229856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-19cbffb4-45a7-45cb-b613-20e9c288679d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:04.238138 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1331/2654] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:04.242401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20856e2-b0ea-480a-acdf-502bdca813de None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:04.252234 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20856e2-b0ea-480a-acdf-502bdca813de None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:04.256822 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9574b0-11a0-4e1f-b460-e9a52665bd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:04.257459 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9574b0-11a0-4e1f-b460-e9a52665bd51 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:04.257696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9574b0-11a0-4e1f-b460-e9a52665bd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:04.257975 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9574b0-11a0-4e1f-b460-e9a52665bd51 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:04.258620 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9574b0-11a0-4e1f-b460-e9a52665bd51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:57:04.258925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9574b0-11a0-4e1f-b460-e9a52665bd51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:04.260552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9574b0-11a0-4e1f-b460-e9a52665bd51 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:04.272308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1324/2655] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:57:04.277276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbffb4-45a7-45cb-b613-20e9c288679d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:04.286705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbffb4-45a7-45cb-b613-20e9c288679d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:04.291961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2ec9d-4a76-408e-8d43-668286e62313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:04.292584 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2ec9d-4a76-408e-8d43-668286e62313 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:04.292863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2ec9d-4a76-408e-8d43-668286e62313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:04.293132 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2ec9d-4a76-408e-8d43-668286e62313 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:04.293768 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2ec9d-4a76-408e-8d43-668286e62313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:04.295659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2ec9d-4a76-408e-8d43-668286e62313 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:04.418640 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1332/2656] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:04 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:57:04.420415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9574b0-11a0-4e1f-b460-e9a52665bd51 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:04.433331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9574b0-11a0-4e1f-b460-e9a52665bd51 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:04.485079 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:04.495518 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c541e-3fec-489f-b6b4-26d5ce3b50c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:04.496194 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c541e-3fec-489f-b6b4-26d5ce3b50c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:04.496481 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c541e-3fec-489f-b6b4-26d5ce3b50c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:04.496754 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c541e-3fec-489f-b6b4-26d5ce3b50c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:04.497439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c541e-3fec-489f-b6b4-26d5ce3b50c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:04.499417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c541e-3fec-489f-b6b4-26d5ce3b50c0 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:04.583969 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1325/2657] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:04 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:04.589358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2ec9d-4a76-408e-8d43-668286e62313 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:04.598886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2ec9d-4a76-408e-8d43-668286e62313 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:04.603990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af832d3-3408-4b0e-9e6a-74469672c538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:04.604616 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af832d3-3408-4b0e-9e6a-74469672c538 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:04.604898 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af832d3-3408-4b0e-9e6a-74469672c538 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:04.605176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af832d3-3408-4b0e-9e6a-74469672c538 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:04.605820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af832d3-3408-4b0e-9e6a-74469672c538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:04.607419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af832d3-3408-4b0e-9e6a-74469672c538 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:04.617447 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1333/2658] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:04.622170 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c541e-3fec-489f-b6b4-26d5ce3b50c0 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:04.632497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c541e-3fec-489f-b6b4-26d5ce3b50c0 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:04.637238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3581ede-081c-4ef9-9c80-19553db37fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:04.637880 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3581ede-081c-4ef9-9c80-19553db37fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:04.638163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3581ede-081c-4ef9-9c80-19553db37fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:04.638439 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3581ede-081c-4ef9-9c80-19553db37fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:04.639080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3581ede-081c-4ef9-9c80-19553db37fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:04.640693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3581ede-081c-4ef9-9c80-19553db37fd8 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:04.651103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1326/2659] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:04.655105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af832d3-3408-4b0e-9e6a-74469672c538 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:04.665575 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af832d3-3408-4b0e-9e6a-74469672c538 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:04.670294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afa32a-93f8-4094-bef0-44481c720624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:04.670932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afa32a-93f8-4094-bef0-44481c720624 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:04.671216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afa32a-93f8-4094-bef0-44481c720624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:04.671531 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afa32a-93f8-4094-bef0-44481c720624 admin admin] PATH_INFO: `/v3/projects/7787fb39fffb49aaad2716acc12ec37c/users/a030a8637e664ec2857409915b38138b/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:04.687090 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afa32a-93f8-4094-bef0-44481c720624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7787fb39fffb49aaad2716acc12ec37c, user_id=a030a8637e664ec2857409915b38138b, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:04.689814 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afa32a-93f8-4094-bef0-44481c720624 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:04.784268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1334/2660] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:04 2022] PUT /identity/v3/projects/7787fb39fffb49aaad2716acc12ec37c/users/a030a8637e664ec2857409915b38138b/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:04.791061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf5970-4d05-46a7-a839-f94b3166fc43 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:04.791593 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf5970-4d05-46a7-a839-f94b3166fc43 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:04.791879 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf5970-4d05-46a7-a839-f94b3166fc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:04.812286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-74bf5970-4d05-46a7-a839-f94b3166fc43 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:04.813555 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-74bf5970-4d05-46a7-a839-f94b3166fc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:04.871475 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1327/2661] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:04.881313 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afa32a-93f8-4094-bef0-44481c720624 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:04.883111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-97afa32a-93f8-4094-bef0-44481c720624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:04.889768 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:04.942196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afa32a-93f8-4094-bef0-44481c720624 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:04.946910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923bfda-b9d4-4421-a225-bdadf90b94cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:04.947524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923bfda-b9d4-4421-a225-bdadf90b94cb service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:04.947929 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923bfda-b9d4-4421-a225-bdadf90b94cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:04.948268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923bfda-b9d4-4421-a225-bdadf90b94cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:04.957472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923bfda-b9d4-4421-a225-bdadf90b94cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:04.959947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923bfda-b9d4-4421-a225-bdadf90b94cb service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:04.971394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1335/2662] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:05.473598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf5970-4d05-46a7-a839-f94b3166fc43 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:05.473598 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-74bf5970-4d05-46a7-a839-f94b3166fc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:05.485718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf5970-4d05-46a7-a839-f94b3166fc43 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:05.490494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0c285-e55c-4257-b59a-8158fdb096f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:05.491250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0c285-e55c-4257-b59a-8158fdb096f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:05.491632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0c285-e55c-4257-b59a-8158fdb096f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:05.492011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0c285-e55c-4257-b59a-8158fdb096f4 admin admin] PATH_INFO: `/v3/users/cc2eae43d6204498951822d3acceec5f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:05.493319 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0c285-e55c-4257-b59a-8158fdb096f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2eae43d6204498951822d3acceec5f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:05.495381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0c285-e55c-4257-b59a-8158fdb096f4 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:05.701415 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3cc0c285-e55c-4257-b59a-8158fdb096f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2eae43d6204498951822d3acceec5f'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:05.723815 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3cc0c285-e55c-4257-b59a-8158fdb096f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2eae43d6204498951822d3acceec5f'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:05.814048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3cc0c285-e55c-4257-b59a-8158fdb096f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2eae43d6204498951822d3acceec5f'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:05.814048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3cc0c285-e55c-4257-b59a-8158fdb096f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2eae43d6204498951822d3acceec5f'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:05.814048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3cc0c285-e55c-4257-b59a-8158fdb096f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2eae43d6204498951822d3acceec5f'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:05.830056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1328/2663] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:57:05 2022] DELETE /identity/v3/users/cc2eae43d6204498951822d3acceec5f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:05.834429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb7ecd-c89d-434c-bfdd-1c22c7bd45f0 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:05.834970 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb7ecd-c89d-434c-bfdd-1c22c7bd45f0 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:05.835177 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb7ecd-c89d-434c-bfdd-1c22c7bd45f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:05.855998 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-12bb7ecd-c89d-434c-bfdd-1c22c7bd45f0 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:05.857510 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-12bb7ecd-c89d-434c-bfdd-1c22c7bd45f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:05.927509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1336/2664] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:05.938299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0c285-e55c-4257-b59a-8158fdb096f4 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:05.939883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3cc0c285-e55c-4257-b59a-8158fdb096f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:05.986003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:06.004232 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0c285-e55c-4257-b59a-8158fdb096f4 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:06.008197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685ac80-5d7e-4a2c-a689-643552ae06f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:06.009175 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685ac80-5d7e-4a2c-a689-643552ae06f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:06.012696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685ac80-5d7e-4a2c-a689-643552ae06f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:06.012696 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685ac80-5d7e-4a2c-a689-643552ae06f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:06.020992 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685ac80-5d7e-4a2c-a689-643552ae06f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:06.022446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685ac80-5d7e-4a2c-a689-643552ae06f3 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:06.033152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1329/2665] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:06.380961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165e447-2f8c-4771-862e-1e66bca1ab48 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:06.381427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165e447-2f8c-4771-862e-1e66bca1ab48 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:06.381553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165e447-2f8c-4771-862e-1e66bca1ab48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:06.412273 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-c165e447-2f8c-4771-862e-1e66bca1ab48 None None] MFA Rules not processed for user `a030a8637e664ec2857409915b38138b`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:06.413572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c165e447-2f8c-4771-862e-1e66bca1ab48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:06.480855 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1337/2666] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:06.485610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685ac80-5d7e-4a2c-a689-643552ae06f3 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:06.486991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1685ac80-5d7e-4a2c-a689-643552ae06f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:06.499549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165e447-2f8c-4771-862e-1e66bca1ab48 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:06.501513 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685ac80-5d7e-4a2c-a689-643552ae06f3 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:06.501677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c165e447-2f8c-4771-862e-1e66bca1ab48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:06.505601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ab630-881d-4d70-9db5-0dbdcda91a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:06.507587 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ab630-881d-4d70-9db5-0dbdcda91a95 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:06.507920 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ab630-881d-4d70-9db5-0dbdcda91a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:06.508228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ab630-881d-4d70-9db5-0dbdcda91a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:06.508897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ab630-881d-4d70-9db5-0dbdcda91a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:06.510803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ab630-881d-4d70-9db5-0dbdcda91a95 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:06.516408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165e447-2f8c-4771-862e-1e66bca1ab48 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:06.521433 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:06.522089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:06.522426 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:06.522704 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65 admin admin] PATH_INFO: `/v3/projects/92dfe6a7a5bc4513945f3d2ec89848ee` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:06.523860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92dfe6a7a5bc4513945f3d2ec89848ee)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:06.526448 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:06.598959 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1330/2667] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:06 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:06.600883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ab630-881d-4d70-9db5-0dbdcda91a95 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:06.629385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:06.642252 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92dfe6a7a5bc4513945f3d2ec89848ee', 'request_id': 'req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:06.648532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92dfe6a7a5bc4513945f3d2ec89848ee', 'request_id': 'req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:06.665153 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ab630-881d-4d70-9db5-0dbdcda91a95 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:06.720872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8efc6e-5df3-4c41-97c5-35ca1ce1e784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:06.721470 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8efc6e-5df3-4c41-97c5-35ca1ce1e784 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:06.721744 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8efc6e-5df3-4c41-97c5-35ca1ce1e784 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:06.722012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8efc6e-5df3-4c41-97c5-35ca1ce1e784 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:06.722629 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8efc6e-5df3-4c41-97c5-35ca1ce1e784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:06.724633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8efc6e-5df3-4c41-97c5-35ca1ce1e784 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:06.754797 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92dfe6a7a5bc4513945f3d2ec89848ee', 'request_id': 'req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:06.766137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65 admin admin] The token cache is being invalidate because project 92dfe6a7a5bc4513945f3d2ec89848ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:57:06.772332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:06.772332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:06.772332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1338/2668] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:57:06 2022] DELETE /identity/v3/projects/92dfe6a7a5bc4513945f3d2ec89848ee => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:06.772608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:06.773759 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:06.787674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8124c9-bbbb-4c77-bbf4-42fdd06dda65 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:06.792476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467a488-f403-4ab8-94f8-5c60db6868d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:06.793124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467a488-f403-4ab8-94f8-5c60db6868d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:06.793423 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467a488-f403-4ab8-94f8-5c60db6868d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:06.793693 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467a488-f403-4ab8-94f8-5c60db6868d3 admin admin] PATH_INFO: `/v3/users/2cc037f2387744ef979d5a1ced10fb41` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:06.794843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467a488-f403-4ab8-94f8-5c60db6868d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc037f2387744ef979d5a1ced10fb41)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:06.796842 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467a488-f403-4ab8-94f8-5c60db6868d3 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:06.827293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1331/2669] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:06 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:57:06.828401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8efc6e-5df3-4c41-97c5-35ca1ce1e784 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:06.829995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1a8efc6e-5df3-4c41-97c5-35ca1ce1e784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:06.844040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8efc6e-5df3-4c41-97c5-35ca1ce1e784 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:06.848806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0674f83-6a05-403e-b61c-e4a1dcb92032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:06.849446 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0674f83-6a05-403e-b61c-e4a1dcb92032 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:06.849728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0674f83-6a05-403e-b61c-e4a1dcb92032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:06.850009 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0674f83-6a05-403e-b61c-e4a1dcb92032 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:06.850710 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0674f83-6a05-403e-b61c-e4a1dcb92032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:06.852846 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0674f83-6a05-403e-b61c-e4a1dcb92032 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:06.862814 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1332/2670] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:06.867171 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0674f83-6a05-403e-b61c-e4a1dcb92032 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:06.877027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0674f83-6a05-403e-b61c-e4a1dcb92032 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:06.881901 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7019f-2368-41b8-a17c-461cf64c5c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:06.882554 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7019f-2368-41b8-a17c-461cf64c5c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:06.882836 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7019f-2368-41b8-a17c-461cf64c5c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:06.883111 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7019f-2368-41b8-a17c-461cf64c5c2c admin admin] PATH_INFO: `/v3/projects/cb6092c1086945d2923ced689c91376d/users/996ae67195bc4512adb810d151f518a1/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:06.897987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7019f-2368-41b8-a17c-461cf64c5c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6092c1086945d2923ced689c91376d, user_id=996ae67195bc4512adb810d151f518a1, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:06.900708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7019f-2368-41b8-a17c-461cf64c5c2c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:06.924718 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d467a488-f403-4ab8-94f8-5c60db6868d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc037f2387744ef979d5a1ced10fb41'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:06.925644 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d467a488-f403-4ab8-94f8-5c60db6868d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc037f2387744ef979d5a1ced10fb41'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:06.961228 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1333/2671] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:06 2022] PUT /identity/v3/projects/cb6092c1086945d2923ced689c91376d/users/996ae67195bc4512adb810d151f518a1/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:57:06.965794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7019f-2368-41b8-a17c-461cf64c5c2c admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:06.967423 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-7ff7019f-2368-41b8-a17c-461cf64c5c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:06.979641 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d467a488-f403-4ab8-94f8-5c60db6868d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc037f2387744ef979d5a1ced10fb41'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:06.980910 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d467a488-f403-4ab8-94f8-5c60db6868d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc037f2387744ef979d5a1ced10fb41'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:06.996046 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:06.996761 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d467a488-f403-4ab8-94f8-5c60db6868d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc037f2387744ef979d5a1ced10fb41'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:07.011623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1339/2672] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:57:06 2022] DELETE /identity/v3/users/2cc037f2387744ef979d5a1ced10fb41 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:57:07.042314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7019f-2368-41b8-a17c-461cf64c5c2c admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:07.109331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7045d-e6a3-4f2f-97e1-55c85e061887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:07.109708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7045d-e6a3-4f2f-97e1-55c85e061887 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:07.109992 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7045d-e6a3-4f2f-97e1-55c85e061887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:07.110443 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7045d-e6a3-4f2f-97e1-55c85e061887 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:07.111057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7045d-e6a3-4f2f-97e1-55c85e061887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:07.112811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7045d-e6a3-4f2f-97e1-55c85e061887 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:07.124326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1334/2673] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:57:07.128695 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467a488-f403-4ab8-94f8-5c60db6868d3 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:07.141518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467a488-f403-4ab8-94f8-5c60db6868d3 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:07.147031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a793e-d76d-458f-a6cb-d6211ce69cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:07.147672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a793e-d76d-458f-a6cb-d6211ce69cba admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:07.148014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a793e-d76d-458f-a6cb-d6211ce69cba admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:07.148456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a793e-d76d-458f-a6cb-d6211ce69cba admin admin] PATH_INFO: `/v3/projects/cb6092c1086945d2923ced689c91376d/users/996ae67195bc4512adb810d151f518a1/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:07.150854 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a793e-d76d-458f-a6cb-d6211ce69cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6092c1086945d2923ced689c91376d, user_id=996ae67195bc4512adb810d151f518a1, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:07.153513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a793e-d76d-458f-a6cb-d6211ce69cba admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:07.164233 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1340/2674] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:07 2022] PUT /identity/v3/projects/cb6092c1086945d2923ced689c91376d/users/996ae67195bc4512adb810d151f518a1/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:07.514660 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7045d-e6a3-4f2f-97e1-55c85e061887 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:07.516429 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b1e7045d-e6a3-4f2f-97e1-55c85e061887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:07.529306 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7045d-e6a3-4f2f-97e1-55c85e061887 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:07.609937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ed32c-7206-450b-860d-0330876cc260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:07.610706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ed32c-7206-450b-860d-0330876cc260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:07.610838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ed32c-7206-450b-860d-0330876cc260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:07.611007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ed32c-7206-450b-860d-0330876cc260 admin admin] PATH_INFO: `/v3/projects/12aace7cc40748a0899b8f34f4289198` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:07.612290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ed32c-7206-450b-860d-0330876cc260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12aace7cc40748a0899b8f34f4289198)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:07.614207 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ed32c-7206-450b-860d-0330876cc260 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:07.767077 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dd2ed32c-7206-450b-860d-0330876cc260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12aace7cc40748a0899b8f34f4289198', 'request_id': 'req-dd2ed32c-7206-450b-860d-0330876cc260'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:07.863821 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dd2ed32c-7206-450b-860d-0330876cc260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12aace7cc40748a0899b8f34f4289198', 'request_id': 'req-dd2ed32c-7206-450b-860d-0330876cc260'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:07.870113 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dd2ed32c-7206-450b-860d-0330876cc260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12aace7cc40748a0899b8f34f4289198', 'request_id': 'req-dd2ed32c-7206-450b-860d-0330876cc260'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:07.871995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:07.881818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dd2ed32c-7206-450b-860d-0330876cc260 admin admin] The token cache is being invalidate because project 12aace7cc40748a0899b8f34f4289198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:57:07.882111 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dd2ed32c-7206-450b-860d-0330876cc260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:07.882743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dd2ed32c-7206-450b-860d-0330876cc260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:07.884254 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1335/2675] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:57:07 2022] DELETE /identity/v3/projects/12aace7cc40748a0899b8f34f4289198 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:07.889008 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b915a-67aa-400f-a5b3-48726433b849 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:07.889290 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b915a-67aa-400f-a5b3-48726433b849 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:07.889561 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b915a-67aa-400f-a5b3-48726433b849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:07.910250 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-947b915a-67aa-400f-a5b3-48726433b849 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:07.911517 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-947b915a-67aa-400f-a5b3-48726433b849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:07.974345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1341/2676] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:07.982596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b60f1-0729-404f-b588-cbeccf08eb1b None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:07.982954 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b60f1-0729-404f-b588-cbeccf08eb1b None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:07.983322 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b60f1-0729-404f-b588-cbeccf08eb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:08.005821 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-1f0b60f1-0729-404f-b588-cbeccf08eb1b None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:08.007111 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-1f0b60f1-0729-404f-b588-cbeccf08eb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:08.016038 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1336/2677] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:08.020891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b915a-67aa-400f-a5b3-48726433b849 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:08.030241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b915a-67aa-400f-a5b3-48726433b849 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:08.034907 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cc79b-30c9-4c1a-a3b6-38b3ce167b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:08.035508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cc79b-30c9-4c1a-a3b6-38b3ce167b9a admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:08.035788 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cc79b-30c9-4c1a-a3b6-38b3ce167b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:08.036061 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cc79b-30c9-4c1a-a3b6-38b3ce167b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:08.036773 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cc79b-30c9-4c1a-a3b6-38b3ce167b9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:57:08.037071 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cc79b-30c9-4c1a-a3b6-38b3ce167b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:08.038666 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cc79b-30c9-4c1a-a3b6-38b3ce167b9a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:08.050963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1342/2678] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:57:08.056149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b60f1-0729-404f-b588-cbeccf08eb1b None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:08.065289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b60f1-0729-404f-b588-cbeccf08eb1b None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:08.069998 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ce79a-1825-4079-94c1-cd6b4e80868c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:08.070595 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ce79a-1825-4079-94c1-cd6b4e80868c admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:08.070875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ce79a-1825-4079-94c1-cd6b4e80868c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:08.071700 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ce79a-1825-4079-94c1-cd6b4e80868c admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:08.072368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ce79a-1825-4079-94c1-cd6b4e80868c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:08.074387 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ce79a-1825-4079-94c1-cd6b4e80868c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:08.159910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1337/2679] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:08 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:08.161048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cc79b-30c9-4c1a-a3b6-38b3ce167b9a admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:08.171935 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cc79b-30c9-4c1a-a3b6-38b3ce167b9a admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:08.176401 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:08.229571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98813608-5dbd-4175-b8b6-6c6ab02af32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:08.240370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98813608-5dbd-4175-b8b6-6c6ab02af32d admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:08.240370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98813608-5dbd-4175-b8b6-6c6ab02af32d admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:08.240370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98813608-5dbd-4175-b8b6-6c6ab02af32d admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:08.240370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98813608-5dbd-4175-b8b6-6c6ab02af32d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:08.240370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98813608-5dbd-4175-b8b6-6c6ab02af32d admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:08.306592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1343/2680] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:08 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:57:08.312155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ce79a-1825-4079-94c1-cd6b4e80868c admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:08.322929 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ce79a-1825-4079-94c1-cd6b4e80868c admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:08.327613 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b986c73-2ca1-4724-bc56-77ff07c0a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:08.328236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b986c73-2ca1-4724-bc56-77ff07c0a8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:08.328524 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b986c73-2ca1-4724-bc56-77ff07c0a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:08.328801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b986c73-2ca1-4724-bc56-77ff07c0a8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:08.329476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b986c73-2ca1-4724-bc56-77ff07c0a8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:08.331057 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b986c73-2ca1-4724-bc56-77ff07c0a8c3 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:08.342039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1338/2681] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:08.346259 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98813608-5dbd-4175-b8b6-6c6ab02af32d admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:08.356687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98813608-5dbd-4175-b8b6-6c6ab02af32d admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:08.361378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55190c-f43f-4720-9054-f35365e32995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:08.361973 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55190c-f43f-4720-9054-f35365e32995 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:08.362258 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55190c-f43f-4720-9054-f35365e32995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:08.362529 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55190c-f43f-4720-9054-f35365e32995 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:08.363230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55190c-f43f-4720-9054-f35365e32995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:08.364879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55190c-f43f-4720-9054-f35365e32995 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:08.376019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1344/2682] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:08.380217 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b986c73-2ca1-4724-bc56-77ff07c0a8c3 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:08.390476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b986c73-2ca1-4724-bc56-77ff07c0a8c3 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:08.395188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33454ae9-d6f2-45d8-93c2-ba32f00c12e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:08.395835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33454ae9-d6f2-45d8-93c2-ba32f00c12e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:08.396166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33454ae9-d6f2-45d8-93c2-ba32f00c12e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:08.396444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33454ae9-d6f2-45d8-93c2-ba32f00c12e4 admin admin] PATH_INFO: `/v3/projects/5bf26b43dd3f41dd83fcd15c2b3fc92e/users/565efd0ea5d94d02b162b82423b8ac6f/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:08.410771 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33454ae9-d6f2-45d8-93c2-ba32f00c12e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf26b43dd3f41dd83fcd15c2b3fc92e, user_id=565efd0ea5d94d02b162b82423b8ac6f, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:08.413565 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33454ae9-d6f2-45d8-93c2-ba32f00c12e4 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:08.497621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1339/2683] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:08 2022] PUT /identity/v3/projects/5bf26b43dd3f41dd83fcd15c2b3fc92e/users/565efd0ea5d94d02b162b82423b8ac6f/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:08.508294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99d9a5-c48f-468a-a61f-7b7db00cd962 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:08.508587 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99d9a5-c48f-468a-a61f-7b7db00cd962 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:08.508867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99d9a5-c48f-468a-a61f-7b7db00cd962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:08.537778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ae99d9a5-c48f-468a-a61f-7b7db00cd962 None None] MFA Rules not processed for user `565efd0ea5d94d02b162b82423b8ac6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:08.539023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ae99d9a5-c48f-468a-a61f-7b7db00cd962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:08.539621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe5c24-9350-4dfa-979b-046b601b5ef9 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:08.540666 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe5c24-9350-4dfa-979b-046b601b5ef9 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:08.540960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe5c24-9350-4dfa-979b-046b601b5ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:08.572765 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-70fe5c24-9350-4dfa-979b-046b601b5ef9 None None] MFA Rules not processed for user `996ae67195bc4512adb810d151f518a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:08.574324 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-70fe5c24-9350-4dfa-979b-046b601b5ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:08.621137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1345/2684] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:08.625885 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99d9a5-c48f-468a-a61f-7b7db00cd962 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:08.666321 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1340/2685] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:08.677293 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae1f5c-5fc2-43c7-8509-f976cafc4681 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:08.677666 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae1f5c-5fc2-43c7-8509-f976cafc4681 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:08.677983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae1f5c-5fc2-43c7-8509-f976cafc4681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:08.692033 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99d9a5-c48f-468a-a61f-7b7db00cd962 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:08.696976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658f915-4de1-40a4-97da-595c162d068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:08.697267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-daae1f5c-5fc2-43c7-8509-f976cafc4681 None None] MFA Rules not processed for user `a030a8637e664ec2857409915b38138b`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:08.697580 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658f915-4de1-40a4-97da-595c162d068a admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:08.697861 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658f915-4de1-40a4-97da-595c162d068a admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:08.698153 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658f915-4de1-40a4-97da-595c162d068a admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:08.698470 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-daae1f5c-5fc2-43c7-8509-f976cafc4681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:08.698781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658f915-4de1-40a4-97da-595c162d068a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:08.700753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658f915-4de1-40a4-97da-595c162d068a admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:08.755174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1341/2686] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:57:08.766149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae1f5c-5fc2-43c7-8509-f976cafc4681 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:08.767484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-daae1f5c-5fc2-43c7-8509-f976cafc4681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:08.794425 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:08.807852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:08.817331 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1346/2687] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:08 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:57:08.818311 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658f915-4de1-40a4-97da-595c162d068a admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:08.843337 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae1f5c-5fc2-43c7-8509-f976cafc4681 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:08.882178 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658f915-4de1-40a4-97da-595c162d068a admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:08.887573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a78c2a-d05d-4be3-bcbe-b10062692226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:08.888205 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a78c2a-d05d-4be3-bcbe-b10062692226 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:08.888493 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a78c2a-d05d-4be3-bcbe-b10062692226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:08.888772 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a78c2a-d05d-4be3-bcbe-b10062692226 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:08.889403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a78c2a-d05d-4be3-bcbe-b10062692226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:08.891317 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a78c2a-d05d-4be3-bcbe-b10062692226 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:08.911531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfd02c-14de-4fd5-8645-799a4fbf605b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:08.914569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfd02c-14de-4fd5-8645-799a4fbf605b service nova] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:08.914569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfd02c-14de-4fd5-8645-799a4fbf605b service nova] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:08.914569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfd02c-14de-4fd5-8645-799a4fbf605b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:08.914569 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-62dfd02c-14de-4fd5-8645-799a4fbf605b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:08.960923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1347/2688] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:08 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:08.965487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a78c2a-d05d-4be3-bcbe-b10062692226 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:08.975034 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfd02c-14de-4fd5-8645-799a4fbf605b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:08.975236 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a78c2a-d05d-4be3-bcbe-b10062692226 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:08.976789 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfd02c-14de-4fd5-8645-799a4fbf605b service nova] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:08.980057 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bc5d7-e4e6-4826-9dd1-087a6364bf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:08.980682 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bc5d7-e4e6-4826-9dd1-087a6364bf34 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:08.980966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bc5d7-e4e6-4826-9dd1-087a6364bf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:08.981243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bc5d7-e4e6-4826-9dd1-087a6364bf34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:08.981893 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bc5d7-e4e6-4826-9dd1-087a6364bf34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:08.983466 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bc5d7-e4e6-4826-9dd1-087a6364bf34 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:08.986156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1342/2689] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:57:08.993605 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1348/2690] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:57:08.997632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfd02c-14de-4fd5-8645-799a4fbf605b service nova] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:09.008201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfd02c-14de-4fd5-8645-799a4fbf605b service nova] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:09.013834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dfd17-9778-4a22-9f5a-e69dc8aefdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:09.014510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dfd17-9778-4a22-9f5a-e69dc8aefdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:09.014722 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dfd17-9778-4a22-9f5a-e69dc8aefdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:09.014999 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dfd17-9778-4a22-9f5a-e69dc8aefdc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:09.015670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7dfd17-9778-4a22-9f5a-e69dc8aefdc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:09.017414 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7dfd17-9778-4a22-9f5a-e69dc8aefdc9 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:09.031548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1343/2691] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:09.032717 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bc5d7-e4e6-4826-9dd1-087a6364bf34 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:09.042960 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bc5d7-e4e6-4826-9dd1-087a6364bf34 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:09.048008 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10164b8c-44d0-4377-bee2-ed3444f693af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:09.048786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10164b8c-44d0-4377-bee2-ed3444f693af admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:09.049069 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10164b8c-44d0-4377-bee2-ed3444f693af admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:09.049343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10164b8c-44d0-4377-bee2-ed3444f693af admin admin] PATH_INFO: `/v3/projects/70d0b554fd8d4b77af11b816ff085eee/users/1335d0ee7ae04cf3a90758c22c2603f5/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:09.064875 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10164b8c-44d0-4377-bee2-ed3444f693af admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d0b554fd8d4b77af11b816ff085eee, user_id=1335d0ee7ae04cf3a90758c22c2603f5, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:09.067520 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10164b8c-44d0-4377-bee2-ed3444f693af admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:09.144076 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1349/2692] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:09 2022] PUT /identity/v3/projects/70d0b554fd8d4b77af11b816ff085eee/users/1335d0ee7ae04cf3a90758c22c2603f5/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:57:09.155520 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3d36f-8861-46b4-8450-c7dfcf8dc518 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:09.155810 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3d36f-8861-46b4-8450-c7dfcf8dc518 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:09.156109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3d36f-8861-46b4-8450-c7dfcf8dc518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:09.186344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-cef3d36f-8861-46b4-8450-c7dfcf8dc518 None None] MFA Rules not processed for user `1335d0ee7ae04cf3a90758c22c2603f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:09.187609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-cef3d36f-8861-46b4-8450-c7dfcf8dc518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:09.223536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:09.254807 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1344/2693] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:57:09.259266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10164b8c-44d0-4377-bee2-ed3444f693af admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:09.324466 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10164b8c-44d0-4377-bee2-ed3444f693af admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:09.329118 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae28a2-68e4-498a-9453-f172c128da38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:09.329723 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae28a2-68e4-498a-9453-f172c128da38 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:09.329997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae28a2-68e4-498a-9453-f172c128da38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:09.330265 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae28a2-68e4-498a-9453-f172c128da38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:09.330909 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae28a2-68e4-498a-9453-f172c128da38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:09.332832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae28a2-68e4-498a-9453-f172c128da38 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:09.410197 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1350/2694] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:09 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:09.418300 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3d36f-8861-46b4-8450-c7dfcf8dc518 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:09.435454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3d36f-8861-46b4-8450-c7dfcf8dc518 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:09.501445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7c650-414a-4877-96ea-e1d796096ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:09.502065 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7c650-414a-4877-96ea-e1d796096ecb admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:09.502339 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7c650-414a-4877-96ea-e1d796096ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:09.502607 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7c650-414a-4877-96ea-e1d796096ecb admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:09.503238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7c650-414a-4877-96ea-e1d796096ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:09.505236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7c650-414a-4877-96ea-e1d796096ecb admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:09.619502 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1345/2695] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:09 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:09.623687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae28a2-68e4-498a-9453-f172c128da38 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:09.634520 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae28a2-68e4-498a-9453-f172c128da38 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:09.639245 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cb90d-7dc7-4df5-abf0-4b2e38d0dbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:09.639851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cb90d-7dc7-4df5-abf0-4b2e38d0dbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:09.640171 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cb90d-7dc7-4df5-abf0-4b2e38d0dbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:09.640450 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cb90d-7dc7-4df5-abf0-4b2e38d0dbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:09.641111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cb90d-7dc7-4df5-abf0-4b2e38d0dbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:09.642721 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cb90d-7dc7-4df5-abf0-4b2e38d0dbe6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:09.657329 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1351/2696] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:09.658740 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7c650-414a-4877-96ea-e1d796096ecb admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:09.669198 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7c650-414a-4877-96ea-e1d796096ecb admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:09.673948 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0149a85-3d4e-4efe-a1d2-c457d64b038a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:09.674603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0149a85-3d4e-4efe-a1d2-c457d64b038a admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:09.674886 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0149a85-3d4e-4efe-a1d2-c457d64b038a admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:09.675163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0149a85-3d4e-4efe-a1d2-c457d64b038a admin admin] PATH_INFO: `/v3/projects/34417fb4acd04fde8a39b25fb7c0760b/users/dddb2d939a8d4c5ab2609fb3237f5dc7/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:09.816761 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0149a85-3d4e-4efe-a1d2-c457d64b038a admin admin] RBAC: Authorizing `identity:create_grant(project_id=34417fb4acd04fde8a39b25fb7c0760b, user_id=dddb2d939a8d4c5ab2609fb3237f5dc7, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:09.819401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0149a85-3d4e-4efe-a1d2-c457d64b038a admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:09.905079 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1346/2697] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:09 2022] PUT /identity/v3/projects/34417fb4acd04fde8a39b25fb7c0760b/users/dddb2d939a8d4c5ab2609fb3237f5dc7/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:09.909053 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cb90d-7dc7-4df5-abf0-4b2e38d0dbe6 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:09.920267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cb90d-7dc7-4df5-abf0-4b2e38d0dbe6 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:09.950014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:09.986415 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed0b11-0512-4002-9f40-eab5efc49e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:09.991921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed0b11-0512-4002-9f40-eab5efc49e22 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:09.991921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed0b11-0512-4002-9f40-eab5efc49e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:09.991921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed0b11-0512-4002-9f40-eab5efc49e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:09.991921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed0b11-0512-4002-9f40-eab5efc49e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:09.991921 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed0b11-0512-4002-9f40-eab5efc49e22 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:10.001027 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1352/2698] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:10.005267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0149a85-3d4e-4efe-a1d2-c457d64b038a admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:10.015991 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0149a85-3d4e-4efe-a1d2-c457d64b038a admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:10.021024 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95031b-aa3b-4942-a8fa-de2f47608e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:10.021665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95031b-aa3b-4942-a8fa-de2f47608e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:10.021939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95031b-aa3b-4942-a8fa-de2f47608e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:10.022290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95031b-aa3b-4942-a8fa-de2f47608e43 admin admin] PATH_INFO: `/v3/projects/34417fb4acd04fde8a39b25fb7c0760b/users/dddb2d939a8d4c5ab2609fb3237f5dc7/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:10.024793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95031b-aa3b-4942-a8fa-de2f47608e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34417fb4acd04fde8a39b25fb7c0760b, user_id=dddb2d939a8d4c5ab2609fb3237f5dc7, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:10.027364 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95031b-aa3b-4942-a8fa-de2f47608e43 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:10.037369 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1347/2699] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:10 2022] PUT /identity/v3/projects/34417fb4acd04fde8a39b25fb7c0760b/users/dddb2d939a8d4c5ab2609fb3237f5dc7/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:10.048345 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b3d16-b15e-497e-87d4-9d68f9341ad6 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:10.055349 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b3d16-b15e-497e-87d4-9d68f9341ad6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:10.055349 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b3d16-b15e-497e-87d4-9d68f9341ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:10.077802 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-217b3d16-b15e-497e-87d4-9d68f9341ad6 None None] MFA Rules not processed for user `dddb2d939a8d4c5ab2609fb3237f5dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:10.079155 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-217b3d16-b15e-497e-87d4-9d68f9341ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:10.151301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1353/2700] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:10.162942 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95031b-aa3b-4942-a8fa-de2f47608e43 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:10.165299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-7c95031b-aa3b-4942-a8fa-de2f47608e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:10.223166 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95031b-aa3b-4942-a8fa-de2f47608e43 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:10.227816 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc05a4-e64f-4157-b425-a21d0277b4dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:10.228472 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc05a4-e64f-4157-b425-a21d0277b4dc service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:10.228832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc05a4-e64f-4157-b425-a21d0277b4dc service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:10.229099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc05a4-e64f-4157-b425-a21d0277b4dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:10.273738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:10.288593 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc05a4-e64f-4157-b425-a21d0277b4dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:10.290724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc05a4-e64f-4157-b425-a21d0277b4dc service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:10.299501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1348/2701] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:12.335941 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b3d16-b15e-497e-87d4-9d68f9341ad6 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:12.338026 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-217b3d16-b15e-497e-87d4-9d68f9341ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:12.350028 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b3d16-b15e-497e-87d4-9d68f9341ad6 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:12.354293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2287-1384-47b9-9a37-d0334059e405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:12.354889 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2287-1384-47b9-9a37-d0334059e405 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:12.355214 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2287-1384-47b9-9a37-d0334059e405 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:12.355472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2287-1384-47b9-9a37-d0334059e405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:12.414547 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2287-1384-47b9-9a37-d0334059e405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:12.416770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2287-1384-47b9-9a37-d0334059e405 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:12.427176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1354/2702] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:13.967706 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc05a4-e64f-4157-b425-a21d0277b4dc service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:13.976599 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc05a4-e64f-4157-b425-a21d0277b4dc service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:13.981004 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619fd49-152c-476c-a85d-267420391114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:13.981678 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619fd49-152c-476c-a85d-267420391114 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:13.981959 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619fd49-152c-476c-a85d-267420391114 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:13.982251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619fd49-152c-476c-a85d-267420391114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:13.991392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619fd49-152c-476c-a85d-267420391114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:13.992868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619fd49-152c-476c-a85d-267420391114 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:14.002693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1349/2703] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:18.593378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2287-1384-47b9-9a37-d0334059e405 service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:18.642832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:18.659148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2287-1384-47b9-9a37-d0334059e405 service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:18.664212 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4446b2-1f76-43e4-88c5-b8c2dcbf7a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:18.664926 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4446b2-1f76-43e4-88c5-b8c2dcbf7a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:18.665750 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4446b2-1f76-43e4-88c5-b8c2dcbf7a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:18.665750 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4446b2-1f76-43e4-88c5-b8c2dcbf7a68 admin admin] PATH_INFO: `/v3/users/565efd0ea5d94d02b162b82423b8ac6f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:18.666828 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4446b2-1f76-43e4-88c5-b8c2dcbf7a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=565efd0ea5d94d02b162b82423b8ac6f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:18.668865 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4446b2-1f76-43e4-88c5-b8c2dcbf7a68 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:18.874975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-0c4446b2-1f76-43e4-88c5-b8c2dcbf7a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565efd0ea5d94d02b162b82423b8ac6f'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:18.875680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-0c4446b2-1f76-43e4-88c5-b8c2dcbf7a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565efd0ea5d94d02b162b82423b8ac6f'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:18.954840 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-0c4446b2-1f76-43e4-88c5-b8c2dcbf7a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565efd0ea5d94d02b162b82423b8ac6f'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:18.955512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-0c4446b2-1f76-43e4-88c5-b8c2dcbf7a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565efd0ea5d94d02b162b82423b8ac6f'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:18.970194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-0c4446b2-1f76-43e4-88c5-b8c2dcbf7a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565efd0ea5d94d02b162b82423b8ac6f'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:18.983797 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1355/2704] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:57:18 2022] DELETE /identity/v3/users/565efd0ea5d94d02b162b82423b8ac6f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:18.988563 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b9a8-ebac-417e-ab51-73b991b55935 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:18.989022 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b9a8-ebac-417e-ab51-73b991b55935 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:18.989137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b9a8-ebac-417e-ab51-73b991b55935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:19.008099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-48f6b9a8-ebac-417e-ab51-73b991b55935 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:19.009348 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-48f6b9a8-ebac-417e-ab51-73b991b55935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:19.073170 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1350/2705] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:19.082585 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4446b2-1f76-43e4-88c5-b8c2dcbf7a68 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:19.084186 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0c4446b2-1f76-43e4-88c5-b8c2dcbf7a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:19.142145 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4446b2-1f76-43e4-88c5-b8c2dcbf7a68 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:19.145808 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5731eb5-6470-41fc-9498-75eda00ab975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:19.146408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5731eb5-6470-41fc-9498-75eda00ab975 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:19.146692 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5731eb5-6470-41fc-9498-75eda00ab975 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:19.146969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5731eb5-6470-41fc-9498-75eda00ab975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:19.156933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5731eb5-6470-41fc-9498-75eda00ab975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:19.158378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5731eb5-6470-41fc-9498-75eda00ab975 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:19.171770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1356/2706] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:19.560262 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6b9a8-ebac-417e-ab51-73b991b55935 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:19.560262 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-48f6b9a8-ebac-417e-ab51-73b991b55935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:19.571793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6b9a8-ebac-417e-ab51-73b991b55935 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:19.577003 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2344b2a-19cc-47ed-87b3-ed9861734a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:19.577722 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2344b2a-19cc-47ed-87b3-ed9861734a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:19.578050 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2344b2a-19cc-47ed-87b3-ed9861734a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:19.578332 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2344b2a-19cc-47ed-87b3-ed9861734a3b admin admin] PATH_INFO: `/v3/projects/5bf26b43dd3f41dd83fcd15c2b3fc92e` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:19.579610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2344b2a-19cc-47ed-87b3-ed9861734a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf26b43dd3f41dd83fcd15c2b3fc92e)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:19.581675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2344b2a-19cc-47ed-87b3-ed9861734a3b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:19.704742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-a2344b2a-19cc-47ed-87b3-ed9861734a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf26b43dd3f41dd83fcd15c2b3fc92e', 'request_id': 'req-a2344b2a-19cc-47ed-87b3-ed9861734a3b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:19.777094 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-a2344b2a-19cc-47ed-87b3-ed9861734a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf26b43dd3f41dd83fcd15c2b3fc92e', 'request_id': 'req-a2344b2a-19cc-47ed-87b3-ed9861734a3b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:19.782774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-a2344b2a-19cc-47ed-87b3-ed9861734a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf26b43dd3f41dd83fcd15c2b3fc92e', 'request_id': 'req-a2344b2a-19cc-47ed-87b3-ed9861734a3b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:19.793770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-a2344b2a-19cc-47ed-87b3-ed9861734a3b admin admin] The token cache is being invalidate because project 5bf26b43dd3f41dd83fcd15c2b3fc92e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:57:19.794058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-a2344b2a-19cc-47ed-87b3-ed9861734a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:19.794697 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-a2344b2a-19cc-47ed-87b3-ed9861734a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:19.796176 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1351/2707] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:57:19 2022] DELETE /identity/v3/projects/5bf26b43dd3f41dd83fcd15c2b3fc92e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:57:19.800163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5731eb5-6470-41fc-9498-75eda00ab975 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:19.810339 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5731eb5-6470-41fc-9498-75eda00ab975 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:19.868262 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3545d-f4d8-47d5-8e5c-1e0bbb86c6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:19.868792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3545d-f4d8-47d5-8e5c-1e0bbb86c6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:19.869075 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3545d-f4d8-47d5-8e5c-1e0bbb86c6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:19.869356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3545d-f4d8-47d5-8e5c-1e0bbb86c6a4 admin admin] PATH_INFO: `/v3/users/1335d0ee7ae04cf3a90758c22c2603f5` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:19.870476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3545d-f4d8-47d5-8e5c-1e0bbb86c6a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1335d0ee7ae04cf3a90758c22c2603f5)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:19.872423 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3545d-f4d8-47d5-8e5c-1e0bbb86c6a4 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:19.886210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:20.082869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4fa3545d-f4d8-47d5-8e5c-1e0bbb86c6a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1335d0ee7ae04cf3a90758c22c2603f5'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:20.083530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4fa3545d-f4d8-47d5-8e5c-1e0bbb86c6a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1335d0ee7ae04cf3a90758c22c2603f5'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:20.171760 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4fa3545d-f4d8-47d5-8e5c-1e0bbb86c6a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1335d0ee7ae04cf3a90758c22c2603f5'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:20.172403 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4fa3545d-f4d8-47d5-8e5c-1e0bbb86c6a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1335d0ee7ae04cf3a90758c22c2603f5'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:20.186347 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-4fa3545d-f4d8-47d5-8e5c-1e0bbb86c6a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1335d0ee7ae04cf3a90758c22c2603f5'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:20.205309 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1357/2708] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:57:19 2022] DELETE /identity/v3/users/1335d0ee7ae04cf3a90758c22c2603f5 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:20.605704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2344b2a-19cc-47ed-87b3-ed9861734a3b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:20.607784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a2344b2a-19cc-47ed-87b3-ed9861734a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:20.625047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2344b2a-19cc-47ed-87b3-ed9861734a3b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:20.676900 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:20.685290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48d0e3-1da8-4329-b2b8-565076bd51b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:20.685959 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48d0e3-1da8-4329-b2b8-565076bd51b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:20.686232 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48d0e3-1da8-4329-b2b8-565076bd51b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:20.686504 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48d0e3-1da8-4329-b2b8-565076bd51b9 admin admin] PATH_INFO: `/v3/projects/70d0b554fd8d4b77af11b816ff085eee` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:20.687641 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48d0e3-1da8-4329-b2b8-565076bd51b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d0b554fd8d4b77af11b816ff085eee)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:20.689789 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48d0e3-1da8-4329-b2b8-565076bd51b9 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:20.778016 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3b48d0e3-1da8-4329-b2b8-565076bd51b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d0b554fd8d4b77af11b816ff085eee', 'request_id': 'req-3b48d0e3-1da8-4329-b2b8-565076bd51b9'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:20.834431 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3b48d0e3-1da8-4329-b2b8-565076bd51b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d0b554fd8d4b77af11b816ff085eee', 'request_id': 'req-3b48d0e3-1da8-4329-b2b8-565076bd51b9'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:20.840577 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3b48d0e3-1da8-4329-b2b8-565076bd51b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d0b554fd8d4b77af11b816ff085eee', 'request_id': 'req-3b48d0e3-1da8-4329-b2b8-565076bd51b9'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:20.853046 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3b48d0e3-1da8-4329-b2b8-565076bd51b9 admin admin] The token cache is being invalidate because project 70d0b554fd8d4b77af11b816ff085eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:57:20.853330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3b48d0e3-1da8-4329-b2b8-565076bd51b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:20.853962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3b48d0e3-1da8-4329-b2b8-565076bd51b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:20.855420 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1352/2709] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:57:20 2022] DELETE /identity/v3/projects/70d0b554fd8d4b77af11b816ff085eee => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:20.859419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3545d-f4d8-47d5-8e5c-1e0bbb86c6a4 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:20.860867 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4fa3545d-f4d8-47d5-8e5c-1e0bbb86c6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:20.874308 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3545d-f4d8-47d5-8e5c-1e0bbb86c6a4 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:20.930672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e8304-c615-4f58-8394-58b348263d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:20.931220 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e8304-c615-4f58-8394-58b348263d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:20.931500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e8304-c615-4f58-8394-58b348263d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:20.931775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e8304-c615-4f58-8394-58b348263d4e admin admin] PATH_INFO: `/v3/users/dddb2d939a8d4c5ab2609fb3237f5dc7` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:20.932925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e8304-c615-4f58-8394-58b348263d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dddb2d939a8d4c5ab2609fb3237f5dc7)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:20.934840 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e8304-c615-4f58-8394-58b348263d4e admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:21.134058 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f54e8304-c615-4f58-8394-58b348263d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dddb2d939a8d4c5ab2609fb3237f5dc7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:21.134708 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f54e8304-c615-4f58-8394-58b348263d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dddb2d939a8d4c5ab2609fb3237f5dc7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:21.200165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f54e8304-c615-4f58-8394-58b348263d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dddb2d939a8d4c5ab2609fb3237f5dc7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:21.200758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f54e8304-c615-4f58-8394-58b348263d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dddb2d939a8d4c5ab2609fb3237f5dc7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:21.213437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f54e8304-c615-4f58-8394-58b348263d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dddb2d939a8d4c5ab2609fb3237f5dc7'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:21.225823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1358/2710] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:57:20 2022] DELETE /identity/v3/users/dddb2d939a8d4c5ab2609fb3237f5dc7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:21.625315 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48d0e3-1da8-4329-b2b8-565076bd51b9 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:21.626902 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3b48d0e3-1da8-4329-b2b8-565076bd51b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:21.641037 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48d0e3-1da8-4329-b2b8-565076bd51b9 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:21.704144 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e475cf-959d-40b2-af12-08d5a0894298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:21.704784 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e475cf-959d-40b2-af12-08d5a0894298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:21.705062 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e475cf-959d-40b2-af12-08d5a0894298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:21.705333 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e475cf-959d-40b2-af12-08d5a0894298 admin admin] PATH_INFO: `/v3/projects/34417fb4acd04fde8a39b25fb7c0760b` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:21.706585 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e475cf-959d-40b2-af12-08d5a0894298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34417fb4acd04fde8a39b25fb7c0760b)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:21.708766 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e475cf-959d-40b2-af12-08d5a0894298 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:21.984916 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-83e475cf-959d-40b2-af12-08d5a0894298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34417fb4acd04fde8a39b25fb7c0760b', 'request_id': 'req-83e475cf-959d-40b2-af12-08d5a0894298'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:22.068645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-83e475cf-959d-40b2-af12-08d5a0894298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34417fb4acd04fde8a39b25fb7c0760b', 'request_id': 'req-83e475cf-959d-40b2-af12-08d5a0894298'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:22.075625 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-83e475cf-959d-40b2-af12-08d5a0894298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34417fb4acd04fde8a39b25fb7c0760b', 'request_id': 'req-83e475cf-959d-40b2-af12-08d5a0894298'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:22.087210 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-83e475cf-959d-40b2-af12-08d5a0894298 admin admin] The token cache is being invalidate because project 34417fb4acd04fde8a39b25fb7c0760b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:57:22.087503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-83e475cf-959d-40b2-af12-08d5a0894298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:22.088243 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-83e475cf-959d-40b2-af12-08d5a0894298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:22.089734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1353/2711] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:57:21 2022] DELETE /identity/v3/projects/34417fb4acd04fde8a39b25fb7c0760b => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:25.106936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e8304-c615-4f58-8394-58b348263d4e admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:25.108446 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f54e8304-c615-4f58-8394-58b348263d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:25.119165 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:25.165918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e8304-c615-4f58-8394-58b348263d4e admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:25.214109 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2b929-4bc7-42ae-933f-6104af5d71c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:25.214705 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2b929-4bc7-42ae-933f-6104af5d71c3 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:25.214987 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2b929-4bc7-42ae-933f-6104af5d71c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:25.215259 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2b929-4bc7-42ae-933f-6104af5d71c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:25.217006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d8f2b929-4bc7-42ae-933f-6104af5d71c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:25.277513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2b929-4bc7-42ae-933f-6104af5d71c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:25.278866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2b929-4bc7-42ae-933f-6104af5d71c3 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:25.288465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1359/2712] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:32.084053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=78,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:35.284145 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=66 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:48.263205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e475cf-959d-40b2-af12-08d5a0894298 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:48.264759 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-83e475cf-959d-40b2-af12-08d5a0894298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:48.392005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e475cf-959d-40b2-af12-08d5a0894298 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:48.396749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76931868-175d-4556-b3fe-8879d51caf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:48.397382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76931868-175d-4556-b3fe-8879d51caf56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.397660 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76931868-175d-4556-b3fe-8879d51caf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.397934 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76931868-175d-4556-b3fe-8879d51caf56 admin admin] PATH_INFO: `/v3/users/a030a8637e664ec2857409915b38138b` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:48.399056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76931868-175d-4556-b3fe-8879d51caf56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a030a8637e664ec2857409915b38138b)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:48.401492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76931868-175d-4556-b3fe-8879d51caf56 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:48.556855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76931868-175d-4556-b3fe-8879d51caf56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a030a8637e664ec2857409915b38138b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:48.568768 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76931868-175d-4556-b3fe-8879d51caf56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a030a8637e664ec2857409915b38138b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:48.640188 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76931868-175d-4556-b3fe-8879d51caf56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a030a8637e664ec2857409915b38138b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:48.640890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76931868-175d-4556-b3fe-8879d51caf56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a030a8637e664ec2857409915b38138b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:48.641532 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-76931868-175d-4556-b3fe-8879d51caf56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a030a8637e664ec2857409915b38138b'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:48.657035 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1354/2713] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:57:48 2022] DELETE /identity/v3/users/a030a8637e664ec2857409915b38138b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:48.892963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2b929-4bc7-42ae-933f-6104af5d71c3 service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:48.937698 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2b929-4bc7-42ae-933f-6104af5d71c3 service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:48.998676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70877626-514b-4e63-8936-adeadee2886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:48.999313 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70877626-514b-4e63-8936-adeadee2886c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:48.999589 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70877626-514b-4e63-8936-adeadee2886c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:48.999862 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70877626-514b-4e63-8936-adeadee2886c admin admin] PATH_INFO: `/v3/projects/7787fb39fffb49aaad2716acc12ec37c` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.001651 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70877626-514b-4e63-8936-adeadee2886c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7787fb39fffb49aaad2716acc12ec37c)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.004234 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70877626-514b-4e63-8936-adeadee2886c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.108913 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-70877626-514b-4e63-8936-adeadee2886c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7787fb39fffb49aaad2716acc12ec37c', 'request_id': 'req-70877626-514b-4e63-8936-adeadee2886c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:49.115137 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-70877626-514b-4e63-8936-adeadee2886c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7787fb39fffb49aaad2716acc12ec37c', 'request_id': 'req-70877626-514b-4e63-8936-adeadee2886c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:49.194593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-70877626-514b-4e63-8936-adeadee2886c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7787fb39fffb49aaad2716acc12ec37c', 'request_id': 'req-70877626-514b-4e63-8936-adeadee2886c'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:49.205465 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-70877626-514b-4e63-8936-adeadee2886c admin admin] The token cache is being invalidate because project 7787fb39fffb49aaad2716acc12ec37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:57:49.205756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-70877626-514b-4e63-8936-adeadee2886c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:49.206379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-70877626-514b-4e63-8936-adeadee2886c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:49.230500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1360/2714] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:57:48 2022] DELETE /identity/v3/projects/7787fb39fffb49aaad2716acc12ec37c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:49.230687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76931868-175d-4556-b3fe-8879d51caf56 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.230687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-76931868-175d-4556-b3fe-8879d51caf56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:49.230687 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76931868-175d-4556-b3fe-8879d51caf56 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.239673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:49.283080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf882e-bc63-40b3-ad54-65a28ecc07b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.283753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf882e-bc63-40b3-ad54-65a28ecc07b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.283987 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf882e-bc63-40b3-ad54-65a28ecc07b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.284299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf882e-bc63-40b3-ad54-65a28ecc07b7 admin admin] PATH_INFO: `/v3/users/996ae67195bc4512adb810d151f518a1` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.287878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf882e-bc63-40b3-ad54-65a28ecc07b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=996ae67195bc4512adb810d151f518a1)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.287878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf882e-bc63-40b3-ad54-65a28ecc07b7 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:49.516714 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-87cf882e-bc63-40b3-ad54-65a28ecc07b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996ae67195bc4512adb810d151f518a1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:49.529375 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-87cf882e-bc63-40b3-ad54-65a28ecc07b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996ae67195bc4512adb810d151f518a1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:49.623045 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-87cf882e-bc63-40b3-ad54-65a28ecc07b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996ae67195bc4512adb810d151f518a1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:49.623671 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-87cf882e-bc63-40b3-ad54-65a28ecc07b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996ae67195bc4512adb810d151f518a1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:49.624315 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-87cf882e-bc63-40b3-ad54-65a28ecc07b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996ae67195bc4512adb810d151f518a1'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:49.637550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1355/2715] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:57:49 2022] DELETE /identity/v3/users/996ae67195bc4512adb810d151f518a1 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:49.918188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70877626-514b-4e63-8936-adeadee2886c admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:49.920656 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-70877626-514b-4e63-8936-adeadee2886c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:49.935413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70877626-514b-4e63-8936-adeadee2886c admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:49.992678 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79668448-8159-4ce6-a7e3-049fe0281321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:49.993456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79668448-8159-4ce6-a7e3-049fe0281321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:49.993862 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79668448-8159-4ce6-a7e3-049fe0281321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:49.994148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79668448-8159-4ce6-a7e3-049fe0281321 admin admin] PATH_INFO: `/v3/projects/cb6092c1086945d2923ced689c91376d` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:49.995380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79668448-8159-4ce6-a7e3-049fe0281321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6092c1086945d2923ced689c91376d)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:49.997328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79668448-8159-4ce6-a7e3-049fe0281321 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.005860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:50.109177 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-79668448-8159-4ce6-a7e3-049fe0281321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6092c1086945d2923ced689c91376d', 'request_id': 'req-79668448-8159-4ce6-a7e3-049fe0281321'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:50.115975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-79668448-8159-4ce6-a7e3-049fe0281321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6092c1086945d2923ced689c91376d', 'request_id': 'req-79668448-8159-4ce6-a7e3-049fe0281321'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:50.188044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-79668448-8159-4ce6-a7e3-049fe0281321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6092c1086945d2923ced689c91376d', 'request_id': 'req-79668448-8159-4ce6-a7e3-049fe0281321'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:50.199433 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-79668448-8159-4ce6-a7e3-049fe0281321 admin admin] The token cache is being invalidate because project cb6092c1086945d2923ced689c91376d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:57:50.199721 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-79668448-8159-4ce6-a7e3-049fe0281321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:50.200373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-79668448-8159-4ce6-a7e3-049fe0281321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:50.201891 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1361/2716] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:57:49 2022] DELETE /identity/v3/projects/cb6092c1086945d2923ced689c91376d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:50.206653 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff42b50-0ddc-4f95-be2b-d6a84889500e None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.206936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff42b50-0ddc-4f95-be2b-d6a84889500e None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.207209 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff42b50-0ddc-4f95-be2b-d6a84889500e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.264707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-bff42b50-0ddc-4f95-be2b-d6a84889500e None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:50.265905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-bff42b50-0ddc-4f95-be2b-d6a84889500e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:50.330898 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1356/2717] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:50.339367 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c03c6-6691-47b5-bbee-3f6bf9299587 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.339658 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c03c6-6691-47b5-bbee-3f6bf9299587 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.339937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c03c6-6691-47b5-bbee-3f6bf9299587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.359605 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-9e8c03c6-6691-47b5-bbee-3f6bf9299587 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:50.360856 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9e8c03c6-6691-47b5-bbee-3f6bf9299587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:50.368810 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1362/2718] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:50.372971 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff42b50-0ddc-4f95-be2b-d6a84889500e None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.382498 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff42b50-0ddc-4f95-be2b-d6a84889500e None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.387533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fb13b-5df0-4623-872a-6651151b61cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.388151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fb13b-5df0-4623-872a-6651151b61cd admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.388428 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fb13b-5df0-4623-872a-6651151b61cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.388694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fb13b-5df0-4623-872a-6651151b61cd admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.389325 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fb13b-5df0-4623-872a-6651151b61cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:57:50.389623 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fb13b-5df0-4623-872a-6651151b61cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.391173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fb13b-5df0-4623-872a-6651151b61cd admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.392656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:50.403465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1357/2719] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:57:50.407647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c03c6-6691-47b5-bbee-3f6bf9299587 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.417111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c03c6-6691-47b5-bbee-3f6bf9299587 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.421879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628a030-db34-47c1-899b-117bb19bca9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.422476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a030-db34-47c1-899b-117bb19bca9f admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.422760 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a030-db34-47c1-899b-117bb19bca9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.423035 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a030-db34-47c1-899b-117bb19bca9f admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.423702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a030-db34-47c1-899b-117bb19bca9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.425892 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a030-db34-47c1-899b-117bb19bca9f admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.574224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1363/2720] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:50 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:50.578540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fb13b-5df0-4623-872a-6651151b61cd admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.588640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fb13b-5df0-4623-872a-6651151b61cd admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.652288 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed8de0-1d06-4330-8de5-c8dd5a982759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.652897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed8de0-1d06-4330-8de5-c8dd5a982759 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.653187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed8de0-1d06-4330-8de5-c8dd5a982759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.653463 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed8de0-1d06-4330-8de5-c8dd5a982759 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.654099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed8de0-1d06-4330-8de5-c8dd5a982759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.656000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed8de0-1d06-4330-8de5-c8dd5a982759 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.800851 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1358/2721] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:50 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:50.805018 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628a030-db34-47c1-899b-117bb19bca9f admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.815907 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628a030-db34-47c1-899b-117bb19bca9f admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.820596 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b319d-791c-46e1-896b-127adf8d08de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.821199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b319d-791c-46e1-896b-127adf8d08de admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.821533 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b319d-791c-46e1-896b-127adf8d08de admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.821809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b319d-791c-46e1-896b-127adf8d08de admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.822456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b319d-791c-46e1-896b-127adf8d08de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.824042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b319d-791c-46e1-896b-127adf8d08de admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.834128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1364/2722] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:50.838440 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed8de0-1d06-4330-8de5-c8dd5a982759 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.848568 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed8de0-1d06-4330-8de5-c8dd5a982759 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.853627 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f70565-74d6-4478-8ce7-40a08f49b60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.854216 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f70565-74d6-4478-8ce7-40a08f49b60c admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.854497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f70565-74d6-4478-8ce7-40a08f49b60c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.854811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f70565-74d6-4478-8ce7-40a08f49b60c admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.855450 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f70565-74d6-4478-8ce7-40a08f49b60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.857054 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f70565-74d6-4478-8ce7-40a08f49b60c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:50.867448 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1359/2723] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:57:50.872278 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b319d-791c-46e1-896b-127adf8d08de admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:50.882097 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b319d-791c-46e1-896b-127adf8d08de admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:50.886643 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ca494-3e9f-440e-ac95-1392b4925976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:50.887270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ca494-3e9f-440e-ac95-1392b4925976 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:50.887544 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ca494-3e9f-440e-ac95-1392b4925976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:50.887861 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ca494-3e9f-440e-ac95-1392b4925976 admin admin] PATH_INFO: `/v3/projects/2f23e6c7abf24564bf1c838ddbe74ac3/users/bf98384780364aeab5e738f27cc9892d/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:50.902150 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ca494-3e9f-440e-ac95-1392b4925976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f23e6c7abf24564bf1c838ddbe74ac3, user_id=bf98384780364aeab5e738f27cc9892d, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:50.904827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ca494-3e9f-440e-ac95-1392b4925976 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:51.021956 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1365/2724] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:50 2022] PUT /identity/v3/projects/2f23e6c7abf24564bf1c838ddbe74ac3/users/bf98384780364aeab5e738f27cc9892d/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:51.032256 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d8d5-46a0-40f6-83e8-75905a8a5e00 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.032551 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d8d5-46a0-40f6-83e8-75905a8a5e00 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.032872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d8d5-46a0-40f6-83e8-75905a8a5e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.061345 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d3e6d8d5-46a0-40f6-83e8-75905a8a5e00 None None] MFA Rules not processed for user `bf98384780364aeab5e738f27cc9892d`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:51.062560 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d3e6d8d5-46a0-40f6-83e8-75905a8a5e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:51.125527 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1360/2725] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:51.136518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ca494-3e9f-440e-ac95-1392b4925976 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:51.138198 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9d7ca494-3e9f-440e-ac95-1392b4925976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:51.210591 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ca494-3e9f-440e-ac95-1392b4925976 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:51.214820 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc505b-3587-4d5b-8ee8-07d40a0f092c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:51.215414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc505b-3587-4d5b-8ee8-07d40a0f092c service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.215692 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc505b-3587-4d5b-8ee8-07d40a0f092c service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.215965 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc505b-3587-4d5b-8ee8-07d40a0f092c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.224210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc505b-3587-4d5b-8ee8-07d40a0f092c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:51.225615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc505b-3587-4d5b-8ee8-07d40a0f092c service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:51.234969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1366/2726] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:51.255866 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6d8d5-46a0-40f6-83e8-75905a8a5e00 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:51.320652 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6d8d5-46a0-40f6-83e8-75905a8a5e00 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:51.325194 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce084a-c03d-4d24-a611-d4122c5df846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:51.325823 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce084a-c03d-4d24-a611-d4122c5df846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.326104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce084a-c03d-4d24-a611-d4122c5df846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.326381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce084a-c03d-4d24-a611-d4122c5df846 admin admin] PATH_INFO: `/v3/users/bf98384780364aeab5e738f27cc9892d` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.327513 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce084a-c03d-4d24-a611-d4122c5df846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf98384780364aeab5e738f27cc9892d)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:51.329493 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce084a-c03d-4d24-a611-d4122c5df846 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:51.331943 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:51.551893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-08ce084a-c03d-4d24-a611-d4122c5df846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf98384780364aeab5e738f27cc9892d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:51.565010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-08ce084a-c03d-4d24-a611-d4122c5df846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf98384780364aeab5e738f27cc9892d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:51.645494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-08ce084a-c03d-4d24-a611-d4122c5df846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf98384780364aeab5e738f27cc9892d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:51.646109 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-08ce084a-c03d-4d24-a611-d4122c5df846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf98384780364aeab5e738f27cc9892d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:51.646709 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-08ce084a-c03d-4d24-a611-d4122c5df846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf98384780364aeab5e738f27cc9892d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:51.660819 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1361/2727] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:57:51 2022] DELETE /identity/v3/users/bf98384780364aeab5e738f27cc9892d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:51.665471 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464c868-20f4-4ac7-972f-cd5a31e55d44 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.665759 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464c868-20f4-4ac7-972f-cd5a31e55d44 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.666034 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464c868-20f4-4ac7-972f-cd5a31e55d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.685520 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-8464c868-20f4-4ac7-972f-cd5a31e55d44 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:51.686719 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8464c868-20f4-4ac7-972f-cd5a31e55d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:51.699586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:51.746047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1367/2728] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:51.755931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce084a-c03d-4d24-a611-d4122c5df846 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:51.757355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-08ce084a-c03d-4d24-a611-d4122c5df846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:51.814257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce084a-c03d-4d24-a611-d4122c5df846 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:51.817828 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7c583-94fa-4937-aa56-f7e2fb9cb42e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:51.818429 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7c583-94fa-4937-aa56-f7e2fb9cb42e service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:51.818704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7c583-94fa-4937-aa56-f7e2fb9cb42e service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:51.818979 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7c583-94fa-4937-aa56-f7e2fb9cb42e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:51.828484 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7c583-94fa-4937-aa56-f7e2fb9cb42e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:51.829905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7c583-94fa-4937-aa56-f7e2fb9cb42e service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:51.839748 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1362/2729] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:52.304080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464c868-20f4-4ac7-972f-cd5a31e55d44 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:52.306785 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8464c868-20f4-4ac7-972f-cd5a31e55d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:52.320191 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464c868-20f4-4ac7-972f-cd5a31e55d44 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:52.324865 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172de9c-78c5-4631-a388-c092d482a7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:52.325495 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172de9c-78c5-4631-a388-c092d482a7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:52.325775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172de9c-78c5-4631-a388-c092d482a7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:52.326044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172de9c-78c5-4631-a388-c092d482a7f4 admin admin] PATH_INFO: `/v3/projects/2f23e6c7abf24564bf1c838ddbe74ac3` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:52.327219 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172de9c-78c5-4631-a388-c092d482a7f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f23e6c7abf24564bf1c838ddbe74ac3)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:52.329152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172de9c-78c5-4631-a388-c092d482a7f4 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:52.446755 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f172de9c-78c5-4631-a388-c092d482a7f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f23e6c7abf24564bf1c838ddbe74ac3', 'request_id': 'req-f172de9c-78c5-4631-a388-c092d482a7f4'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:52.452817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f172de9c-78c5-4631-a388-c092d482a7f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f23e6c7abf24564bf1c838ddbe74ac3', 'request_id': 'req-f172de9c-78c5-4631-a388-c092d482a7f4'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:52.647623 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f172de9c-78c5-4631-a388-c092d482a7f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f23e6c7abf24564bf1c838ddbe74ac3', 'request_id': 'req-f172de9c-78c5-4631-a388-c092d482a7f4'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:52.659657 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f172de9c-78c5-4631-a388-c092d482a7f4 admin admin] The token cache is being invalidate because project 2f23e6c7abf24564bf1c838ddbe74ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:57:52.659942 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f172de9c-78c5-4631-a388-c092d482a7f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:52.660626 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f172de9c-78c5-4631-a388-c092d482a7f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:57:52.662114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1368/2730] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:57:52 2022] DELETE /identity/v3/projects/2f23e6c7abf24564bf1c838ddbe74ac3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:52.667763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3751ee9-326f-44cb-8105-37062a17d95d None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:52.668303 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3751ee9-326f-44cb-8105-37062a17d95d None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:52.668434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3751ee9-326f-44cb-8105-37062a17d95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:52.688183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-e3751ee9-326f-44cb-8105-37062a17d95d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:52.689451 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-e3751ee9-326f-44cb-8105-37062a17d95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:52.751183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1363/2731] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:52.760321 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e32458-eff9-41d4-a9af-dc5ba61f9df5 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:52.760713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e32458-eff9-41d4-a9af-dc5ba61f9df5 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:52.761063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e32458-eff9-41d4-a9af-dc5ba61f9df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:52.783230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-52e32458-eff9-41d4-a9af-dc5ba61f9df5 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:52.784857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-52e32458-eff9-41d4-a9af-dc5ba61f9df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:52.797752 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1369/2732] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:52.798704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3751ee9-326f-44cb-8105-37062a17d95d None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:52.809163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3751ee9-326f-44cb-8105-37062a17d95d None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:52.813849 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7f191-e796-4c3e-b3a7-36fd4cc5c850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:52.814454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7f191-e796-4c3e-b3a7-36fd4cc5c850 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:52.814734 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7f191-e796-4c3e-b3a7-36fd4cc5c850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:52.815009 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7f191-e796-4c3e-b3a7-36fd4cc5c850 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:52.815662 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7f191-e796-4c3e-b3a7-36fd4cc5c850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:57:52.815969 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7f191-e796-4c3e-b3a7-36fd4cc5c850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:52.817603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7f191-e796-4c3e-b3a7-36fd4cc5c850 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:52.829310 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1364/2733] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:57:52.833905 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e32458-eff9-41d4-a9af-dc5ba61f9df5 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:52.843815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e32458-eff9-41d4-a9af-dc5ba61f9df5 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:52.848597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97ab53-9e54-43a6-9ee7-c85e425177b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:52.849189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97ab53-9e54-43a6-9ee7-c85e425177b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:52.849508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97ab53-9e54-43a6-9ee7-c85e425177b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:52.849789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97ab53-9e54-43a6-9ee7-c85e425177b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:52.850421 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97ab53-9e54-43a6-9ee7-c85e425177b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:52.852466 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97ab53-9e54-43a6-9ee7-c85e425177b3 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:52.932221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1370/2734] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:52 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:52.936544 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7f191-e796-4c3e-b3a7-36fd4cc5c850 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:52.947216 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7f191-e796-4c3e-b3a7-36fd4cc5c850 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:52.954980 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:53.003799 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec65ab-2d61-4f9a-a078-4d74c4a5b029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.004356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec65ab-2d61-4f9a-a078-4d74c4a5b029 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.004640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec65ab-2d61-4f9a-a078-4d74c4a5b029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.004911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec65ab-2d61-4f9a-a078-4d74c4a5b029 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.005541 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec65ab-2d61-4f9a-a078-4d74c4a5b029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.007424 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec65ab-2d61-4f9a-a078-4d74c4a5b029 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.113953 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1365/2735] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:52 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:57:53.118105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97ab53-9e54-43a6-9ee7-c85e425177b3 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.128454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97ab53-9e54-43a6-9ee7-c85e425177b3 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.133100 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8d656-76fb-49ff-8e7c-cf1f26d8cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.133694 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8d656-76fb-49ff-8e7c-cf1f26d8cd41 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.133975 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8d656-76fb-49ff-8e7c-cf1f26d8cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.134753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8d656-76fb-49ff-8e7c-cf1f26d8cd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.135524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8d656-76fb-49ff-8e7c-cf1f26d8cd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.137159 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8d656-76fb-49ff-8e7c-cf1f26d8cd41 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.146919 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1371/2736] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:53.151372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec65ab-2d61-4f9a-a078-4d74c4a5b029 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.161167 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec65ab-2d61-4f9a-a078-4d74c4a5b029 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.165750 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa811c-c8fa-4565-adcc-0815e63b05c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.166334 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa811c-c8fa-4565-adcc-0815e63b05c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.166613 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa811c-c8fa-4565-adcc-0815e63b05c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.166885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa811c-c8fa-4565-adcc-0815e63b05c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.167549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa811c-c8fa-4565-adcc-0815e63b05c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.169146 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa811c-c8fa-4565-adcc-0815e63b05c8 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.179685 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1366/2737] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:53.183557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8d656-76fb-49ff-8e7c-cf1f26d8cd41 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.193419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8d656-76fb-49ff-8e7c-cf1f26d8cd41 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.198534 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6977f40-533b-4cd6-aec8-fa602e22e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.199172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6977f40-533b-4cd6-aec8-fa602e22e742 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.199454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6977f40-533b-4cd6-aec8-fa602e22e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.199732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6977f40-533b-4cd6-aec8-fa602e22e742 admin admin] PATH_INFO: `/v3/projects/b4a609cc5a5f44b69d715ef7a1c62763/users/34bdeca9ec9e46e3b8db1dc829531167/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.214662 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6977f40-533b-4cd6-aec8-fa602e22e742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a609cc5a5f44b69d715ef7a1c62763, user_id=34bdeca9ec9e46e3b8db1dc829531167, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.217351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6977f40-533b-4cd6-aec8-fa602e22e742 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.291174 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1372/2738] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:53 2022] PUT /identity/v3/projects/b4a609cc5a5f44b69d715ef7a1c62763/users/34bdeca9ec9e46e3b8db1dc829531167/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:53.302017 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccaa56-937c-4bf1-bdc7-99ac31b76ada None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.302393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccaa56-937c-4bf1-bdc7-99ac31b76ada None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.302672 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccaa56-937c-4bf1-bdc7-99ac31b76ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.331104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-25ccaa56-937c-4bf1-bdc7-99ac31b76ada None None] MFA Rules not processed for user `34bdeca9ec9e46e3b8db1dc829531167`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:53.332409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-25ccaa56-937c-4bf1-bdc7-99ac31b76ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:53.397072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1367/2739] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:53.402324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6977f40-533b-4cd6-aec8-fa602e22e742 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.443939 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:53.463700 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6977f40-533b-4cd6-aec8-fa602e22e742 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.468355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dabd1-f087-473d-a071-72a97529df11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.468962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dabd1-f087-473d-a071-72a97529df11 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.469246 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dabd1-f087-473d-a071-72a97529df11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.469522 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dabd1-f087-473d-a071-72a97529df11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.470163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dabd1-f087-473d-a071-72a97529df11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.472075 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dabd1-f087-473d-a071-72a97529df11 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.572799 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1373/2740] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:53 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:53.585903 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccaa56-937c-4bf1-bdc7-99ac31b76ada None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.588894 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccaa56-937c-4bf1-bdc7-99ac31b76ada None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.645278 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd12a5-24f0-438f-9686-925fc70036da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.645879 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd12a5-24f0-438f-9686-925fc70036da admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.646160 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd12a5-24f0-438f-9686-925fc70036da admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.646435 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd12a5-24f0-438f-9686-925fc70036da admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.647053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd12a5-24f0-438f-9686-925fc70036da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.648990 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd12a5-24f0-438f-9686-925fc70036da admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.736640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1368/2741] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:53 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:53.740615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dabd1-f087-473d-a071-72a97529df11 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.751509 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dabd1-f087-473d-a071-72a97529df11 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.756152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffd824-5fb4-46b8-a063-f2e61cfe526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.756743 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffd824-5fb4-46b8-a063-f2e61cfe526b admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.757017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffd824-5fb4-46b8-a063-f2e61cfe526b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.757295 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffd824-5fb4-46b8-a063-f2e61cfe526b admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.758042 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffd824-5fb4-46b8-a063-f2e61cfe526b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.760277 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffd824-5fb4-46b8-a063-f2e61cfe526b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.770394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1374/2742] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:53.774076 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd12a5-24f0-438f-9686-925fc70036da admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.784430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd12a5-24f0-438f-9686-925fc70036da admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.789344 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab416701-9596-44cd-92fc-79a7463b9b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.789932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab416701-9596-44cd-92fc-79a7463b9b93 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.790208 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab416701-9596-44cd-92fc-79a7463b9b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.791122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab416701-9596-44cd-92fc-79a7463b9b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.791765 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab416701-9596-44cd-92fc-79a7463b9b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.793368 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab416701-9596-44cd-92fc-79a7463b9b93 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.795401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:53.803891 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1369/2743] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:53.812146 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffd824-5fb4-46b8-a063-f2e61cfe526b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:53.823118 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffd824-5fb4-46b8-a063-f2e61cfe526b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:53.828119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebf44a-658a-42bb-972b-f2d208c37266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:53.828905 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebf44a-658a-42bb-972b-f2d208c37266 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.829194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebf44a-658a-42bb-972b-f2d208c37266 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.829476 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebf44a-658a-42bb-972b-f2d208c37266 admin admin] PATH_INFO: `/v3/projects/d4dbfd2f585644afaae92be4ca421e8b/users/ae6d17716a2648e79b9efcacc4001493/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.845160 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebf44a-658a-42bb-972b-f2d208c37266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4dbfd2f585644afaae92be4ca421e8b, user_id=ae6d17716a2648e79b9efcacc4001493, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:53.847823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebf44a-658a-42bb-972b-f2d208c37266 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:53.903845 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1375/2744] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:53 2022] PUT /identity/v3/projects/d4dbfd2f585644afaae92be4ca421e8b/users/ae6d17716a2648e79b9efcacc4001493/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:53.914435 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f819cfd-b644-4ca1-b4bf-ad37240c9777 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:53.914723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f819cfd-b644-4ca1-b4bf-ad37240c9777 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:53.914998 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f819cfd-b644-4ca1-b4bf-ad37240c9777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:53.947614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-5f819cfd-b644-4ca1-b4bf-ad37240c9777 None None] MFA Rules not processed for user `ae6d17716a2648e79b9efcacc4001493`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:53.948890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5f819cfd-b644-4ca1-b4bf-ad37240c9777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:54.018523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1370/2745] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:57:54.023155 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebf44a-658a-42bb-972b-f2d208c37266 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:54.085189 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebf44a-658a-42bb-972b-f2d208c37266 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:54.090424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7e865-8709-417f-9094-b8a84cdde9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:54.091024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7e865-8709-417f-9094-b8a84cdde9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.091311 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7e865-8709-417f-9094-b8a84cdde9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.091586 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7e865-8709-417f-9094-b8a84cdde9a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.092251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7e865-8709-417f-9094-b8a84cdde9a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:54.094148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7e865-8709-417f-9094-b8a84cdde9a0 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:54.166414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1376/2746] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:57:54 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:54.170466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f819cfd-b644-4ca1-b4bf-ad37240c9777 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:54.181970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f819cfd-b644-4ca1-b4bf-ad37240c9777 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:54.237611 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf9133-4db8-448b-a569-b9193845fff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:54.238209 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf9133-4db8-448b-a569-b9193845fff4 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.238483 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf9133-4db8-448b-a569-b9193845fff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.238751 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf9133-4db8-448b-a569-b9193845fff4 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.239372 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf9133-4db8-448b-a569-b9193845fff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:54.241328 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf9133-4db8-448b-a569-b9193845fff4 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:54.326340 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1371/2747] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:57:54 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:57:54.335392 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7e865-8709-417f-9094-b8a84cdde9a0 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:54.345685 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7e865-8709-417f-9094-b8a84cdde9a0 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:54.350412 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4b59e-d7be-4d0a-9c76-9a0b365d356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:54.351002 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4b59e-d7be-4d0a-9c76-9a0b365d356b admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.351283 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4b59e-d7be-4d0a-9c76-9a0b365d356b admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.351558 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4b59e-d7be-4d0a-9c76-9a0b365d356b admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.352243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4b59e-d7be-4d0a-9c76-9a0b365d356b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:54.353936 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4b59e-d7be-4d0a-9c76-9a0b365d356b admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:54.364565 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1377/2748] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:57:54.368796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf9133-4db8-448b-a569-b9193845fff4 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:54.379225 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf9133-4db8-448b-a569-b9193845fff4 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:54.383785 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb9a38-cf3d-410d-a466-e4f9f23b99e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:54.384454 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb9a38-cf3d-410d-a466-e4f9f23b99e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.384730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb9a38-cf3d-410d-a466-e4f9f23b99e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.384997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb9a38-cf3d-410d-a466-e4f9f23b99e3 admin admin] PATH_INFO: `/v3/projects/96604160163641c1922f7dcc2d1a4c9c/users/a2d5c4444ca447b6a8e5ecc09af51f05/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.401510 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb9a38-cf3d-410d-a466-e4f9f23b99e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96604160163641c1922f7dcc2d1a4c9c, user_id=a2d5c4444ca447b6a8e5ecc09af51f05, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:54.404269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb9a38-cf3d-410d-a466-e4f9f23b99e3 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:54.420494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4b59e-d7be-4d0a-9c76-9a0b365d356b admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:54.422115 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-23f4b59e-d7be-4d0a-9c76-9a0b365d356b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:54.474282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1372/2749] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:54 2022] PUT /identity/v3/projects/96604160163641c1922f7dcc2d1a4c9c/users/a2d5c4444ca447b6a8e5ecc09af51f05/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:57:54.478158 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb9a38-cf3d-410d-a466-e4f9f23b99e3 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:54.490248 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:54.518969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4b59e-d7be-4d0a-9c76-9a0b365d356b admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:54.531930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:54.543986 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb9a38-cf3d-410d-a466-e4f9f23b99e3 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:54.548802 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b6fc1-78f8-4e81-82c2-df86cddbca88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:54.549406 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b6fc1-78f8-4e81-82c2-df86cddbca88 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.549684 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b6fc1-78f8-4e81-82c2-df86cddbca88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.549957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b6fc1-78f8-4e81-82c2-df86cddbca88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.550854 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b6fc1-78f8-4e81-82c2-df86cddbca88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:54.552600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b6fc1-78f8-4e81-82c2-df86cddbca88 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:54.563211 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1373/2750] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:57:54.567236 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b6fc1-78f8-4e81-82c2-df86cddbca88 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:54.576965 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b6fc1-78f8-4e81-82c2-df86cddbca88 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:54.581693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf668b-b1a3-442d-8cc4-d6907c68d106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:54.582371 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf668b-b1a3-442d-8cc4-d6907c68d106 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.582573 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a589deb-3478-487b-9511-8c93a91d2dec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2991c613878e4993901199434f384f49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:54.582717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf668b-b1a3-442d-8cc4-d6907c68d106 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.582920 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf668b-b1a3-442d-8cc4-d6907c68d106 admin admin] PATH_INFO: `/v3/projects/96604160163641c1922f7dcc2d1a4c9c/users/a2d5c4444ca447b6a8e5ecc09af51f05/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.583164 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a589deb-3478-487b-9511-8c93a91d2dec service placement] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.583447 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a589deb-3478-487b-9511-8c93a91d2dec service placement] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.583726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a589deb-3478-487b-9511-8c93a91d2dec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.584888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf668b-b1a3-442d-8cc4-d6907c68d106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96604160163641c1922f7dcc2d1a4c9c, user_id=a2d5c4444ca447b6a8e5ecc09af51f05, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:54.585556 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4a589deb-3478-487b-9511-8c93a91d2dec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:54.587529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf668b-b1a3-442d-8cc4-d6907c68d106 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:54.597679 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a589deb-3478-487b-9511-8c93a91d2dec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:54.602397 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1374/2751] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:57:54 2022] PUT /identity/v3/projects/96604160163641c1922f7dcc2d1a4c9c/users/a2d5c4444ca447b6a8e5ecc09af51f05/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:57:54.602539 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a589deb-3478-487b-9511-8c93a91d2dec service placement] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:54.611354 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1378/2752] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:54.669699 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49034bc5-9397-4a24-a0ac-e96b4f6387fc None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.669982 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49034bc5-9397-4a24-a0ac-e96b4f6387fc None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.670257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49034bc5-9397-4a24-a0ac-e96b4f6387fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.698465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-49034bc5-9397-4a24-a0ac-e96b4f6387fc None None] MFA Rules not processed for user `a2d5c4444ca447b6a8e5ecc09af51f05`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:57:54.699676 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-49034bc5-9397-4a24-a0ac-e96b4f6387fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:54.774276 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1375/2753] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:57:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:57:54.786424 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a589deb-3478-487b-9511-8c93a91d2dec service placement] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:54.788144 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4a589deb-3478-487b-9511-8c93a91d2dec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:54.849393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a589deb-3478-487b-9511-8c93a91d2dec service placement] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:54.905962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd2f44-a0e9-45f9-be7b-ddc6064ef9fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:54.907372 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd2f44-a0e9-45f9-be7b-ddc6064ef9fe service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:54.907742 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd2f44-a0e9-45f9-be7b-ddc6064ef9fe service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:54.908110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd2f44-a0e9-45f9-be7b-ddc6064ef9fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:54.958571 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:54.970365 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd2f44-a0e9-45f9-be7b-ddc6064ef9fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:54.971998 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd2f44-a0e9-45f9-be7b-ddc6064ef9fe service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:54.981449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1379/2754] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:56.915180 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49034bc5-9397-4a24-a0ac-e96b4f6387fc None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:56.917443 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-49034bc5-9397-4a24-a0ac-e96b4f6387fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:57:56.930211 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49034bc5-9397-4a24-a0ac-e96b4f6387fc None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:56.942048 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abde866-cb20-4bac-b8f8-e920d2511542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:56.942682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abde866-cb20-4bac-b8f8-e920d2511542 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:56.942967 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abde866-cb20-4bac-b8f8-e920d2511542 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:56.943294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abde866-cb20-4bac-b8f8-e920d2511542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:57.011830 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abde866-cb20-4bac-b8f8-e920d2511542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:57.013300 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abde866-cb20-4bac-b8f8-e920d2511542 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:57.022644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1376/2755] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:57:58.272762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd2f44-a0e9-45f9-be7b-ddc6064ef9fe service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:57:58.282156 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd2f44-a0e9-45f9-be7b-ddc6064ef9fe service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:57:58.285780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d96521-2c94-4120-937f-a23826264d87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:57:58.286371 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d96521-2c94-4120-937f-a23826264d87 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:57:58.286651 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d96521-2c94-4120-937f-a23826264d87 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:57:58.286923 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d96521-2c94-4120-937f-a23826264d87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:57:58.296799 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d96521-2c94-4120-937f-a23826264d87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:57:58.298232 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d96521-2c94-4120-937f-a23826264d87 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:57:58.308241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1380/2756] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:57:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:00.386201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4974c-080e-4f53-a233-96f6ce44c733 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:00.386746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4974c-080e-4f53-a233-96f6ce44c733 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:00.386855 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4974c-080e-4f53-a233-96f6ce44c733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:00.406426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-5ef4974c-080e-4f53-a233-96f6ce44c733 None None] MFA Rules not processed for user `1d73958b5e2d43ecad929b9720889cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:00.409094 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5ef4974c-080e-4f53-a233-96f6ce44c733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:00.466383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1377/2757] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:02.813291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d96521-2c94-4120-937f-a23826264d87 service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:02.883378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d96521-2c94-4120-937f-a23826264d87 service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:02.888199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e393939-70fc-4427-bc0a-d9b8d71064c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:02.888832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e393939-70fc-4427-bc0a-d9b8d71064c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:02.889117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e393939-70fc-4427-bc0a-d9b8d71064c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:02.889395 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e393939-70fc-4427-bc0a-d9b8d71064c7 admin admin] PATH_INFO: `/v3/users/34bdeca9ec9e46e3b8db1dc829531167` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:02.890529 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e393939-70fc-4427-bc0a-d9b8d71064c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34bdeca9ec9e46e3b8db1dc829531167)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:02.892487 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e393939-70fc-4427-bc0a-d9b8d71064c7 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:03.065202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2e393939-70fc-4427-bc0a-d9b8d71064c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34bdeca9ec9e46e3b8db1dc829531167'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:03.065846 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2e393939-70fc-4427-bc0a-d9b8d71064c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34bdeca9ec9e46e3b8db1dc829531167'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:03.120140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2e393939-70fc-4427-bc0a-d9b8d71064c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34bdeca9ec9e46e3b8db1dc829531167'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:03.123716 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2e393939-70fc-4427-bc0a-d9b8d71064c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34bdeca9ec9e46e3b8db1dc829531167'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:03.142949 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-2e393939-70fc-4427-bc0a-d9b8d71064c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34bdeca9ec9e46e3b8db1dc829531167'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:03.156649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1381/2758] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:02 2022] DELETE /identity/v3/users/34bdeca9ec9e46e3b8db1dc829531167 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:58:03.161412 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf628d-9496-46cc-aac8-35ddff2991c0 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:03.161897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf628d-9496-46cc-aac8-35ddff2991c0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:03.161990 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf628d-9496-46cc-aac8-35ddff2991c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:03.171920 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:03.184183 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-8edf628d-9496-46cc-aac8-35ddff2991c0 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:03.185418 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8edf628d-9496-46cc-aac8-35ddff2991c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:03.251541 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1378/2759] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:03.258411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e393939-70fc-4427-bc0a-d9b8d71064c7 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:03.260541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-2e393939-70fc-4427-bc0a-d9b8d71064c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:03.328489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:03.354838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e393939-70fc-4427-bc0a-d9b8d71064c7 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:03.360412 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed6656-8393-4694-af09-9748f248be17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:03.360584 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed6656-8393-4694-af09-9748f248be17 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:03.361143 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed6656-8393-4694-af09-9748f248be17 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:03.361524 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed6656-8393-4694-af09-9748f248be17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:03.373023 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed6656-8393-4694-af09-9748f248be17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:03.374563 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed6656-8393-4694-af09-9748f248be17 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:03.389141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1382/2760] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:03.865889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf628d-9496-46cc-aac8-35ddff2991c0 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:03.867669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8edf628d-9496-46cc-aac8-35ddff2991c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:03.886620 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf628d-9496-46cc-aac8-35ddff2991c0 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:03.895874 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5594103-8000-4ab7-9508-412bd931408f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:03.897500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594103-8000-4ab7-9508-412bd931408f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:03.898081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594103-8000-4ab7-9508-412bd931408f admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:03.899701 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594103-8000-4ab7-9508-412bd931408f admin admin] PATH_INFO: `/v3/projects/b4a609cc5a5f44b69d715ef7a1c62763` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:03.903856 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5594103-8000-4ab7-9508-412bd931408f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4a609cc5a5f44b69d715ef7a1c62763)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:03.919907 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5594103-8000-4ab7-9508-412bd931408f admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:04.036416 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d5594103-8000-4ab7-9508-412bd931408f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a609cc5a5f44b69d715ef7a1c62763', 'request_id': 'req-d5594103-8000-4ab7-9508-412bd931408f'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:04.119758 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d5594103-8000-4ab7-9508-412bd931408f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a609cc5a5f44b69d715ef7a1c62763', 'request_id': 'req-d5594103-8000-4ab7-9508-412bd931408f'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:04.125875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d5594103-8000-4ab7-9508-412bd931408f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a609cc5a5f44b69d715ef7a1c62763', 'request_id': 'req-d5594103-8000-4ab7-9508-412bd931408f'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:04.137276 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d5594103-8000-4ab7-9508-412bd931408f admin admin] The token cache is being invalidate because project b4a609cc5a5f44b69d715ef7a1c62763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:04.137565 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d5594103-8000-4ab7-9508-412bd931408f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:04.138194 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-d5594103-8000-4ab7-9508-412bd931408f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:04.139660 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1379/2761] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:03 2022] DELETE /identity/v3/projects/b4a609cc5a5f44b69d715ef7a1c62763 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:04.144081 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed6656-8393-4694-af09-9748f248be17 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:04.155328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed6656-8393-4694-af09-9748f248be17 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:04.222552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890690d1-ae6a-46cc-a72f-646fc83e3a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:04.223196 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890690d1-ae6a-46cc-a72f-646fc83e3a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:04.223514 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890690d1-ae6a-46cc-a72f-646fc83e3a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:04.223843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890690d1-ae6a-46cc-a72f-646fc83e3a72 admin admin] PATH_INFO: `/v3/users/ae6d17716a2648e79b9efcacc4001493` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:04.225080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890690d1-ae6a-46cc-a72f-646fc83e3a72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae6d17716a2648e79b9efcacc4001493)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:04.227065 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890690d1-ae6a-46cc-a72f-646fc83e3a72 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:04.406437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-890690d1-ae6a-46cc-a72f-646fc83e3a72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae6d17716a2648e79b9efcacc4001493'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:04.407022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-890690d1-ae6a-46cc-a72f-646fc83e3a72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae6d17716a2648e79b9efcacc4001493'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:04.462744 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-890690d1-ae6a-46cc-a72f-646fc83e3a72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae6d17716a2648e79b9efcacc4001493'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:04.463961 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-890690d1-ae6a-46cc-a72f-646fc83e3a72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae6d17716a2648e79b9efcacc4001493'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:04.476741 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-890690d1-ae6a-46cc-a72f-646fc83e3a72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae6d17716a2648e79b9efcacc4001493'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:04.489279 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1383/2762] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:04 2022] DELETE /identity/v3/users/ae6d17716a2648e79b9efcacc4001493 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:04.962149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5594103-8000-4ab7-9508-412bd931408f admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:04.964203 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d5594103-8000-4ab7-9508-412bd931408f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:04.992476 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5594103-8000-4ab7-9508-412bd931408f admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:05.075022 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452545f-c72c-4c5d-a220-f937c34dfb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:05.079889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452545f-c72c-4c5d-a220-f937c34dfb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:05.079889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452545f-c72c-4c5d-a220-f937c34dfb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:05.079889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452545f-c72c-4c5d-a220-f937c34dfb59 admin admin] PATH_INFO: `/v3/projects/d4dbfd2f585644afaae92be4ca421e8b` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:05.079889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452545f-c72c-4c5d-a220-f937c34dfb59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4dbfd2f585644afaae92be4ca421e8b)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:05.079889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452545f-c72c-4c5d-a220-f937c34dfb59 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:05.185221 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:05.206209 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b452545f-c72c-4c5d-a220-f937c34dfb59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4dbfd2f585644afaae92be4ca421e8b', 'request_id': 'req-b452545f-c72c-4c5d-a220-f937c34dfb59'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:05.291609 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b452545f-c72c-4c5d-a220-f937c34dfb59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4dbfd2f585644afaae92be4ca421e8b', 'request_id': 'req-b452545f-c72c-4c5d-a220-f937c34dfb59'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:05.297812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b452545f-c72c-4c5d-a220-f937c34dfb59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4dbfd2f585644afaae92be4ca421e8b', 'request_id': 'req-b452545f-c72c-4c5d-a220-f937c34dfb59'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:05.310667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b452545f-c72c-4c5d-a220-f937c34dfb59 admin admin] The token cache is being invalidate because project d4dbfd2f585644afaae92be4ca421e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:05.310958 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b452545f-c72c-4c5d-a220-f937c34dfb59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:05.311633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b452545f-c72c-4c5d-a220-f937c34dfb59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:05.313267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1380/2763] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:04 2022] DELETE /identity/v3/projects/d4dbfd2f585644afaae92be4ca421e8b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:05.318539 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890690d1-ae6a-46cc-a72f-646fc83e3a72 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:05.320001 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-890690d1-ae6a-46cc-a72f-646fc83e3a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:05.333649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890690d1-ae6a-46cc-a72f-646fc83e3a72 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:05.395031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:05.401734 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160ba83-7d43-4d59-916a-c860bddd6bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:05.402449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160ba83-7d43-4d59-916a-c860bddd6bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:05.402800 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160ba83-7d43-4d59-916a-c860bddd6bff admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:05.403148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160ba83-7d43-4d59-916a-c860bddd6bff admin admin] PATH_INFO: `/v3/users/a2d5c4444ca447b6a8e5ecc09af51f05` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:05.404323 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160ba83-7d43-4d59-916a-c860bddd6bff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d5c4444ca447b6a8e5ecc09af51f05)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:05.406245 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160ba83-7d43-4d59-916a-c860bddd6bff admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:05.611664 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a160ba83-7d43-4d59-916a-c860bddd6bff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d5c4444ca447b6a8e5ecc09af51f05'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:05.612362 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a160ba83-7d43-4d59-916a-c860bddd6bff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d5c4444ca447b6a8e5ecc09af51f05'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:05.674313 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a160ba83-7d43-4d59-916a-c860bddd6bff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d5c4444ca447b6a8e5ecc09af51f05'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:05.675239 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a160ba83-7d43-4d59-916a-c860bddd6bff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d5c4444ca447b6a8e5ecc09af51f05'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:05.689332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a160ba83-7d43-4d59-916a-c860bddd6bff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d5c4444ca447b6a8e5ecc09af51f05'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:05.701757 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1384/2764] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:05 2022] DELETE /identity/v3/users/a2d5c4444ca447b6a8e5ecc09af51f05 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:58:06.221490 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452545f-c72c-4c5d-a220-f937c34dfb59 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:06.221490 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b452545f-c72c-4c5d-a220-f937c34dfb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:06.245381 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452545f-c72c-4c5d-a220-f937c34dfb59 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:06.307112 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d33ae-d563-46e7-aa5d-0bfe1546710f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:06.308114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d33ae-d563-46e7-aa5d-0bfe1546710f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:06.308399 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d33ae-d563-46e7-aa5d-0bfe1546710f admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:06.308682 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d33ae-d563-46e7-aa5d-0bfe1546710f admin admin] PATH_INFO: `/v3/projects/96604160163641c1922f7dcc2d1a4c9c` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:06.309941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d33ae-d563-46e7-aa5d-0bfe1546710f admin admin] RBAC: Authorizing `identity:delete_project(project_id=96604160163641c1922f7dcc2d1a4c9c)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:06.312545 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d33ae-d563-46e7-aa5d-0bfe1546710f admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:06.443693 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-350d33ae-d563-46e7-aa5d-0bfe1546710f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96604160163641c1922f7dcc2d1a4c9c', 'request_id': 'req-350d33ae-d563-46e7-aa5d-0bfe1546710f'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:06.513837 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-350d33ae-d563-46e7-aa5d-0bfe1546710f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96604160163641c1922f7dcc2d1a4c9c', 'request_id': 'req-350d33ae-d563-46e7-aa5d-0bfe1546710f'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:06.521698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-350d33ae-d563-46e7-aa5d-0bfe1546710f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96604160163641c1922f7dcc2d1a4c9c', 'request_id': 'req-350d33ae-d563-46e7-aa5d-0bfe1546710f'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:06.532290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-350d33ae-d563-46e7-aa5d-0bfe1546710f admin admin] The token cache is being invalidate because project 96604160163641c1922f7dcc2d1a4c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:06.532581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-350d33ae-d563-46e7-aa5d-0bfe1546710f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:06.533224 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-350d33ae-d563-46e7-aa5d-0bfe1546710f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:06.534728 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1381/2765] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:06 2022] DELETE /identity/v3/projects/96604160163641c1922f7dcc2d1a4c9c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:58:06.539758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9966abc-03ae-4e3d-8c81-aaf3858ecf65 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:06.540273 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9966abc-03ae-4e3d-8c81-aaf3858ecf65 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:06.540373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9966abc-03ae-4e3d-8c81-aaf3858ecf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:06.561893 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-d9966abc-03ae-4e3d-8c81-aaf3858ecf65 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:06.563157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d9966abc-03ae-4e3d-8c81-aaf3858ecf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:06.631632 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1385/2766] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:06.639774 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db109a74-49ec-47c1-bb9a-8acdd2c7766a None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:06.640507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db109a74-49ec-47c1-bb9a-8acdd2c7766a None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:06.640507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db109a74-49ec-47c1-bb9a-8acdd2c7766a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:06.661205 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-db109a74-49ec-47c1-bb9a-8acdd2c7766a None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:06.662425 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-db109a74-49ec-47c1-bb9a-8acdd2c7766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:06.670765 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1382/2767] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:58:06.675179 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9966abc-03ae-4e3d-8c81-aaf3858ecf65 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:06.685382 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9966abc-03ae-4e3d-8c81-aaf3858ecf65 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:06.690283 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d7ed0-1aa0-4ca8-b4e8-64b43c6275c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:06.690886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d7ed0-1aa0-4ca8-b4e8-64b43c6275c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:06.691168 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d7ed0-1aa0-4ca8-b4e8-64b43c6275c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:06.691445 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d7ed0-1aa0-4ca8-b4e8-64b43c6275c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:06.692151 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d7ed0-1aa0-4ca8-b4e8-64b43c6275c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:06.692458 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d7ed0-1aa0-4ca8-b4e8-64b43c6275c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:06.694119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d7ed0-1aa0-4ca8-b4e8-64b43c6275c6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:06.707163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1386/2768] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:58:06.711178 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db109a74-49ec-47c1-bb9a-8acdd2c7766a None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:06.721195 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db109a74-49ec-47c1-bb9a-8acdd2c7766a None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:06.726118 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158342c-e5ba-4f77-9fcf-bea55a32aad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:06.726723 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158342c-e5ba-4f77-9fcf-bea55a32aad9 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:06.727006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158342c-e5ba-4f77-9fcf-bea55a32aad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:06.728935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158342c-e5ba-4f77-9fcf-bea55a32aad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:06.728935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158342c-e5ba-4f77-9fcf-bea55a32aad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:06.730271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158342c-e5ba-4f77-9fcf-bea55a32aad9 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:06.844582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1383/2769] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:06 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:06.848804 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d7ed0-1aa0-4ca8-b4e8-64b43c6275c6 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:06.860830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d7ed0-1aa0-4ca8-b4e8-64b43c6275c6 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:06.925650 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4beffa-edbe-46c3-9b71-6fa695ce7eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:06.926303 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4beffa-edbe-46c3-9b71-6fa695ce7eba admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:06.926574 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4beffa-edbe-46c3-9b71-6fa695ce7eba admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:06.926845 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4beffa-edbe-46c3-9b71-6fa695ce7eba admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:06.927477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4beffa-edbe-46c3-9b71-6fa695ce7eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:06.929429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4beffa-edbe-46c3-9b71-6fa695ce7eba admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:06.940224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:07.057207 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1387/2770] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:06 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:58:07.058419 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158342c-e5ba-4f77-9fcf-bea55a32aad9 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:07.069537 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158342c-e5ba-4f77-9fcf-bea55a32aad9 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:07.074013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91470838-8028-4296-871c-836e9dfa1eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:07.074613 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91470838-8028-4296-871c-836e9dfa1eeb admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:07.074893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91470838-8028-4296-871c-836e9dfa1eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:07.075197 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91470838-8028-4296-871c-836e9dfa1eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:07.075838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91470838-8028-4296-871c-836e9dfa1eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:07.077465 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91470838-8028-4296-871c-836e9dfa1eeb admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:07.088589 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1384/2771] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:58:07.092675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4beffa-edbe-46c3-9b71-6fa695ce7eba admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:07.105869 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4beffa-edbe-46c3-9b71-6fa695ce7eba admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:07.112825 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36356bd2-7df1-462d-9660-56d8a6a0fde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:07.113617 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36356bd2-7df1-462d-9660-56d8a6a0fde9 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:07.113900 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36356bd2-7df1-462d-9660-56d8a6a0fde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:07.114179 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36356bd2-7df1-462d-9660-56d8a6a0fde9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:07.115022 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36356bd2-7df1-462d-9660-56d8a6a0fde9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:07.116810 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36356bd2-7df1-462d-9660-56d8a6a0fde9 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:07.134358 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1388/2772] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:07.135196 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91470838-8028-4296-871c-836e9dfa1eeb admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:07.145500 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91470838-8028-4296-871c-836e9dfa1eeb admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:07.153219 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217ff4a-8ec1-42f5-bd78-080cdec4d3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:07.158160 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217ff4a-8ec1-42f5-bd78-080cdec4d3fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:07.158160 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217ff4a-8ec1-42f5-bd78-080cdec4d3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:07.158160 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217ff4a-8ec1-42f5-bd78-080cdec4d3fa admin admin] PATH_INFO: `/v3/projects/ceb41b1913634f8cbbca9dc43837b3db/users/33bf366176fc4c5abbfac603a1352ba9/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:07.158160 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:07.170085 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217ff4a-8ec1-42f5-bd78-080cdec4d3fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb41b1913634f8cbbca9dc43837b3db, user_id=33bf366176fc4c5abbfac603a1352ba9, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:07.172680 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217ff4a-8ec1-42f5-bd78-080cdec4d3fa admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:07.270108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1385/2773] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:07 2022] PUT /identity/v3/projects/ceb41b1913634f8cbbca9dc43837b3db/users/33bf366176fc4c5abbfac603a1352ba9/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:58:07.274451 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c6aa7-1ebb-4c5f-a677-a07cc04f8a51 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:07.274844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c6aa7-1ebb-4c5f-a677-a07cc04f8a51 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:07.275355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c6aa7-1ebb-4c5f-a677-a07cc04f8a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:07.307436 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-4f3c6aa7-1ebb-4c5f-a677-a07cc04f8a51 None None] MFA Rules not processed for user `33bf366176fc4c5abbfac603a1352ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:07.308803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4f3c6aa7-1ebb-4c5f-a677-a07cc04f8a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:07.382370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1389/2774] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:07.390549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217ff4a-8ec1-42f5-bd78-080cdec4d3fa admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:07.482270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217ff4a-8ec1-42f5-bd78-080cdec4d3fa admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:07.487391 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe9899-3a7d-4758-8741-7d02b28e26dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:07.488008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe9899-3a7d-4758-8741-7d02b28e26dc admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:07.488338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe9899-3a7d-4758-8741-7d02b28e26dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:07.488615 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe9899-3a7d-4758-8741-7d02b28e26dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:07.489261 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe9899-3a7d-4758-8741-7d02b28e26dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:07.491517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe9899-3a7d-4758-8741-7d02b28e26dc admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:07.576076 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1386/2775] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:07 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:58:07.580469 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c6aa7-1ebb-4c5f-a677-a07cc04f8a51 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:07.594013 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c6aa7-1ebb-4c5f-a677-a07cc04f8a51 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:07.670597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad592d-14fd-4a33-8f31-c4cc928bec08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:07.671204 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad592d-14fd-4a33-8f31-c4cc928bec08 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:07.671481 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad592d-14fd-4a33-8f31-c4cc928bec08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:07.671753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad592d-14fd-4a33-8f31-c4cc928bec08 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:07.672496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad592d-14fd-4a33-8f31-c4cc928bec08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:07.674454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad592d-14fd-4a33-8f31-c4cc928bec08 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:07.779597 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1390/2776] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:07 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:58:07.783788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe9899-3a7d-4758-8741-7d02b28e26dc admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:07.794376 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe9899-3a7d-4758-8741-7d02b28e26dc admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:07.798928 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0186eb-1230-4ccd-b6da-8b2714e09bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:07.799531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0186eb-1230-4ccd-b6da-8b2714e09bec admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:07.799812 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0186eb-1230-4ccd-b6da-8b2714e09bec admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:07.800106 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0186eb-1230-4ccd-b6da-8b2714e09bec admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:07.801011 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0186eb-1230-4ccd-b6da-8b2714e09bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:07.802607 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0186eb-1230-4ccd-b6da-8b2714e09bec admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:07.814009 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1387/2777] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:07.818168 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad592d-14fd-4a33-8f31-c4cc928bec08 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:07.828943 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad592d-14fd-4a33-8f31-c4cc928bec08 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:07.833500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac5217-f78a-419e-a23e-0725fef84230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:07.834086 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac5217-f78a-419e-a23e-0725fef84230 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:07.834362 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac5217-f78a-419e-a23e-0725fef84230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:07.834632 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac5217-f78a-419e-a23e-0725fef84230 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:07.835266 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac5217-f78a-419e-a23e-0725fef84230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:07.836947 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac5217-f78a-419e-a23e-0725fef84230 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:07.847359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1391/2778] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:58:07.851807 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0186eb-1230-4ccd-b6da-8b2714e09bec admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:07.862233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0186eb-1230-4ccd-b6da-8b2714e09bec admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:07.867067 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b93f54-6bff-4418-8dac-d7960213d8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:07.867718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b93f54-6bff-4418-8dac-d7960213d8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:07.868000 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b93f54-6bff-4418-8dac-d7960213d8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:07.868306 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b93f54-6bff-4418-8dac-d7960213d8cc admin admin] PATH_INFO: `/v3/projects/6af249691d3742fcbbdb9be87eca6775/users/69fa6890482444dfad91ed5206ca6988/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:07.883854 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b93f54-6bff-4418-8dac-d7960213d8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af249691d3742fcbbdb9be87eca6775, user_id=69fa6890482444dfad91ed5206ca6988, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:07.887155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b93f54-6bff-4418-8dac-d7960213d8cc admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:07.954805 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1388/2779] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:07 2022] PUT /identity/v3/projects/6af249691d3742fcbbdb9be87eca6775/users/69fa6890482444dfad91ed5206ca6988/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:07.965268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8927-eb11-4c5d-8efc-992fb31f5866 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:07.965581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8927-eb11-4c5d-8efc-992fb31f5866 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:07.965884 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8927-eb11-4c5d-8efc-992fb31f5866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:07.994479 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-27dc8927-eb11-4c5d-8efc-992fb31f5866 None None] MFA Rules not processed for user `69fa6890482444dfad91ed5206ca6988`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:07.995711 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-27dc8927-eb11-4c5d-8efc-992fb31f5866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:08.033655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:08.060059 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1392/2780] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:08.064580 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b93f54-6bff-4418-8dac-d7960213d8cc admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:08.129047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b93f54-6bff-4418-8dac-d7960213d8cc admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:08.133664 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b8242-5947-4969-925c-1a6ddd380ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:08.134267 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b8242-5947-4969-925c-1a6ddd380ccd admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:08.134558 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b8242-5947-4969-925c-1a6ddd380ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:08.134932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b8242-5947-4969-925c-1a6ddd380ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:08.135467 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b8242-5947-4969-925c-1a6ddd380ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:08.137386 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b8242-5947-4969-925c-1a6ddd380ccd admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:08.207002 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1389/2781] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:08 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:08.211157 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc8927-eb11-4c5d-8efc-992fb31f5866 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:08.222393 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc8927-eb11-4c5d-8efc-992fb31f5866 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:08.281336 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df8319-3ad9-4e8a-9d68-16755d5646dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:08.281958 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8319-3ad9-4e8a-9d68-16755d5646dd admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:08.282295 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8319-3ad9-4e8a-9d68-16755d5646dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:08.282522 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8319-3ad9-4e8a-9d68-16755d5646dd admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:08.283176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df8319-3ad9-4e8a-9d68-16755d5646dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:08.285204 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df8319-3ad9-4e8a-9d68-16755d5646dd admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:08.417702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1393/2782] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:08 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:08.421737 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b8242-5947-4969-925c-1a6ddd380ccd admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:08.432402 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b8242-5947-4969-925c-1a6ddd380ccd admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:08.437128 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646552b3-77d7-4c92-a0e3-6cc70b6ae210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:08.437733 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646552b3-77d7-4c92-a0e3-6cc70b6ae210 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:08.438018 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646552b3-77d7-4c92-a0e3-6cc70b6ae210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:08.438313 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646552b3-77d7-4c92-a0e3-6cc70b6ae210 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:08.438989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646552b3-77d7-4c92-a0e3-6cc70b6ae210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:08.440666 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646552b3-77d7-4c92-a0e3-6cc70b6ae210 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:08.453061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1390/2783] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:08.459579 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df8319-3ad9-4e8a-9d68-16755d5646dd admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:08.471179 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df8319-3ad9-4e8a-9d68-16755d5646dd admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:08.476289 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6094977-edb2-4ec2-b750-a47aab870c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:08.477024 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6094977-edb2-4ec2-b750-a47aab870c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:08.477373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6094977-edb2-4ec2-b750-a47aab870c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:08.477737 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6094977-edb2-4ec2-b750-a47aab870c72 admin admin] PATH_INFO: `/v3/projects/4790e06ef9e341d3b66bc8c227b31fbc/users/999c2ec5d0fb43769e3209e111c706d8/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:08.496447 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6094977-edb2-4ec2-b750-a47aab870c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4790e06ef9e341d3b66bc8c227b31fbc, user_id=999c2ec5d0fb43769e3209e111c706d8, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:08.499244 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6094977-edb2-4ec2-b750-a47aab870c72 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:08.570655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1394/2784] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:08 2022] PUT /identity/v3/projects/4790e06ef9e341d3b66bc8c227b31fbc/users/999c2ec5d0fb43769e3209e111c706d8/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:08.571970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646552b3-77d7-4c92-a0e3-6cc70b6ae210 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:08.583573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646552b3-77d7-4c92-a0e3-6cc70b6ae210 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:08.592274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:08.661186 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be7460-6f47-435e-853d-7f8aee4377a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:08.661811 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be7460-6f47-435e-853d-7f8aee4377a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:08.662091 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be7460-6f47-435e-853d-7f8aee4377a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:08.662365 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be7460-6f47-435e-853d-7f8aee4377a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:08.663019 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be7460-6f47-435e-853d-7f8aee4377a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:08.664776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be7460-6f47-435e-853d-7f8aee4377a4 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:08.677716 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1391/2785] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:08.682287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6094977-edb2-4ec2-b750-a47aab870c72 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:08.693307 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6094977-edb2-4ec2-b750-a47aab870c72 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:08.698293 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75d327-b345-4caa-99e4-687efe693940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:08.704332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75d327-b345-4caa-99e4-687efe693940 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:08.704332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75d327-b345-4caa-99e4-687efe693940 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:08.704332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75d327-b345-4caa-99e4-687efe693940 admin admin] PATH_INFO: `/v3/projects/4790e06ef9e341d3b66bc8c227b31fbc/users/999c2ec5d0fb43769e3209e111c706d8/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:08.704332 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75d327-b345-4caa-99e4-687efe693940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4790e06ef9e341d3b66bc8c227b31fbc, user_id=999c2ec5d0fb43769e3209e111c706d8, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:08.704728 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75d327-b345-4caa-99e4-687efe693940 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:08.716496 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1395/2786] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:08 2022] PUT /identity/v3/projects/4790e06ef9e341d3b66bc8c227b31fbc/users/999c2ec5d0fb43769e3209e111c706d8/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:08.727215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df982da-e583-434c-bbde-293f7436b011 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:08.727496 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df982da-e583-434c-bbde-293f7436b011 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:08.727770 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df982da-e583-434c-bbde-293f7436b011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:08.758289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-6df982da-e583-434c-bbde-293f7436b011 None None] MFA Rules not processed for user `999c2ec5d0fb43769e3209e111c706d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:08.761442 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6df982da-e583-434c-bbde-293f7436b011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:08.840116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1392/2787] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:08.851508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75d327-b345-4caa-99e4-687efe693940 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:08.853240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-da75d327-b345-4caa-99e4-687efe693940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:08.939113 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75d327-b345-4caa-99e4-687efe693940 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:08.942863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20c614-662c-47fb-acb9-e4abdd30b83b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:08.943462 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20c614-662c-47fb-acb9-e4abdd30b83b service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:08.943740 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20c614-662c-47fb-acb9-e4abdd30b83b service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:08.944010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20c614-662c-47fb-acb9-e4abdd30b83b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:08.968584 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:09.003585 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20c614-662c-47fb-acb9-e4abdd30b83b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:09.016184 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20c614-662c-47fb-acb9-e4abdd30b83b service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:09.018194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1396/2788] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:10.883371 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df982da-e583-434c-bbde-293f7436b011 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:10.885440 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6df982da-e583-434c-bbde-293f7436b011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:10.906862 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df982da-e583-434c-bbde-293f7436b011 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:10.911497 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ef24d-5e1c-4fbf-96f3-5e325dc1b99a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:10.911965 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ef24d-5e1c-4fbf-96f3-5e325dc1b99a service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:10.912231 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ef24d-5e1c-4fbf-96f3-5e325dc1b99a service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:10.912908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ef24d-5e1c-4fbf-96f3-5e325dc1b99a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:11.001724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ef24d-5e1c-4fbf-96f3-5e325dc1b99a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:11.003173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ef24d-5e1c-4fbf-96f3-5e325dc1b99a service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:11.013997 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1393/2789] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:12.568702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20c614-662c-47fb-acb9-e4abdd30b83b service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:12.578370 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20c614-662c-47fb-acb9-e4abdd30b83b service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:12.589302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdca30f-ae67-4e65-a39f-f35012457210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:12.590551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdca30f-ae67-4e65-a39f-f35012457210 service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:12.590551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdca30f-ae67-4e65-a39f-f35012457210 service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:12.590831 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdca30f-ae67-4e65-a39f-f35012457210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:12.614811 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdca30f-ae67-4e65-a39f-f35012457210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:12.616753 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdca30f-ae67-4e65-a39f-f35012457210 service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:12.638589 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1397/2790] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:14.294066 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ef24d-5e1c-4fbf-96f3-5e325dc1b99a service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:14.295533 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-c93ef24d-5e1c-4fbf-96f3-5e325dc1b99a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:14.351567 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:14.379714 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ef24d-5e1c-4fbf-96f3-5e325dc1b99a service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:14.387346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e8749-c005-4848-a5a4-01637369e331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:14.387346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e8749-c005-4848-a5a4-01637369e331 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:14.387346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e8749-c005-4848-a5a4-01637369e331 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:14.387346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e8749-c005-4848-a5a4-01637369e331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:14.387713 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-575e8749-c005-4848-a5a4-01637369e331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:14.458185 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e8749-c005-4848-a5a4-01637369e331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:14.459848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e8749-c005-4848-a5a4-01637369e331 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:14.472654 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1394/2791] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:15.522131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdca30f-ae67-4e65-a39f-f35012457210 service cinder] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:15.523614 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ebdca30f-ae67-4e65-a39f-f35012457210 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:15.539058 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdca30f-ae67-4e65-a39f-f35012457210 service cinder] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:15.544448 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea803964-36ab-42d1-ad66-0eea35310849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:15.545085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea803964-36ab-42d1-ad66-0eea35310849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:15.546056 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea803964-36ab-42d1-ad66-0eea35310849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:15.546056 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea803964-36ab-42d1-ad66-0eea35310849 admin admin] PATH_INFO: `/v3/users/d3d28b9e27444162b5d02429c56d327a` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:15.547199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea803964-36ab-42d1-ad66-0eea35310849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d28b9e27444162b5d02429c56d327a)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:15.549185 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea803964-36ab-42d1-ad66-0eea35310849 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:15.783827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-ea803964-36ab-42d1-ad66-0eea35310849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d28b9e27444162b5d02429c56d327a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:15.784804 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-ea803964-36ab-42d1-ad66-0eea35310849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d28b9e27444162b5d02429c56d327a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:15.850930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-ea803964-36ab-42d1-ad66-0eea35310849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d28b9e27444162b5d02429c56d327a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:15.851593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-ea803964-36ab-42d1-ad66-0eea35310849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d28b9e27444162b5d02429c56d327a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:15.867930 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-ea803964-36ab-42d1-ad66-0eea35310849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d28b9e27444162b5d02429c56d327a'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:15.880973 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1398/2792] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:15 2022] DELETE /identity/v3/users/d3d28b9e27444162b5d02429c56d327a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:16.213718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e8749-c005-4848-a5a4-01637369e331 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:16.237246 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e8749-c005-4848-a5a4-01637369e331 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:16.324576 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af9952-807b-4fc2-ade7-4e8dd4399842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:16.325361 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af9952-807b-4fc2-ade7-4e8dd4399842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:16.325649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af9952-807b-4fc2-ade7-4e8dd4399842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:16.325927 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af9952-807b-4fc2-ade7-4e8dd4399842 admin admin] PATH_INFO: `/v3/projects/4f95d720ec184934b6c94fe5738261b7` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:16.327139 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af9952-807b-4fc2-ade7-4e8dd4399842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f95d720ec184934b6c94fe5738261b7)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:16.329559 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af9952-807b-4fc2-ade7-4e8dd4399842 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:16.447673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b7af9952-807b-4fc2-ade7-4e8dd4399842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f95d720ec184934b6c94fe5738261b7', 'request_id': 'req-b7af9952-807b-4fc2-ade7-4e8dd4399842'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:16.582590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b7af9952-807b-4fc2-ade7-4e8dd4399842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f95d720ec184934b6c94fe5738261b7', 'request_id': 'req-b7af9952-807b-4fc2-ade7-4e8dd4399842'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:16.592646 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b7af9952-807b-4fc2-ade7-4e8dd4399842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f95d720ec184934b6c94fe5738261b7', 'request_id': 'req-b7af9952-807b-4fc2-ade7-4e8dd4399842'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:16.611850 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b7af9952-807b-4fc2-ade7-4e8dd4399842 admin admin] The token cache is being invalidate because project 4f95d720ec184934b6c94fe5738261b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:16.612274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b7af9952-807b-4fc2-ade7-4e8dd4399842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:16.617461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b7af9952-807b-4fc2-ade7-4e8dd4399842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:16.617461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1395/2793] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:16 2022] DELETE /identity/v3/projects/4f95d720ec184934b6c94fe5738261b7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:16.618480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea803964-36ab-42d1-ad66-0eea35310849 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:16.620655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ea803964-36ab-42d1-ad66-0eea35310849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:16.633950 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea803964-36ab-42d1-ad66-0eea35310849 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:16.710410 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4292b11-58b1-45d2-94e9-588f0724f686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:16.711109 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4292b11-58b1-45d2-94e9-588f0724f686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:16.711402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4292b11-58b1-45d2-94e9-588f0724f686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:16.711676 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4292b11-58b1-45d2-94e9-588f0724f686 admin admin] PATH_INFO: `/v3/users/ea03863bda2f47208461a776e24d85d9` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:16.713172 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4292b11-58b1-45d2-94e9-588f0724f686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea03863bda2f47208461a776e24d85d9)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:16.718056 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4292b11-58b1-45d2-94e9-588f0724f686 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:16.863976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:16.987500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b4292b11-58b1-45d2-94e9-588f0724f686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea03863bda2f47208461a776e24d85d9'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:16.988221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b4292b11-58b1-45d2-94e9-588f0724f686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea03863bda2f47208461a776e24d85d9'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.057592 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b4292b11-58b1-45d2-94e9-588f0724f686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea03863bda2f47208461a776e24d85d9'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.058305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b4292b11-58b1-45d2-94e9-588f0724f686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea03863bda2f47208461a776e24d85d9'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.074624 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-b4292b11-58b1-45d2-94e9-588f0724f686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea03863bda2f47208461a776e24d85d9'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.089845 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1399/2794] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:16 2022] DELETE /identity/v3/users/ea03863bda2f47208461a776e24d85d9 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:58:17.333029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af9952-807b-4fc2-ade7-4e8dd4399842 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:17.334587 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b7af9952-807b-4fc2-ade7-4e8dd4399842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:17.370776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af9952-807b-4fc2-ade7-4e8dd4399842 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:17.377361 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:17.426186 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4292b11-58b1-45d2-94e9-588f0724f686 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:17.427767 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b4292b11-58b1-45d2-94e9-588f0724f686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:17.446588 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1f70d-a58b-434e-bc95-9d480cd4a4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:17.447906 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1f70d-a58b-434e-bc95-9d480cd4a4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:17.448230 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1f70d-a58b-434e-bc95-9d480cd4a4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:17.448513 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1f70d-a58b-434e-bc95-9d480cd4a4d7 admin admin] PATH_INFO: `/v3/projects/574c8f664b3a44ae8688b1882ee4177e` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:17.449836 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1f70d-a58b-434e-bc95-9d480cd4a4d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=574c8f664b3a44ae8688b1882ee4177e)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:17.451895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1f70d-a58b-434e-bc95-9d480cd4a4d7 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:17.498791 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4292b11-58b1-45d2-94e9-588f0724f686 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:17.503480 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb055138-7b1c-4559-8ced-a34c1abbdddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:17.504136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055138-7b1c-4559-8ced-a34c1abbdddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:17.504420 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055138-7b1c-4559-8ced-a34c1abbdddc admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:17.504691 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055138-7b1c-4559-8ced-a34c1abbdddc admin admin] PATH_INFO: `/v3/users/33bf366176fc4c5abbfac603a1352ba9` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:17.505841 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb055138-7b1c-4559-8ced-a34c1abbdddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=33bf366176fc4c5abbfac603a1352ba9)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:17.507762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb055138-7b1c-4559-8ced-a34c1abbdddc admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:17.559725 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-51e1f70d-a58b-434e-bc95-9d480cd4a4d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574c8f664b3a44ae8688b1882ee4177e', 'request_id': 'req-51e1f70d-a58b-434e-bc95-9d480cd4a4d7'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.656984 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-51e1f70d-a58b-434e-bc95-9d480cd4a4d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574c8f664b3a44ae8688b1882ee4177e', 'request_id': 'req-51e1f70d-a58b-434e-bc95-9d480cd4a4d7'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.663937 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-51e1f70d-a58b-434e-bc95-9d480cd4a4d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574c8f664b3a44ae8688b1882ee4177e', 'request_id': 'req-51e1f70d-a58b-434e-bc95-9d480cd4a4d7'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.677104 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-51e1f70d-a58b-434e-bc95-9d480cd4a4d7 admin admin] The token cache is being invalidate because project 574c8f664b3a44ae8688b1882ee4177e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:17.677393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-51e1f70d-a58b-434e-bc95-9d480cd4a4d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.678072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-51e1f70d-a58b-434e-bc95-9d480cd4a4d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.679648 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1396/2795] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:17 2022] DELETE /identity/v3/projects/574c8f664b3a44ae8688b1882ee4177e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:17.810937 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-cb055138-7b1c-4559-8ced-a34c1abbdddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33bf366176fc4c5abbfac603a1352ba9'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.811522 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-cb055138-7b1c-4559-8ced-a34c1abbdddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33bf366176fc4c5abbfac603a1352ba9'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.879749 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-cb055138-7b1c-4559-8ced-a34c1abbdddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33bf366176fc4c5abbfac603a1352ba9'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.880427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-cb055138-7b1c-4559-8ced-a34c1abbdddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33bf366176fc4c5abbfac603a1352ba9'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.895210 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-cb055138-7b1c-4559-8ced-a34c1abbdddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33bf366176fc4c5abbfac603a1352ba9'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:17.908537 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1400/2796] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:17 2022] DELETE /identity/v3/users/33bf366176fc4c5abbfac603a1352ba9 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:17.913388 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b32714-aa8a-4dab-b385-757dd9285a1b None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:17.913673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b32714-aa8a-4dab-b385-757dd9285a1b None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:17.916258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b32714-aa8a-4dab-b385-757dd9285a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:17.935647 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-d1b32714-aa8a-4dab-b385-757dd9285a1b None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:17.936921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d1b32714-aa8a-4dab-b385-757dd9285a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:17.998199 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1397/2797] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:18.007941 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb055138-7b1c-4559-8ced-a34c1abbdddc admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:18.009419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-cb055138-7b1c-4559-8ced-a34c1abbdddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:18.035100 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:18.066148 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb055138-7b1c-4559-8ced-a34c1abbdddc admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:18.069707 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5956c65-40a9-48b2-84b7-8904c7c021e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:18.070297 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5956c65-40a9-48b2-84b7-8904c7c021e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:18.070602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5956c65-40a9-48b2-84b7-8904c7c021e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:18.070925 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5956c65-40a9-48b2-84b7-8904c7c021e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:18.080145 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5956c65-40a9-48b2-84b7-8904c7c021e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:18.081568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5956c65-40a9-48b2-84b7-8904c7c021e0 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:18.092114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1401/2798] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:18.475294 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b32714-aa8a-4dab-b385-757dd9285a1b None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:18.476853 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d1b32714-aa8a-4dab-b385-757dd9285a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:18.490292 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b32714-aa8a-4dab-b385-757dd9285a1b None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:18.494893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2e75e-32c6-4096-a2c6-a3cb85c721db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:18.495600 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2e75e-32c6-4096-a2c6-a3cb85c721db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:18.495875 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2e75e-32c6-4096-a2c6-a3cb85c721db admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:18.496193 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2e75e-32c6-4096-a2c6-a3cb85c721db admin admin] PATH_INFO: `/v3/projects/ceb41b1913634f8cbbca9dc43837b3db` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:18.497404 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2e75e-32c6-4096-a2c6-a3cb85c721db admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb41b1913634f8cbbca9dc43837b3db)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:18.499331 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2e75e-32c6-4096-a2c6-a3cb85c721db admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:18.613659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:18.623007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dde2e75e-32c6-4096-a2c6-a3cb85c721db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb41b1913634f8cbbca9dc43837b3db', 'request_id': 'req-dde2e75e-32c6-4096-a2c6-a3cb85c721db'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:18.690917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dde2e75e-32c6-4096-a2c6-a3cb85c721db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb41b1913634f8cbbca9dc43837b3db', 'request_id': 'req-dde2e75e-32c6-4096-a2c6-a3cb85c721db'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:18.696603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dde2e75e-32c6-4096-a2c6-a3cb85c721db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb41b1913634f8cbbca9dc43837b3db', 'request_id': 'req-dde2e75e-32c6-4096-a2c6-a3cb85c721db'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:18.708388 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dde2e75e-32c6-4096-a2c6-a3cb85c721db admin admin] The token cache is being invalidate because project ceb41b1913634f8cbbca9dc43837b3db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:18.708885 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dde2e75e-32c6-4096-a2c6-a3cb85c721db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:18.709936 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dde2e75e-32c6-4096-a2c6-a3cb85c721db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:18.711422 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1398/2799] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:18 2022] DELETE /identity/v3/projects/ceb41b1913634f8cbbca9dc43837b3db => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:18.716105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5956c65-40a9-48b2-84b7-8904c7c021e0 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:18.725866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5956c65-40a9-48b2-84b7-8904c7c021e0 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:18.782188 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb9f22-04b5-405a-96c1-0911aecdb016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:18.782810 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb9f22-04b5-405a-96c1-0911aecdb016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:18.783091 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb9f22-04b5-405a-96c1-0911aecdb016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:18.783368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb9f22-04b5-405a-96c1-0911aecdb016 admin admin] PATH_INFO: `/v3/users/69fa6890482444dfad91ed5206ca6988` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:18.784513 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb9f22-04b5-405a-96c1-0911aecdb016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69fa6890482444dfad91ed5206ca6988)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:18.786435 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb9f22-04b5-405a-96c1-0911aecdb016 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:18.933699 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-23fb9f22-04b5-405a-96c1-0911aecdb016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69fa6890482444dfad91ed5206ca6988'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:18.934366 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-23fb9f22-04b5-405a-96c1-0911aecdb016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69fa6890482444dfad91ed5206ca6988'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:18.999441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-23fb9f22-04b5-405a-96c1-0911aecdb016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69fa6890482444dfad91ed5206ca6988'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:19.000014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-23fb9f22-04b5-405a-96c1-0911aecdb016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69fa6890482444dfad91ed5206ca6988'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:19.012344 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-23fb9f22-04b5-405a-96c1-0911aecdb016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69fa6890482444dfad91ed5206ca6988'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:19.024500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1402/2800] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:18 2022] DELETE /identity/v3/users/69fa6890482444dfad91ed5206ca6988 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:19.419644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2e75e-32c6-4096-a2c6-a3cb85c721db admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:19.421511 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-dde2e75e-32c6-4096-a2c6-a3cb85c721db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:19.435233 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2e75e-32c6-4096-a2c6-a3cb85c721db admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:19.493026 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bcb9d-b95c-4534-9273-435253e87f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:19.493753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bcb9d-b95c-4534-9273-435253e87f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:19.494521 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bcb9d-b95c-4534-9273-435253e87f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:19.494800 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bcb9d-b95c-4534-9273-435253e87f2e admin admin] PATH_INFO: `/v3/projects/6af249691d3742fcbbdb9be87eca6775` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:19.495933 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bcb9d-b95c-4534-9273-435253e87f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af249691d3742fcbbdb9be87eca6775)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:19.497850 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bcb9d-b95c-4534-9273-435253e87f2e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:19.593948 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-a70bcb9d-b95c-4534-9273-435253e87f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af249691d3742fcbbdb9be87eca6775', 'request_id': 'req-a70bcb9d-b95c-4534-9273-435253e87f2e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:19.673615 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-a70bcb9d-b95c-4534-9273-435253e87f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af249691d3742fcbbdb9be87eca6775', 'request_id': 'req-a70bcb9d-b95c-4534-9273-435253e87f2e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:19.680066 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-a70bcb9d-b95c-4534-9273-435253e87f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af249691d3742fcbbdb9be87eca6775', 'request_id': 'req-a70bcb9d-b95c-4534-9273-435253e87f2e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:19.691539 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-a70bcb9d-b95c-4534-9273-435253e87f2e admin admin] The token cache is being invalidate because project 6af249691d3742fcbbdb9be87eca6775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:19.691831 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-a70bcb9d-b95c-4534-9273-435253e87f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:19.692490 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-a70bcb9d-b95c-4534-9273-435253e87f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:19.693972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1399/2801] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:19 2022] DELETE /identity/v3/projects/6af249691d3742fcbbdb9be87eca6775 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:19.703671 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb9f22-04b5-405a-96c1-0911aecdb016 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:19.705093 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-23fb9f22-04b5-405a-96c1-0911aecdb016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:19.719168 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb9f22-04b5-405a-96c1-0911aecdb016 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:19.762040 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:19.776983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab21bde-61d7-445d-8ba0-83329a76cb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:19.777614 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab21bde-61d7-445d-8ba0-83329a76cb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:19.777894 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab21bde-61d7-445d-8ba0-83329a76cb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:19.778166 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab21bde-61d7-445d-8ba0-83329a76cb78 admin admin] PATH_INFO: `/v3/users/999c2ec5d0fb43769e3209e111c706d8` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:19.779275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab21bde-61d7-445d-8ba0-83329a76cb78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999c2ec5d0fb43769e3209e111c706d8)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:19.781286 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab21bde-61d7-445d-8ba0-83329a76cb78 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:19.985103 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8ab21bde-61d7-445d-8ba0-83329a76cb78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999c2ec5d0fb43769e3209e111c706d8'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:19.985762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8ab21bde-61d7-445d-8ba0-83329a76cb78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999c2ec5d0fb43769e3209e111c706d8'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:20.079371 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8ab21bde-61d7-445d-8ba0-83329a76cb78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999c2ec5d0fb43769e3209e111c706d8'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:20.080006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8ab21bde-61d7-445d-8ba0-83329a76cb78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999c2ec5d0fb43769e3209e111c706d8'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:20.092655 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-8ab21bde-61d7-445d-8ba0-83329a76cb78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999c2ec5d0fb43769e3209e111c706d8'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:20.105006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1403/2802] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:19 2022] DELETE /identity/v3/users/999c2ec5d0fb43769e3209e111c706d8 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:20.544361 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bcb9d-b95c-4534-9273-435253e87f2e admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:20.545807 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-a70bcb9d-b95c-4534-9273-435253e87f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:20.559366 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bcb9d-b95c-4534-9273-435253e87f2e admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:20.609608 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:20.620856 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dbcae-2fb4-4c5b-b87b-fd7092b2dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:20.621494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dbcae-2fb4-4c5b-b87b-fd7092b2dc2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:20.621775 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dbcae-2fb4-4c5b-b87b-fd7092b2dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:20.622047 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dbcae-2fb4-4c5b-b87b-fd7092b2dc2d admin admin] PATH_INFO: `/v3/projects/4790e06ef9e341d3b66bc8c227b31fbc` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:20.623173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595dbcae-2fb4-4c5b-b87b-fd7092b2dc2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4790e06ef9e341d3b66bc8c227b31fbc)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:20.625220 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595dbcae-2fb4-4c5b-b87b-fd7092b2dc2d admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:20.725211 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-595dbcae-2fb4-4c5b-b87b-fd7092b2dc2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4790e06ef9e341d3b66bc8c227b31fbc', 'request_id': 'req-595dbcae-2fb4-4c5b-b87b-fd7092b2dc2d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:20.793675 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-595dbcae-2fb4-4c5b-b87b-fd7092b2dc2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4790e06ef9e341d3b66bc8c227b31fbc', 'request_id': 'req-595dbcae-2fb4-4c5b-b87b-fd7092b2dc2d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:20.799399 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-595dbcae-2fb4-4c5b-b87b-fd7092b2dc2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4790e06ef9e341d3b66bc8c227b31fbc', 'request_id': 'req-595dbcae-2fb4-4c5b-b87b-fd7092b2dc2d'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:20.811619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-595dbcae-2fb4-4c5b-b87b-fd7092b2dc2d admin admin] The token cache is being invalidate because project 4790e06ef9e341d3b66bc8c227b31fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:20.812153 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-595dbcae-2fb4-4c5b-b87b-fd7092b2dc2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:20.813241 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-595dbcae-2fb4-4c5b-b87b-fd7092b2dc2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:20.814814 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1400/2803] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:20 2022] DELETE /identity/v3/projects/4790e06ef9e341d3b66bc8c227b31fbc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:20.819817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe57d9-e43f-4f5b-8082-56bf2717e437 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:20.820151 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe57d9-e43f-4f5b-8082-56bf2717e437 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:20.820451 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe57d9-e43f-4f5b-8082-56bf2717e437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:20.839759 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-fabe57d9-e43f-4f5b-8082-56bf2717e437 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:20.841021 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-fabe57d9-e43f-4f5b-8082-56bf2717e437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:20.899726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1404/2804] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:20.908809 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db370af8-1d2e-483b-9c08-d4fba031e024 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:20.909125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db370af8-1d2e-483b-9c08-d4fba031e024 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:20.909401 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db370af8-1d2e-483b-9c08-d4fba031e024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:20.929581 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-db370af8-1d2e-483b-9c08-d4fba031e024 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:20.930778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-db370af8-1d2e-483b-9c08-d4fba031e024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:20.939320 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1401/2805] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:20.943379 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe57d9-e43f-4f5b-8082-56bf2717e437 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:20.952969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe57d9-e43f-4f5b-8082-56bf2717e437 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:20.957672 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cea35-edfb-4470-bdab-07029f9d5013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:20.958270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cea35-edfb-4470-bdab-07029f9d5013 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:20.958550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cea35-edfb-4470-bdab-07029f9d5013 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:20.958823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cea35-edfb-4470-bdab-07029f9d5013 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:20.959520 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cea35-edfb-4470-bdab-07029f9d5013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:20.959849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cea35-edfb-4470-bdab-07029f9d5013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:20.961515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cea35-edfb-4470-bdab-07029f9d5013 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:20.973020 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1405/2806] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:58:20.977124 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db370af8-1d2e-483b-9c08-d4fba031e024 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:20.987762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db370af8-1d2e-483b-9c08-d4fba031e024 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:20.992396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de169b-6f9f-4ff8-ac9c-2b39c70dd094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:20.992983 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de169b-6f9f-4ff8-ac9c-2b39c70dd094 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:20.993260 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de169b-6f9f-4ff8-ac9c-2b39c70dd094 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:20.993529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de169b-6f9f-4ff8-ac9c-2b39c70dd094 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:20.994759 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de169b-6f9f-4ff8-ac9c-2b39c70dd094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:20.996651 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de169b-6f9f-4ff8-ac9c-2b39c70dd094 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:21.080282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1402/2807] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:20 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:21.084468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cea35-edfb-4470-bdab-07029f9d5013 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:21.094789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cea35-edfb-4470-bdab-07029f9d5013 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:21.142043 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:21.152073 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227039f-3c2b-49de-9cfe-df0cf689c2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:21.154599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227039f-3c2b-49de-9cfe-df0cf689c2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:21.154599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227039f-3c2b-49de-9cfe-df0cf689c2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:21.154599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227039f-3c2b-49de-9cfe-df0cf689c2d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:21.154599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227039f-3c2b-49de-9cfe-df0cf689c2d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:21.155781 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227039f-3c2b-49de-9cfe-df0cf689c2d5 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:21.262944 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1406/2808] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:21 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:21.267117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de169b-6f9f-4ff8-ac9c-2b39c70dd094 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:21.277910 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de169b-6f9f-4ff8-ac9c-2b39c70dd094 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:21.282523 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0217a0a-b12b-4fd4-a455-0c3a16f541e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:21.283122 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0217a0a-b12b-4fd4-a455-0c3a16f541e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:21.283406 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0217a0a-b12b-4fd4-a455-0c3a16f541e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:21.283684 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0217a0a-b12b-4fd4-a455-0c3a16f541e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:21.284370 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0217a0a-b12b-4fd4-a455-0c3a16f541e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:21.285977 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0217a0a-b12b-4fd4-a455-0c3a16f541e0 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:21.295799 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1403/2809] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:21.299620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227039f-3c2b-49de-9cfe-df0cf689c2d5 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:21.310413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227039f-3c2b-49de-9cfe-df0cf689c2d5 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:21.315270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba426709-f76c-4d3a-96bb-232f84cfab08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:21.315861 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba426709-f76c-4d3a-96bb-232f84cfab08 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:21.316220 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba426709-f76c-4d3a-96bb-232f84cfab08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:21.316500 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba426709-f76c-4d3a-96bb-232f84cfab08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:21.317145 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba426709-f76c-4d3a-96bb-232f84cfab08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:21.318765 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba426709-f76c-4d3a-96bb-232f84cfab08 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:21.329971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1407/2810] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:21.334012 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0217a0a-b12b-4fd4-a455-0c3a16f541e0 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:21.343720 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0217a0a-b12b-4fd4-a455-0c3a16f541e0 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:21.348327 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e44078-79d5-4d8b-b2d4-5dd27a411181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:21.348966 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e44078-79d5-4d8b-b2d4-5dd27a411181 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:21.349250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e44078-79d5-4d8b-b2d4-5dd27a411181 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:21.349525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e44078-79d5-4d8b-b2d4-5dd27a411181 admin admin] PATH_INFO: `/v3/projects/24d869cf0e094051a2cd37fb8391480b/users/840bdbe0b54849efbf92a18c813c5ad5/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:21.363470 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e44078-79d5-4d8b-b2d4-5dd27a411181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d869cf0e094051a2cd37fb8391480b, user_id=840bdbe0b54849efbf92a18c813c5ad5, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:21.366116 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e44078-79d5-4d8b-b2d4-5dd27a411181 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:21.444478 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1404/2811] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:21 2022] PUT /identity/v3/projects/24d869cf0e094051a2cd37fb8391480b/users/840bdbe0b54849efbf92a18c813c5ad5/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:21.456044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b4709-3203-428d-bb2c-78d8d9143a2d None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:21.456366 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b4709-3203-428d-bb2c-78d8d9143a2d None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:21.457546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b4709-3203-428d-bb2c-78d8d9143a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:21.484775 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-485b4709-3203-428d-bb2c-78d8d9143a2d None None] MFA Rules not processed for user `840bdbe0b54849efbf92a18c813c5ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:21.486080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-485b4709-3203-428d-bb2c-78d8d9143a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:21.550824 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1408/2812] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:21.568336 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e44078-79d5-4d8b-b2d4-5dd27a411181 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:21.570028 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-f6e44078-79d5-4d8b-b2d4-5dd27a411181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:21.629543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e44078-79d5-4d8b-b2d4-5dd27a411181 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:21.633407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949d19a-ddf0-4a5e-a578-b32eca5ce6fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:21.634031 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949d19a-ddf0-4a5e-a578-b32eca5ce6fb service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:21.634984 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949d19a-ddf0-4a5e-a578-b32eca5ce6fb service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:21.635093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949d19a-ddf0-4a5e-a578-b32eca5ce6fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:21.643772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949d19a-ddf0-4a5e-a578-b32eca5ce6fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:21.645163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949d19a-ddf0-4a5e-a578-b32eca5ce6fb service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:21.654865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1405/2813] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:31.547657 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=43,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:31.649949 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:32.833605 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b4709-3203-428d-bb2c-78d8d9143a2d None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:32.893963 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b4709-3203-428d-bb2c-78d8d9143a2d None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:32.898363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba233e7-0923-49df-96da-8e02b78da73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:32.898976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba233e7-0923-49df-96da-8e02b78da73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:32.899251 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba233e7-0923-49df-96da-8e02b78da73f admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:32.899522 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba233e7-0923-49df-96da-8e02b78da73f admin admin] PATH_INFO: `/v3/users/840bdbe0b54849efbf92a18c813c5ad5` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:32.900638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba233e7-0923-49df-96da-8e02b78da73f admin admin] RBAC: Authorizing `identity:delete_user(user_id=840bdbe0b54849efbf92a18c813c5ad5)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:32.902544 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba233e7-0923-49df-96da-8e02b78da73f admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:33.080073 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-dba233e7-0923-49df-96da-8e02b78da73f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840bdbe0b54849efbf92a18c813c5ad5'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:33.080758 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-dba233e7-0923-49df-96da-8e02b78da73f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840bdbe0b54849efbf92a18c813c5ad5'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:33.152625 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-dba233e7-0923-49df-96da-8e02b78da73f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840bdbe0b54849efbf92a18c813c5ad5'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:33.153163 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-dba233e7-0923-49df-96da-8e02b78da73f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840bdbe0b54849efbf92a18c813c5ad5'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:33.166318 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-dba233e7-0923-49df-96da-8e02b78da73f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840bdbe0b54849efbf92a18c813c5ad5'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:33.179706 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1409/2814] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:58:32 2022] DELETE /identity/v3/users/840bdbe0b54849efbf92a18c813c5ad5 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:33.184396 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f4cb4-fd6d-4eb2-92e5-130f65d6e818 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:33.184867 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f4cb4-fd6d-4eb2-92e5-130f65d6e818 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:33.184973 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f4cb4-fd6d-4eb2-92e5-130f65d6e818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:33.203689 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-f88f4cb4-fd6d-4eb2-92e5-130f65d6e818 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:33.204921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-f88f4cb4-fd6d-4eb2-92e5-130f65d6e818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:33.270308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1406/2815] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:33.280964 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba233e7-0923-49df-96da-8e02b78da73f admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:33.282383 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-dba233e7-0923-49df-96da-8e02b78da73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:33.342014 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba233e7-0923-49df-96da-8e02b78da73f admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:33.345567 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f833b5d-07fb-419e-a637-357b69e644d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:33.346211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f833b5d-07fb-419e-a637-357b69e644d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:33.346596 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f833b5d-07fb-419e-a637-357b69e644d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:33.346872 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f833b5d-07fb-419e-a637-357b69e644d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:33.356413 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f833b5d-07fb-419e-a637-357b69e644d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:33.357847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f833b5d-07fb-419e-a637-357b69e644d8 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:33.367391 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1410/2816] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:33.813261 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f4cb4-fd6d-4eb2-92e5-130f65d6e818 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:33.814752 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-f88f4cb4-fd6d-4eb2-92e5-130f65d6e818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:33.827225 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f4cb4-fd6d-4eb2-92e5-130f65d6e818 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:33.832338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e65ff-4169-4d77-8ef7-4fce41c9638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:33.833092 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e65ff-4169-4d77-8ef7-4fce41c9638c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:33.833434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e65ff-4169-4d77-8ef7-4fce41c9638c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:33.833701 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e65ff-4169-4d77-8ef7-4fce41c9638c admin admin] PATH_INFO: `/v3/projects/24d869cf0e094051a2cd37fb8391480b` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:33.834868 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e65ff-4169-4d77-8ef7-4fce41c9638c admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d869cf0e094051a2cd37fb8391480b)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:33.838724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e65ff-4169-4d77-8ef7-4fce41c9638c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:33.936547 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b32e65ff-4169-4d77-8ef7-4fce41c9638c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d869cf0e094051a2cd37fb8391480b', 'request_id': 'req-b32e65ff-4169-4d77-8ef7-4fce41c9638c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:34.010753 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b32e65ff-4169-4d77-8ef7-4fce41c9638c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d869cf0e094051a2cd37fb8391480b', 'request_id': 'req-b32e65ff-4169-4d77-8ef7-4fce41c9638c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:34.016643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b32e65ff-4169-4d77-8ef7-4fce41c9638c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d869cf0e094051a2cd37fb8391480b', 'request_id': 'req-b32e65ff-4169-4d77-8ef7-4fce41c9638c'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:34.027593 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b32e65ff-4169-4d77-8ef7-4fce41c9638c admin admin] The token cache is being invalidate because project 24d869cf0e094051a2cd37fb8391480b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:58:34.027877 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b32e65ff-4169-4d77-8ef7-4fce41c9638c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:34.028542 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b32e65ff-4169-4d77-8ef7-4fce41c9638c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:58:34.030125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1407/2817] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:58:33 2022] DELETE /identity/v3/projects/24d869cf0e094051a2cd37fb8391480b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:34.035267 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61908e-7ccc-441d-950c-6c1856b9b66a None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.035733 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61908e-7ccc-441d-950c-6c1856b9b66a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.035857 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61908e-7ccc-441d-950c-6c1856b9b66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.055550 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ba61908e-7ccc-441d-950c-6c1856b9b66a None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:34.057216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ba61908e-7ccc-441d-950c-6c1856b9b66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:34.074450 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:34.116530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1411/2818] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:34.126177 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496301c-c93a-4799-b8d3-d573e3c939d1 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.126489 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496301c-c93a-4799-b8d3-d573e3c939d1 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.126769 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496301c-c93a-4799-b8d3-d573e3c939d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.147711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-3496301c-c93a-4799-b8d3-d573e3c939d1 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:34.148959 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3496301c-c93a-4799-b8d3-d573e3c939d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:34.156776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1408/2819] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:34.161045 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61908e-7ccc-441d-950c-6c1856b9b66a None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.170593 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61908e-7ccc-441d-950c-6c1856b9b66a None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.175173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc514d-3374-4fe5-80c1-1fb73703e238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.176019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc514d-3374-4fe5-80c1-1fb73703e238 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.176328 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc514d-3374-4fe5-80c1-1fb73703e238 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.176596 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc514d-3374-4fe5-80c1-1fb73703e238 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.177230 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc514d-3374-4fe5-80c1-1fb73703e238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:58:34.177526 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc514d-3374-4fe5-80c1-1fb73703e238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.179140 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc514d-3374-4fe5-80c1-1fb73703e238 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.192675 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1412/2820] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:58:34.197808 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496301c-c93a-4799-b8d3-d573e3c939d1 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.207004 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496301c-c93a-4799-b8d3-d573e3c939d1 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.211608 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d6e52-0871-45dc-b260-fd65a470899e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.212240 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d6e52-0871-45dc-b260-fd65a470899e admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.212526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d6e52-0871-45dc-b260-fd65a470899e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.212800 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d6e52-0871-45dc-b260-fd65a470899e admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.213462 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d6e52-0871-45dc-b260-fd65a470899e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.215548 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d6e52-0871-45dc-b260-fd65a470899e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.291673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1409/2821] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:34 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:34.295959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc514d-3374-4fe5-80c1-1fb73703e238 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.307429 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc514d-3374-4fe5-80c1-1fb73703e238 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.363113 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928ea5c-a0f5-4bc6-9a50-8f2a483c0697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.363704 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928ea5c-a0f5-4bc6-9a50-8f2a483c0697 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.363980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928ea5c-a0f5-4bc6-9a50-8f2a483c0697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.364282 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928ea5c-a0f5-4bc6-9a50-8f2a483c0697 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.365019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928ea5c-a0f5-4bc6-9a50-8f2a483c0697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.366945 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928ea5c-a0f5-4bc6-9a50-8f2a483c0697 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.450240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1413/2822] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:34 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:34.454290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d6e52-0871-45dc-b260-fd65a470899e admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.464460 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d6e52-0871-45dc-b260-fd65a470899e admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.469022 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cada4-af87-402b-af8d-02bd7b91b6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.469612 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cada4-af87-402b-af8d-02bd7b91b6dd admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.469888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cada4-af87-402b-af8d-02bd7b91b6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.470156 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cada4-af87-402b-af8d-02bd7b91b6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.470793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cada4-af87-402b-af8d-02bd7b91b6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.472417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cada4-af87-402b-af8d-02bd7b91b6dd admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.483138 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1410/2823] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:34.487242 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928ea5c-a0f5-4bc6-9a50-8f2a483c0697 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.497849 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928ea5c-a0f5-4bc6-9a50-8f2a483c0697 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.502482 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e2da2-feb9-4649-ae6b-78117dd1060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.503072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e2da2-feb9-4649-ae6b-78117dd1060f admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.503353 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e2da2-feb9-4649-ae6b-78117dd1060f admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.503627 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e2da2-feb9-4649-ae6b-78117dd1060f admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.504301 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e2da2-feb9-4649-ae6b-78117dd1060f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.505890 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e2da2-feb9-4649-ae6b-78117dd1060f admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.516305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1414/2824] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:34.520356 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cada4-af87-402b-af8d-02bd7b91b6dd admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.530080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cada4-af87-402b-af8d-02bd7b91b6dd admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.534542 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456aac2-abfc-42e6-b636-30a91b84ce02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.535245 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456aac2-abfc-42e6-b636-30a91b84ce02 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.535517 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456aac2-abfc-42e6-b636-30a91b84ce02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.535785 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456aac2-abfc-42e6-b636-30a91b84ce02 admin admin] PATH_INFO: `/v3/projects/9f25fbce60b747c0824e2dd27e28c319/users/3f9f59a9d513466cade5740873df518e/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.550876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456aac2-abfc-42e6-b636-30a91b84ce02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f25fbce60b747c0824e2dd27e28c319, user_id=3f9f59a9d513466cade5740873df518e, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.553595 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456aac2-abfc-42e6-b636-30a91b84ce02 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.685215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1411/2825] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:34 2022] PUT /identity/v3/projects/9f25fbce60b747c0824e2dd27e28c319/users/3f9f59a9d513466cade5740873df518e/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:34.690276 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36f6b4-34f5-4309-9ca4-2de69a59d43f None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.690568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36f6b4-34f5-4309-9ca4-2de69a59d43f None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.690847 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36f6b4-34f5-4309-9ca4-2de69a59d43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.709589 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-8c36f6b4-34f5-4309-9ca4-2de69a59d43f None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:34.710794 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-8c36f6b4-34f5-4309-9ca4-2de69a59d43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:34.768308 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1415/2826] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:34.778426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456aac2-abfc-42e6-b636-30a91b84ce02 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:34.780173 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-5456aac2-abfc-42e6-b636-30a91b84ce02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:34.803570 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:34.838071 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456aac2-abfc-42e6-b636-30a91b84ce02 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:34.842635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f1206-9ac0-40ca-9e3d-ff4f31566f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:34.842635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f1206-9ac0-40ca-9e3d-ff4f31566f18 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:34.842635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f1206-9ac0-40ca-9e3d-ff4f31566f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:34.842972 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f1206-9ac0-40ca-9e3d-ff4f31566f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:34.851780 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f1206-9ac0-40ca-9e3d-ff4f31566f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:34.853832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f1206-9ac0-40ca-9e3d-ff4f31566f18 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:34.863258 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1412/2827] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:39.945074 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fd753-f202-4406-8785-17d2664a38d6 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:39.945653 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fd753-f202-4406-8785-17d2664a38d6 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:39.945653 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fd753-f202-4406-8785-17d2664a38d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:39.977085 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-c84fd753-f202-4406-8785-17d2664a38d6 None None] MFA Rules not processed for user `3f9f59a9d513466cade5740873df518e`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:39.979114 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-c84fd753-f202-4406-8785-17d2664a38d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:39.999399 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:40.061832 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1416/2828] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:40.066537 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f1206-9ac0-40ca-9e3d-ff4f31566f18 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:40.077480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f1206-9ac0-40ca-9e3d-ff4f31566f18 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:40.082174 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afb221-82ed-4e34-a67a-9ba8a28c5858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:40.082777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afb221-82ed-4e34-a67a-9ba8a28c5858 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:40.083056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afb221-82ed-4e34-a67a-9ba8a28c5858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:40.084403 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afb221-82ed-4e34-a67a-9ba8a28c5858 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:40.084403 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afb221-82ed-4e34-a67a-9ba8a28c5858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:40.085899 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afb221-82ed-4e34-a67a-9ba8a28c5858 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:40.167818 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1413/2829] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:58:40 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:58:40.171803 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fd753-f202-4406-8785-17d2664a38d6 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:40.183361 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fd753-f202-4406-8785-17d2664a38d6 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:40.257652 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34670d-958c-487c-af66-4a3e3d0c35ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:40.258359 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34670d-958c-487c-af66-4a3e3d0c35ac admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:40.259193 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34670d-958c-487c-af66-4a3e3d0c35ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:40.259557 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34670d-958c-487c-af66-4a3e3d0c35ac admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:40.260302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34670d-958c-487c-af66-4a3e3d0c35ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:40.262385 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34670d-958c-487c-af66-4a3e3d0c35ac admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:40.359991 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1417/2830] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:58:40 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:58:40.363744 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afb221-82ed-4e34-a67a-9ba8a28c5858 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:40.374637 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afb221-82ed-4e34-a67a-9ba8a28c5858 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:40.384238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e555f3f-58bc-42c6-963c-b8fed61abd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:40.384878 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e555f3f-58bc-42c6-963c-b8fed61abd73 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:40.385163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e555f3f-58bc-42c6-963c-b8fed61abd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:40.385436 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e555f3f-58bc-42c6-963c-b8fed61abd73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:40.386098 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e555f3f-58bc-42c6-963c-b8fed61abd73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:40.388282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e555f3f-58bc-42c6-963c-b8fed61abd73 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:40.400951 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1414/2831] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:40.406103 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34670d-958c-487c-af66-4a3e3d0c35ac admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:40.417152 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34670d-958c-487c-af66-4a3e3d0c35ac admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:40.426214 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc8210-b001-48b6-a713-34b7340c03c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:40.426895 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc8210-b001-48b6-a713-34b7340c03c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:40.427179 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc8210-b001-48b6-a713-34b7340c03c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:40.427457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc8210-b001-48b6-a713-34b7340c03c7 admin admin] PATH_INFO: `/v3/projects/82015855261144c8aa428dafc1f8ad8a/users/c8de3650e0d449ec9369d5299e613dd2/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:40.442692 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc8210-b001-48b6-a713-34b7340c03c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82015855261144c8aa428dafc1f8ad8a, user_id=c8de3650e0d449ec9369d5299e613dd2, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:40.445468 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc8210-b001-48b6-a713-34b7340c03c7 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:40.514666 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1418/2832] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:40 2022] PUT /identity/v3/projects/82015855261144c8aa428dafc1f8ad8a/users/c8de3650e0d449ec9369d5299e613dd2/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:58:40.518621 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e555f3f-58bc-42c6-963c-b8fed61abd73 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:40.530908 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e555f3f-58bc-42c6-963c-b8fed61abd73 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:40.589897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36171b01-58ea-402d-87d9-ec0c3642cfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:40.590387 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36171b01-58ea-402d-87d9-ec0c3642cfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:40.590667 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36171b01-58ea-402d-87d9-ec0c3642cfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:40.590942 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36171b01-58ea-402d-87d9-ec0c3642cfd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:40.591614 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36171b01-58ea-402d-87d9-ec0c3642cfd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:40.593269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36171b01-58ea-402d-87d9-ec0c3642cfd7 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:40.604635 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1415/2833] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:58:40.610631 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc8210-b001-48b6-a713-34b7340c03c7 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:40.622025 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc8210-b001-48b6-a713-34b7340c03c7 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:40.626703 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be5d90-1a98-4670-a438-9465d3e2867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:40.627364 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be5d90-1a98-4670-a438-9465d3e2867c admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:40.627649 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be5d90-1a98-4670-a438-9465d3e2867c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:40.627924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be5d90-1a98-4670-a438-9465d3e2867c admin admin] PATH_INFO: `/v3/projects/82015855261144c8aa428dafc1f8ad8a/users/c8de3650e0d449ec9369d5299e613dd2/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:40.629882 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be5d90-1a98-4670-a438-9465d3e2867c admin admin] RBAC: Authorizing `identity:create_grant(project_id=82015855261144c8aa428dafc1f8ad8a, user_id=c8de3650e0d449ec9369d5299e613dd2, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:40.632553 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be5d90-1a98-4670-a438-9465d3e2867c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:40.643213 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1419/2834] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:58:40 2022] PUT /identity/v3/projects/82015855261144c8aa428dafc1f8ad8a/users/c8de3650e0d449ec9369d5299e613dd2/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:58:45.966628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437eef0-7fc1-4d09-b396-ea03b74f0abb None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:45.967191 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437eef0-7fc1-4d09-b396-ea03b74f0abb None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:45.967417 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437eef0-7fc1-4d09-b396-ea03b74f0abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:46.000641 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-8437eef0-7fc1-4d09-b396-ea03b74f0abb None None] MFA Rules not processed for user `c8de3650e0d449ec9369d5299e613dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:46.001896 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-8437eef0-7fc1-4d09-b396-ea03b74f0abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:46.098271 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1416/2835] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:46.114415 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be5d90-1a98-4670-a438-9465d3e2867c admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:46.116226 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-40be5d90-1a98-4670-a438-9465d3e2867c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:46.184452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be5d90-1a98-4670-a438-9465d3e2867c admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:46.188268 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791387df-fc4f-473e-9d46-463a8c908d24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7d8a79945a4e73839cd2ad995e016b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:46.188787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791387df-fc4f-473e-9d46-463a8c908d24 service glance] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:46.195394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791387df-fc4f-473e-9d46-463a8c908d24 service glance] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:46.195394 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791387df-fc4f-473e-9d46-463a8c908d24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:46.226044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:46.255731 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791387df-fc4f-473e-9d46-463a8c908d24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:46.258959 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791387df-fc4f-473e-9d46-463a8c908d24 service glance] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:46.268262 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1420/2836] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:46.508006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7a713-baf2-4426-80d6-71dcbe4157a4 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:46.509154 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7a713-baf2-4426-80d6-71dcbe4157a4 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:46.517144 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7a713-baf2-4426-80d6-71dcbe4157a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:46.538282 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:46.553139 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-84f7a713-baf2-4426-80d6-71dcbe4157a4 None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:46.554493 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-84f7a713-baf2-4426-80d6-71dcbe4157a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:46.662285 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1417/2837] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 29 22:58:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:58:46.786156 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791387df-fc4f-473e-9d46-463a8c908d24 service glance] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:46.787637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-791387df-fc4f-473e-9d46-463a8c908d24 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:46.863096 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791387df-fc4f-473e-9d46-463a8c908d24 service glance] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:46.868831 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d51a46-e66a-4d46-8f99-c45c54a580d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:46.869452 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d51a46-e66a-4d46-8f99-c45c54a580d7 service swift] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:46.869732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d51a46-e66a-4d46-8f99-c45c54a580d7 service swift] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:46.870006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d51a46-e66a-4d46-8f99-c45c54a580d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:46.878878 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d51a46-e66a-4d46-8f99-c45c54a580d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:46.880538 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d51a46-e66a-4d46-8f99-c45c54a580d7 service swift] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:46.889599 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1421/2838] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:58:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:58:56.654514 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=27 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:56.886025 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=48 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:57.037452 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33486d-6f0d-48ff-b4ea-dcbdf28601c2 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:57.037739 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33486d-6f0d-48ff-b4ea-dcbdf28601c2 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:57.038010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33486d-6f0d-48ff-b4ea-dcbdf28601c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:57.057056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-6e33486d-6f0d-48ff-b4ea-dcbdf28601c2 None None] MFA Rules not processed for user `3f9f59a9d513466cade5740873df518e`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:58:57.058239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6e33486d-6f0d-48ff-b4ea-dcbdf28601c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:57.064974 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1418/2839] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:58:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:00.990443 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958cd79-24ff-4c3a-8843-9af128f6d817 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:00.990865 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958cd79-24ff-4c3a-8843-9af128f6d817 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:00.991057 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958cd79-24ff-4c3a-8843-9af128f6d817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:01.013038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-0958cd79-24ff-4c3a-8843-9af128f6d817 None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:01.014271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-0958cd79-24ff-4c3a-8843-9af128f6d817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:01.022131 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1422/2840] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 29 22:59:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:01.034935 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33486d-6f0d-48ff-b4ea-dcbdf28601c2 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:01.047796 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33486d-6f0d-48ff-b4ea-dcbdf28601c2 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:01.071638 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cf3a8-9bbe-4e38-8107-0819ab2d85db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:01.072330 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cf3a8-9bbe-4e38-8107-0819ab2d85db service swift] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:01.072628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cf3a8-9bbe-4e38-8107-0819ab2d85db service swift] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:01.072911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cf3a8-9bbe-4e38-8107-0819ab2d85db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:01.082640 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cf3a8-9bbe-4e38-8107-0819ab2d85db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:01.089314 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cf3a8-9bbe-4e38-8107-0819ab2d85db service swift] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:01.097384 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1419/2841] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 22:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:59:11.005971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:11.091283 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=9 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:25.822491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958cd79-24ff-4c3a-8843-9af128f6d817 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:25.885845 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958cd79-24ff-4c3a-8843-9af128f6d817 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:25.890711 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4bcb9-774a-4734-b587-41bc7bb76083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:25.891343 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4bcb9-774a-4734-b587-41bc7bb76083 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:25.891622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4bcb9-774a-4734-b587-41bc7bb76083 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:25.891893 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4bcb9-774a-4734-b587-41bc7bb76083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:25.901280 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4bcb9-774a-4734-b587-41bc7bb76083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:25.903297 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4bcb9-774a-4734-b587-41bc7bb76083 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:25.913273 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1423/2842] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:27.429130 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cf3a8-9bbe-4e38-8107-0819ab2d85db service swift] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:27.430092 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-189cf3a8-9bbe-4e38-8107-0819ab2d85db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:27.498705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cf3a8-9bbe-4e38-8107-0819ab2d85db service swift] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:27.503296 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a55f6e-d38a-4e28-9f1b-fb96f344c09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:27.503932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a55f6e-d38a-4e28-9f1b-fb96f344c09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:27.504254 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a55f6e-d38a-4e28-9f1b-fb96f344c09b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:27.504536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a55f6e-d38a-4e28-9f1b-fb96f344c09b admin admin] PATH_INFO: `/v3/users/1d73958b5e2d43ecad929b9720889cfe` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:27.505670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a55f6e-d38a-4e28-9f1b-fb96f344c09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d73958b5e2d43ecad929b9720889cfe)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:27.507633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a55f6e-d38a-4e28-9f1b-fb96f344c09b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:27.683051 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c0a55f6e-d38a-4e28-9f1b-fb96f344c09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d73958b5e2d43ecad929b9720889cfe'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:27.696698 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c0a55f6e-d38a-4e28-9f1b-fb96f344c09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d73958b5e2d43ecad929b9720889cfe'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:27.747724 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c0a55f6e-d38a-4e28-9f1b-fb96f344c09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d73958b5e2d43ecad929b9720889cfe'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:27.748304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c0a55f6e-d38a-4e28-9f1b-fb96f344c09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d73958b5e2d43ecad929b9720889cfe'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:27.748911 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c0a55f6e-d38a-4e28-9f1b-fb96f344c09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d73958b5e2d43ecad929b9720889cfe'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:27.761960 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1420/2843] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:27 2022] DELETE /identity/v3/users/1d73958b5e2d43ecad929b9720889cfe => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:28.109298 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4bcb9-774a-4734-b587-41bc7bb76083 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:28.115442 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4bcb9-774a-4734-b587-41bc7bb76083 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:28.188787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b0ef9-ce69-4b25-ad4a-fcdf6e6c6507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:28.190037 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b0ef9-ce69-4b25-ad4a-fcdf6e6c6507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:28.190815 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b0ef9-ce69-4b25-ad4a-fcdf6e6c6507 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:28.191243 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b0ef9-ce69-4b25-ad4a-fcdf6e6c6507 admin admin] PATH_INFO: `/v3/projects/2593bbcc161e4c24ad6e7ef0094b67e7` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:28.193041 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b0ef9-ce69-4b25-ad4a-fcdf6e6c6507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2593bbcc161e4c24ad6e7ef0094b67e7)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:28.195658 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b0ef9-ce69-4b25-ad4a-fcdf6e6c6507 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:28.364793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-860b0ef9-ce69-4b25-ad4a-fcdf6e6c6507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2593bbcc161e4c24ad6e7ef0094b67e7', 'request_id': 'req-860b0ef9-ce69-4b25-ad4a-fcdf6e6c6507'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:28.374057 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-860b0ef9-ce69-4b25-ad4a-fcdf6e6c6507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2593bbcc161e4c24ad6e7ef0094b67e7', 'request_id': 'req-860b0ef9-ce69-4b25-ad4a-fcdf6e6c6507'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:28.490054 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-860b0ef9-ce69-4b25-ad4a-fcdf6e6c6507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2593bbcc161e4c24ad6e7ef0094b67e7', 'request_id': 'req-860b0ef9-ce69-4b25-ad4a-fcdf6e6c6507'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:28.501555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-860b0ef9-ce69-4b25-ad4a-fcdf6e6c6507 admin admin] The token cache is being invalidate because project 2593bbcc161e4c24ad6e7ef0094b67e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:28.501848 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-860b0ef9-ce69-4b25-ad4a-fcdf6e6c6507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:28.502502 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-860b0ef9-ce69-4b25-ad4a-fcdf6e6c6507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:28.503995 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1424/2844] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:28 2022] DELETE /identity/v3/projects/2593bbcc161e4c24ad6e7ef0094b67e7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:28.512649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c886deb-79a8-4609-b1b1-f04a7c5eefa9 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:28.513169 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c886deb-79a8-4609-b1b1-f04a7c5eefa9 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:28.513957 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c886deb-79a8-4609-b1b1-f04a7c5eefa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:28.536785 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-0c886deb-79a8-4609-b1b1-f04a7c5eefa9 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:28.538249 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-0c886deb-79a8-4609-b1b1-f04a7c5eefa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:28.609610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1421/2845] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:59:28.620000 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f68e4-3778-46f0-8567-87eb952e1531 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:28.620334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f68e4-3778-46f0-8567-87eb952e1531 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:28.620726 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f68e4-3778-46f0-8567-87eb952e1531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:28.645687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-532f68e4-3778-46f0-8567-87eb952e1531 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:28.646920 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-532f68e4-3778-46f0-8567-87eb952e1531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:28.655828 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1425/2846] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:28.660137 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c886deb-79a8-4609-b1b1-f04a7c5eefa9 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:28.670984 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c886deb-79a8-4609-b1b1-f04a7c5eefa9 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:28.675645 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af7a2b-c517-4731-a837-cf34055418f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:28.676536 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af7a2b-c517-4731-a837-cf34055418f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:28.676813 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af7a2b-c517-4731-a837-cf34055418f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:28.677108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af7a2b-c517-4731-a837-cf34055418f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:28.677755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af7a2b-c517-4731-a837-cf34055418f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:59:28.678093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af7a2b-c517-4731-a837-cf34055418f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:28.679670 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af7a2b-c517-4731-a837-cf34055418f0 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:28.698139 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1422/2847] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:59:28.701274 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f68e4-3778-46f0-8567-87eb952e1531 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:28.711306 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f68e4-3778-46f0-8567-87eb952e1531 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:28.716874 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf222196-d5b2-4d88-bf91-b4b6470741f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:28.717515 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf222196-d5b2-4d88-bf91-b4b6470741f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:28.717780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf222196-d5b2-4d88-bf91-b4b6470741f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:28.718104 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf222196-d5b2-4d88-bf91-b4b6470741f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:28.718790 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf222196-d5b2-4d88-bf91-b4b6470741f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:28.720792 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf222196-d5b2-4d88-bf91-b4b6470741f6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:28.829742 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1426/2848] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:28 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:59:28.834059 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af7a2b-c517-4731-a837-cf34055418f0 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:28.845917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af7a2b-c517-4731-a837-cf34055418f0 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:28.853946 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:28.914568 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912b036-bb0a-4024-bc20-020f0c3ec4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:28.915742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912b036-bb0a-4024-bc20-020f0c3ec4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:28.915742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912b036-bb0a-4024-bc20-020f0c3ec4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:28.915742 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912b036-bb0a-4024-bc20-020f0c3ec4f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:28.916427 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912b036-bb0a-4024-bc20-020f0c3ec4f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:28.918916 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912b036-bb0a-4024-bc20-020f0c3ec4f3 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:29.004524 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1423/2849] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:28 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:29.008770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf222196-d5b2-4d88-bf91-b4b6470741f6 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:29.016133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:29.020002 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf222196-d5b2-4d88-bf91-b4b6470741f6 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:29.024689 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c38b55-3572-4242-b6b2-f64d8b0706af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:29.025281 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c38b55-3572-4242-b6b2-f64d8b0706af admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:29.025568 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c38b55-3572-4242-b6b2-f64d8b0706af admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:29.025844 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c38b55-3572-4242-b6b2-f64d8b0706af admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:29.026485 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c38b55-3572-4242-b6b2-f64d8b0706af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:29.028818 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c38b55-3572-4242-b6b2-f64d8b0706af admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:29.038809 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1427/2850] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:29.049872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912b036-bb0a-4024-bc20-020f0c3ec4f3 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:29.060060 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912b036-bb0a-4024-bc20-020f0c3ec4f3 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:29.064656 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ca10d-6909-44e9-8323-5a3979b5eec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:29.065259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ca10d-6909-44e9-8323-5a3979b5eec6 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:29.065543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ca10d-6909-44e9-8323-5a3979b5eec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:29.066029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ca10d-6909-44e9-8323-5a3979b5eec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:29.066841 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ca10d-6909-44e9-8323-5a3979b5eec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:29.069074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ca10d-6909-44e9-8323-5a3979b5eec6 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:29.080637 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1424/2851] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:29.084738 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c38b55-3572-4242-b6b2-f64d8b0706af admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:29.100222 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c38b55-3572-4242-b6b2-f64d8b0706af admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:29.100724 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0195b5b-cd83-4828-a879-f840adc7e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:29.101402 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0195b5b-cd83-4828-a879-f840adc7e2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:29.101684 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0195b5b-cd83-4828-a879-f840adc7e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:29.101962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0195b5b-cd83-4828-a879-f840adc7e2c1 admin admin] PATH_INFO: `/v3/projects/f03a1c3352af459fb0f6d7916f2364f1/users/89f421eeab694633a55a6c206908ef3e/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:29.118953 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0195b5b-cd83-4828-a879-f840adc7e2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03a1c3352af459fb0f6d7916f2364f1, user_id=89f421eeab694633a55a6c206908ef3e, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:29.122987 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0195b5b-cd83-4828-a879-f840adc7e2c1 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:29.216324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1428/2852] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:29 2022] PUT /identity/v3/projects/f03a1c3352af459fb0f6d7916f2364f1/users/89f421eeab694633a55a6c206908ef3e/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:29.227445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99741cb-fa53-4028-ae20-55f3d9f51bb7 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:29.227745 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99741cb-fa53-4028-ae20-55f3d9f51bb7 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:29.228008 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99741cb-fa53-4028-ae20-55f3d9f51bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:29.257587 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-c99741cb-fa53-4028-ae20-55f3d9f51bb7 None None] MFA Rules not processed for user `89f421eeab694633a55a6c206908ef3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:29.259086 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-c99741cb-fa53-4028-ae20-55f3d9f51bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:29.322703 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1425/2853] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:29.334713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0195b5b-cd83-4828-a879-f840adc7e2c1 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:29.336688 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d0195b5b-cd83-4828-a879-f840adc7e2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:29.431899 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0195b5b-cd83-4828-a879-f840adc7e2c1 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:29.438308 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fced15-3769-4132-8429-9c6c50e60077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:29.438928 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fced15-3769-4132-8429-9c6c50e60077 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:29.439208 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fced15-3769-4132-8429-9c6c50e60077 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:29.439481 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fced15-3769-4132-8429-9c6c50e60077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:29.447530 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fced15-3769-4132-8429-9c6c50e60077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:29.449854 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fced15-3769-4132-8429-9c6c50e60077 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:29.459141 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1429/2854] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:35.726904 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99741cb-fa53-4028-ae20-55f3d9f51bb7 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:35.787346 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99741cb-fa53-4028-ae20-55f3d9f51bb7 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:35.791889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe23b64-eb7f-4924-8e2d-424ae0e70d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:35.792550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23b64-eb7f-4924-8e2d-424ae0e70d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:35.792836 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23b64-eb7f-4924-8e2d-424ae0e70d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:35.793603 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23b64-eb7f-4924-8e2d-424ae0e70d22 admin admin] PATH_INFO: `/v3/users/89f421eeab694633a55a6c206908ef3e` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:35.794786 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe23b64-eb7f-4924-8e2d-424ae0e70d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f421eeab694633a55a6c206908ef3e)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:35.796736 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe23b64-eb7f-4924-8e2d-424ae0e70d22 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:35.813300 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:35.948969 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dfe23b64-eb7f-4924-8e2d-424ae0e70d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f421eeab694633a55a6c206908ef3e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:35.960829 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dfe23b64-eb7f-4924-8e2d-424ae0e70d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f421eeab694633a55a6c206908ef3e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:36.026649 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dfe23b64-eb7f-4924-8e2d-424ae0e70d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f421eeab694633a55a6c206908ef3e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:36.027773 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dfe23b64-eb7f-4924-8e2d-424ae0e70d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f421eeab694633a55a6c206908ef3e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:36.028399 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-dfe23b64-eb7f-4924-8e2d-424ae0e70d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f421eeab694633a55a6c206908ef3e'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:36.040591 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1426/2855] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:35 2022] DELETE /identity/v3/users/89f421eeab694633a55a6c206908ef3e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:36.045852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6d9c8-9fb8-400c-bfd0-dbcfed8ad056 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:36.046425 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6d9c8-9fb8-400c-bfd0-dbcfed8ad056 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:36.046541 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6d9c8-9fb8-400c-bfd0-dbcfed8ad056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:36.065990 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-4bc6d9c8-9fb8-400c-bfd0-dbcfed8ad056 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:36.067194 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4bc6d9c8-9fb8-400c-bfd0-dbcfed8ad056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:36.130605 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1430/2856] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:36.140619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe23b64-eb7f-4924-8e2d-424ae0e70d22 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:36.142064 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-dfe23b64-eb7f-4924-8e2d-424ae0e70d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:36.199582 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe23b64-eb7f-4924-8e2d-424ae0e70d22 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:36.203216 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527d251-ff67-4c9c-bb75-bb8f0733b8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:36.203826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d251-ff67-4c9c-bb75-bb8f0733b8ee service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:36.204129 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d251-ff67-4c9c-bb75-bb8f0733b8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:36.204416 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d251-ff67-4c9c-bb75-bb8f0733b8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:36.213461 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527d251-ff67-4c9c-bb75-bb8f0733b8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:36.215596 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527d251-ff67-4c9c-bb75-bb8f0733b8ee service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:36.225068 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1427/2857] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:36.640661 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6d9c8-9fb8-400c-bfd0-dbcfed8ad056 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:36.642170 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-4bc6d9c8-9fb8-400c-bfd0-dbcfed8ad056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:36.657016 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6d9c8-9fb8-400c-bfd0-dbcfed8ad056 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:36.669602 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7dc46-5812-4acd-bc65-723d7c4c64aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:36.670286 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7dc46-5812-4acd-bc65-723d7c4c64aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:36.670572 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7dc46-5812-4acd-bc65-723d7c4c64aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:36.670855 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7dc46-5812-4acd-bc65-723d7c4c64aa admin admin] PATH_INFO: `/v3/projects/f03a1c3352af459fb0f6d7916f2364f1` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:36.672967 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7dc46-5812-4acd-bc65-723d7c4c64aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f03a1c3352af459fb0f6d7916f2364f1)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:36.674239 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7dc46-5812-4acd-bc65-723d7c4c64aa admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:36.769980 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:36.782291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8f7dc46-5812-4acd-bc65-723d7c4c64aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03a1c3352af459fb0f6d7916f2364f1', 'request_id': 'req-a8f7dc46-5812-4acd-bc65-723d7c4c64aa'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:36.788507 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8f7dc46-5812-4acd-bc65-723d7c4c64aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03a1c3352af459fb0f6d7916f2364f1', 'request_id': 'req-a8f7dc46-5812-4acd-bc65-723d7c4c64aa'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:36.871863 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8f7dc46-5812-4acd-bc65-723d7c4c64aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03a1c3352af459fb0f6d7916f2364f1', 'request_id': 'req-a8f7dc46-5812-4acd-bc65-723d7c4c64aa'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:36.882601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8f7dc46-5812-4acd-bc65-723d7c4c64aa admin admin] The token cache is being invalidate because project f03a1c3352af459fb0f6d7916f2364f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:36.883135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8f7dc46-5812-4acd-bc65-723d7c4c64aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:36.884260 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a8f7dc46-5812-4acd-bc65-723d7c4c64aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:36.885962 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1431/2858] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:36 2022] DELETE /identity/v3/projects/f03a1c3352af459fb0f6d7916f2364f1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:36.891574 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432af14f-c1f2-4b24-8276-2465b788d3e0 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:36.892061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432af14f-c1f2-4b24-8276-2465b788d3e0 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:36.892217 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432af14f-c1f2-4b24-8276-2465b788d3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:36.911407 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-432af14f-c1f2-4b24-8276-2465b788d3e0 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:36.912644 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-432af14f-c1f2-4b24-8276-2465b788d3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:36.972025 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1428/2859] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:36.980072 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56d5d-e40f-4015-848e-9d5020db73f1 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:36.980388 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56d5d-e40f-4015-848e-9d5020db73f1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:36.982025 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56d5d-e40f-4015-848e-9d5020db73f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:37.002793 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-80e56d5d-e40f-4015-848e-9d5020db73f1 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:37.003986 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-80e56d5d-e40f-4015-848e-9d5020db73f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:37.013717 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1432/2860] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:37.019634 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432af14f-c1f2-4b24-8276-2465b788d3e0 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:37.036373 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432af14f-c1f2-4b24-8276-2465b788d3e0 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:37.041263 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f625981-ed7d-4d2c-841b-017c013a8e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:37.041881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f625981-ed7d-4d2c-841b-017c013a8e09 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:37.042164 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f625981-ed7d-4d2c-841b-017c013a8e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:37.042444 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f625981-ed7d-4d2c-841b-017c013a8e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:37.043683 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f625981-ed7d-4d2c-841b-017c013a8e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:59:37.044021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f625981-ed7d-4d2c-841b-017c013a8e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:37.045643 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f625981-ed7d-4d2c-841b-017c013a8e09 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:37.057762 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1429/2861] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:59:37.063224 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e56d5d-e40f-4015-848e-9d5020db73f1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:37.073135 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e56d5d-e40f-4015-848e-9d5020db73f1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:37.077828 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b213c56-1228-403e-8d75-71929cbcf71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:37.078419 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b213c56-1228-403e-8d75-71929cbcf71d admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:37.078696 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b213c56-1228-403e-8d75-71929cbcf71d admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:37.078968 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b213c56-1228-403e-8d75-71929cbcf71d admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:37.079603 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b213c56-1228-403e-8d75-71929cbcf71d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:37.081641 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b213c56-1228-403e-8d75-71929cbcf71d admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:37.165091 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1433/2862] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:37 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:37.169575 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f625981-ed7d-4d2c-841b-017c013a8e09 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:37.179861 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f625981-ed7d-4d2c-841b-017c013a8e09 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:37.201274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:37.236055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a1562-0110-4ddd-9b66-fc425cb7bde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:37.236704 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a1562-0110-4ddd-9b66-fc425cb7bde8 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:37.236981 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a1562-0110-4ddd-9b66-fc425cb7bde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:37.237250 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a1562-0110-4ddd-9b66-fc425cb7bde8 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:37.237876 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a1562-0110-4ddd-9b66-fc425cb7bde8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:37.239765 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a1562-0110-4ddd-9b66-fc425cb7bde8 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:37.342074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1430/2863] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:37 2022] POST /identity/v3/users => generated 284 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:59:37.346431 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b213c56-1228-403e-8d75-71929cbcf71d admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:37.356805 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b213c56-1228-403e-8d75-71929cbcf71d admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:37.361478 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84482e5-b397-41fc-8bb5-395629d9f049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:37.362176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84482e5-b397-41fc-8bb5-395629d9f049 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:37.362475 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84482e5-b397-41fc-8bb5-395629d9f049 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:37.362751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84482e5-b397-41fc-8bb5-395629d9f049 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:37.363428 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84482e5-b397-41fc-8bb5-395629d9f049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:37.365068 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84482e5-b397-41fc-8bb5-395629d9f049 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:37.375552 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1434/2864] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:37.379590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a1562-0110-4ddd-9b66-fc425cb7bde8 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:37.390150 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a1562-0110-4ddd-9b66-fc425cb7bde8 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:37.394918 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4c217-293c-48b7-bb27-cc20bf972711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:37.395507 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4c217-293c-48b7-bb27-cc20bf972711 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:37.395793 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4c217-293c-48b7-bb27-cc20bf972711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:37.396069 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4c217-293c-48b7-bb27-cc20bf972711 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:37.396771 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4c217-293c-48b7-bb27-cc20bf972711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:37.398366 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4c217-293c-48b7-bb27-cc20bf972711 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:37.409602 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1431/2865] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:37.413614 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84482e5-b397-41fc-8bb5-395629d9f049 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:37.423646 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84482e5-b397-41fc-8bb5-395629d9f049 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:37.428659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab615fc-f8c5-4448-8d61-d5ae27c75f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:37.429305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab615fc-f8c5-4448-8d61-d5ae27c75f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:37.429578 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab615fc-f8c5-4448-8d61-d5ae27c75f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:37.429851 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab615fc-f8c5-4448-8d61-d5ae27c75f04 admin admin] PATH_INFO: `/v3/projects/cec99334e2c54fa99da9fb769985f137/users/3161fa6a57db4e0089e2833015a892ef/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:37.444417 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab615fc-f8c5-4448-8d61-d5ae27c75f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec99334e2c54fa99da9fb769985f137, user_id=3161fa6a57db4e0089e2833015a892ef, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:37.447061 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab615fc-f8c5-4448-8d61-d5ae27c75f04 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:37.494883 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1435/2866] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:37 2022] PUT /identity/v3/projects/cec99334e2c54fa99da9fb769985f137/users/3161fa6a57db4e0089e2833015a892ef/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:37.511530 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79878538-bfcd-4d09-b999-0a9d6496c730 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:37.512467 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79878538-bfcd-4d09-b999-0a9d6496c730 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:37.512743 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79878538-bfcd-4d09-b999-0a9d6496c730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:37.540445 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-79878538-bfcd-4d09-b999-0a9d6496c730 None None] MFA Rules not processed for user `3161fa6a57db4e0089e2833015a892ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:37.541694 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-79878538-bfcd-4d09-b999-0a9d6496c730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:37.604567 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1432/2867] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:37.609117 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab615fc-f8c5-4448-8d61-d5ae27c75f04 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:37.669555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab615fc-f8c5-4448-8d61-d5ae27c75f04 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:37.674122 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83d1ae-e3e0-4513-9b75-a161dcda4fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:37.674717 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83d1ae-e3e0-4513-9b75-a161dcda4fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:37.674997 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83d1ae-e3e0-4513-9b75-a161dcda4fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:37.675271 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83d1ae-e3e0-4513-9b75-a161dcda4fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:37.676182 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83d1ae-e3e0-4513-9b75-a161dcda4fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:37.678076 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83d1ae-e3e0-4513-9b75-a161dcda4fc6 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:37.765414 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1436/2868] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:37 2022] POST /identity/v3/projects => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:37.769526 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79878538-bfcd-4d09-b999-0a9d6496c730 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:37.780184 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79878538-bfcd-4d09-b999-0a9d6496c730 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:37.836045 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7653c-b105-435a-8ada-c1b1dcfb7fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:37.836680 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7653c-b105-435a-8ada-c1b1dcfb7fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:37.836956 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7653c-b105-435a-8ada-c1b1dcfb7fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:37.837225 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7653c-b105-435a-8ada-c1b1dcfb7fe4 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:37.837852 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7653c-b105-435a-8ada-c1b1dcfb7fe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:37.839788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7653c-b105-435a-8ada-c1b1dcfb7fe4 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:37.911865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1433/2869] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:37 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:37.916161 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83d1ae-e3e0-4513-9b75-a161dcda4fc6 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:37.927255 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83d1ae-e3e0-4513-9b75-a161dcda4fc6 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:37.931871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fff01b-5794-4ad1-aa58-789fa743d829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:37.932494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fff01b-5794-4ad1-aa58-789fa743d829 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:37.932778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fff01b-5794-4ad1-aa58-789fa743d829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:37.933062 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fff01b-5794-4ad1-aa58-789fa743d829 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:37.934342 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fff01b-5794-4ad1-aa58-789fa743d829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:37.935912 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fff01b-5794-4ad1-aa58-789fa743d829 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:37.946302 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1437/2870] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:37.950281 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7653c-b105-435a-8ada-c1b1dcfb7fe4 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:37.960338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7653c-b105-435a-8ada-c1b1dcfb7fe4 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:37.965270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda6885-79bb-424f-a9a0-03dce2109710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:37.965930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda6885-79bb-424f-a9a0-03dce2109710 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:37.966214 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda6885-79bb-424f-a9a0-03dce2109710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:37.966525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda6885-79bb-424f-a9a0-03dce2109710 admin admin] PATH_INFO: `/v3/projects/16b2abf3d0034e4bbbca16f7c20f008c/users/55b6ce8659284c70b2222594dea71329/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:37.981738 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda6885-79bb-424f-a9a0-03dce2109710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16b2abf3d0034e4bbbca16f7c20f008c, user_id=55b6ce8659284c70b2222594dea71329, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:37.984553 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda6885-79bb-424f-a9a0-03dce2109710 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:38.027882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:38.033515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1434/2871] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:37 2022] PUT /identity/v3/projects/16b2abf3d0034e4bbbca16f7c20f008c/users/55b6ce8659284c70b2222594dea71329/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:38.037536 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fff01b-5794-4ad1-aa58-789fa743d829 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:38.048591 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fff01b-5794-4ad1-aa58-789fa743d829 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:38.075383 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:38.105304 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802557fe-de2c-4a08-83a1-d5e181133350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:38.106352 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802557fe-de2c-4a08-83a1-d5e181133350 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:38.106629 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802557fe-de2c-4a08-83a1-d5e181133350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:38.106899 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802557fe-de2c-4a08-83a1-d5e181133350 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:38.107532 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802557fe-de2c-4a08-83a1-d5e181133350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:38.109228 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802557fe-de2c-4a08-83a1-d5e181133350 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:38.119321 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1438/2872] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:38.123857 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda6885-79bb-424f-a9a0-03dce2109710 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:38.134101 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda6885-79bb-424f-a9a0-03dce2109710 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:38.138826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e83ae-1899-44b5-980b-1a7d1bb14758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:38.139470 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e83ae-1899-44b5-980b-1a7d1bb14758 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:38.139838 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e83ae-1899-44b5-980b-1a7d1bb14758 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:38.140142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e83ae-1899-44b5-980b-1a7d1bb14758 admin admin] PATH_INFO: `/v3/projects/16b2abf3d0034e4bbbca16f7c20f008c/users/55b6ce8659284c70b2222594dea71329/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:38.142043 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e83ae-1899-44b5-980b-1a7d1bb14758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16b2abf3d0034e4bbbca16f7c20f008c, user_id=55b6ce8659284c70b2222594dea71329, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:38.144730 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e83ae-1899-44b5-980b-1a7d1bb14758 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:38.155072 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1435/2873] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:38 2022] PUT /identity/v3/projects/16b2abf3d0034e4bbbca16f7c20f008c/users/55b6ce8659284c70b2222594dea71329/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:38.165233 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74e839-f8f0-4b26-8002-349dbf7e86a1 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:38.165555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74e839-f8f0-4b26-8002-349dbf7e86a1 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:38.165834 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74e839-f8f0-4b26-8002-349dbf7e86a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:38.194825 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-ed74e839-f8f0-4b26-8002-349dbf7e86a1 None None] MFA Rules not processed for user `55b6ce8659284c70b2222594dea71329`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:38.196048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ed74e839-f8f0-4b26-8002-349dbf7e86a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:38.263047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1439/2874] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:38.274326 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e83ae-1899-44b5-980b-1a7d1bb14758 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:38.276013 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-be0e83ae-1899-44b5-980b-1a7d1bb14758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:38.334831 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e83ae-1899-44b5-980b-1a7d1bb14758 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:38.338777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882f5e9-18c1-4a7e-bf7c-ef4f969c50a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:38.339387 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f5e9-18c1-4a7e-bf7c-ef4f969c50a4 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:38.339666 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f5e9-18c1-4a7e-bf7c-ef4f969c50a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:38.339962 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f5e9-18c1-4a7e-bf7c-ef4f969c50a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:38.348917 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882f5e9-18c1-4a7e-bf7c-ef4f969c50a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:38.350338 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882f5e9-18c1-4a7e-bf7c-ef4f969c50a4 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:38.359861 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1436/2875] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:38.454111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74e839-f8f0-4b26-8002-349dbf7e86a1 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:38.455490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ed74e839-f8f0-4b26-8002-349dbf7e86a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:38.467924 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74e839-f8f0-4b26-8002-349dbf7e86a1 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:38.471512 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278532a-e26d-457a-8a24-34964b91300c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:38.472128 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278532a-e26d-457a-8a24-34964b91300c service cinder] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:38.472411 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278532a-e26d-457a-8a24-34964b91300c service cinder] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:38.472683 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278532a-e26d-457a-8a24-34964b91300c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:38.529551 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278532a-e26d-457a-8a24-34964b91300c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:38.530994 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278532a-e26d-457a-8a24-34964b91300c service cinder] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:38.540190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1440/2876] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:43.361578 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882f5e9-18c1-4a7e-bf7c-ef4f969c50a4 service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:43.422932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882f5e9-18c1-4a7e-bf7c-ef4f969c50a4 service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:43.427673 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb24561-2d59-406f-a701-ca7d3fb7950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:43.428323 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb24561-2d59-406f-a701-ca7d3fb7950f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:43.428607 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb24561-2d59-406f-a701-ca7d3fb7950f admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:43.428939 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb24561-2d59-406f-a701-ca7d3fb7950f admin admin] PATH_INFO: `/v3/users/3161fa6a57db4e0089e2833015a892ef` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:43.430041 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb24561-2d59-406f-a701-ca7d3fb7950f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3161fa6a57db4e0089e2833015a892ef)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:43.431981 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb24561-2d59-406f-a701-ca7d3fb7950f admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:43.560763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3eb24561-2d59-406f-a701-ca7d3fb7950f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3161fa6a57db4e0089e2833015a892ef'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:43.573238 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3eb24561-2d59-406f-a701-ca7d3fb7950f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3161fa6a57db4e0089e2833015a892ef'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:43.654143 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3eb24561-2d59-406f-a701-ca7d3fb7950f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3161fa6a57db4e0089e2833015a892ef'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:43.654781 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3eb24561-2d59-406f-a701-ca7d3fb7950f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3161fa6a57db4e0089e2833015a892ef'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:43.655393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-3eb24561-2d59-406f-a701-ca7d3fb7950f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3161fa6a57db4e0089e2833015a892ef'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:43.668597 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1437/2877] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:43 2022] DELETE /identity/v3/users/3161fa6a57db4e0089e2833015a892ef => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:43.673119 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a763d-bdff-4b24-ba34-165cc47affdb None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:43.673601 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a763d-bdff-4b24-ba34-165cc47affdb None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:43.673717 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a763d-bdff-4b24-ba34-165cc47affdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:43.693518 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-dc6a763d-bdff-4b24-ba34-165cc47affdb None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:43.694651 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-dc6a763d-bdff-4b24-ba34-165cc47affdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:43.737692 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:43.752902 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1441/2878] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:43.763304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb24561-2d59-406f-a701-ca7d3fb7950f admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:43.764746 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3eb24561-2d59-406f-a701-ca7d3fb7950f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:43.774508 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:43.821628 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb24561-2d59-406f-a701-ca7d3fb7950f admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:43.825858 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd5033-c0b0-41ae-9582-78febd96cdf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:43.826455 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd5033-c0b0-41ae-9582-78febd96cdf2 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:43.826736 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd5033-c0b0-41ae-9582-78febd96cdf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:43.827010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd5033-c0b0-41ae-9582-78febd96cdf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:43.835905 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd5033-c0b0-41ae-9582-78febd96cdf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:43.841249 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd5033-c0b0-41ae-9582-78febd96cdf2 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:43.846721 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1438/2879] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:44.228065 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a763d-bdff-4b24-ba34-165cc47affdb None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:44.233535 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-dc6a763d-bdff-4b24-ba34-165cc47affdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:44.246478 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a763d-bdff-4b24-ba34-165cc47affdb None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:44.251770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5735cb3-bb30-4fb9-8438-01aaed00e45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:44.252438 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5735cb3-bb30-4fb9-8438-01aaed00e45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:44.252713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5735cb3-bb30-4fb9-8438-01aaed00e45d admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:44.253051 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5735cb3-bb30-4fb9-8438-01aaed00e45d admin admin] PATH_INFO: `/v3/projects/cec99334e2c54fa99da9fb769985f137` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:44.254227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5735cb3-bb30-4fb9-8438-01aaed00e45d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec99334e2c54fa99da9fb769985f137)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:44.255999 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5735cb3-bb30-4fb9-8438-01aaed00e45d admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:44.352674 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f5735cb3-bb30-4fb9-8438-01aaed00e45d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec99334e2c54fa99da9fb769985f137', 'request_id': 'req-f5735cb3-bb30-4fb9-8438-01aaed00e45d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:44.359581 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f5735cb3-bb30-4fb9-8438-01aaed00e45d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec99334e2c54fa99da9fb769985f137', 'request_id': 'req-f5735cb3-bb30-4fb9-8438-01aaed00e45d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:44.404036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f5735cb3-bb30-4fb9-8438-01aaed00e45d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec99334e2c54fa99da9fb769985f137', 'request_id': 'req-f5735cb3-bb30-4fb9-8438-01aaed00e45d'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:44.414761 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f5735cb3-bb30-4fb9-8438-01aaed00e45d admin admin] The token cache is being invalidate because project cec99334e2c54fa99da9fb769985f137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:44.419346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f5735cb3-bb30-4fb9-8438-01aaed00e45d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:44.419346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-f5735cb3-bb30-4fb9-8438-01aaed00e45d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:44.419346 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1442/2880] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:44 2022] DELETE /identity/v3/projects/cec99334e2c54fa99da9fb769985f137 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:44.421848 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd5033-c0b0-41ae-9582-78febd96cdf2 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:44.431475 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd5033-c0b0-41ae-9582-78febd96cdf2 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:44.486989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b18677-4415-4f70-915e-f83907e9596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:44.487611 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b18677-4415-4f70-915e-f83907e9596e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:44.487888 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b18677-4415-4f70-915e-f83907e9596e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:44.488257 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b18677-4415-4f70-915e-f83907e9596e admin admin] PATH_INFO: `/v3/users/55b6ce8659284c70b2222594dea71329` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:44.489392 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b18677-4415-4f70-915e-f83907e9596e admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b6ce8659284c70b2222594dea71329)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:44.491315 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b18677-4415-4f70-915e-f83907e9596e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:44.700531 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b0b18677-4415-4f70-915e-f83907e9596e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b6ce8659284c70b2222594dea71329'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:44.712151 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b0b18677-4415-4f70-915e-f83907e9596e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b6ce8659284c70b2222594dea71329'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:44.774794 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b0b18677-4415-4f70-915e-f83907e9596e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b6ce8659284c70b2222594dea71329'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:44.775403 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b0b18677-4415-4f70-915e-f83907e9596e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b6ce8659284c70b2222594dea71329'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:44.776032 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-b0b18677-4415-4f70-915e-f83907e9596e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b6ce8659284c70b2222594dea71329'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:44.789254 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1439/2881] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:44 2022] DELETE /identity/v3/users/55b6ce8659284c70b2222594dea71329 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:45.215884 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5735cb3-bb30-4fb9-8438-01aaed00e45d admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:45.220639 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f5735cb3-bb30-4fb9-8438-01aaed00e45d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:45.232622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5735cb3-bb30-4fb9-8438-01aaed00e45d admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:45.292642 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2679a7a-31b2-4a89-9fa5-292907208555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:45.293270 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2679a7a-31b2-4a89-9fa5-292907208555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:45.293546 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2679a7a-31b2-4a89-9fa5-292907208555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:45.293821 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2679a7a-31b2-4a89-9fa5-292907208555 admin admin] PATH_INFO: `/v3/projects/16b2abf3d0034e4bbbca16f7c20f008c` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:45.294932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2679a7a-31b2-4a89-9fa5-292907208555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16b2abf3d0034e4bbbca16f7c20f008c)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:45.296852 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2679a7a-31b2-4a89-9fa5-292907208555 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:45.388941 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e2679a7a-31b2-4a89-9fa5-292907208555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16b2abf3d0034e4bbbca16f7c20f008c', 'request_id': 'req-e2679a7a-31b2-4a89-9fa5-292907208555'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:45.395620 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e2679a7a-31b2-4a89-9fa5-292907208555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16b2abf3d0034e4bbbca16f7c20f008c', 'request_id': 'req-e2679a7a-31b2-4a89-9fa5-292907208555'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:45.450083 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e2679a7a-31b2-4a89-9fa5-292907208555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16b2abf3d0034e4bbbca16f7c20f008c', 'request_id': 'req-e2679a7a-31b2-4a89-9fa5-292907208555'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:45.461133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e2679a7a-31b2-4a89-9fa5-292907208555 admin admin] The token cache is being invalidate because project 16b2abf3d0034e4bbbca16f7c20f008c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82237) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:45.461348 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e2679a7a-31b2-4a89-9fa5-292907208555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:45.461971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-e2679a7a-31b2-4a89-9fa5-292907208555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:45.463535 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1443/2882] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:45 2022] DELETE /identity/v3/projects/16b2abf3d0034e4bbbca16f7c20f008c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:45.469027 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94481556-8ed3-4277-80e9-fc30cbb6be25 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:45.469516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94481556-8ed3-4277-80e9-fc30cbb6be25 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:45.469627 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94481556-8ed3-4277-80e9-fc30cbb6be25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:45.488839 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-94481556-8ed3-4277-80e9-fc30cbb6be25 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:45.490098 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-94481556-8ed3-4277-80e9-fc30cbb6be25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:45.519816 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:45.557486 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1440/2883] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:45.565893 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2386b81-5603-4088-8c33-a354c2836189 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:45.566181 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2386b81-5603-4088-8c33-a354c2836189 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:45.566461 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2386b81-5603-4088-8c33-a354c2836189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:45.574751 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:45.587833 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-f2386b81-5603-4088-8c33-a354c2836189 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:45.590227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f2386b81-5603-4088-8c33-a354c2836189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:45.598006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1444/2884] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:45.602398 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94481556-8ed3-4277-80e9-fc30cbb6be25 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:45.612529 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94481556-8ed3-4277-80e9-fc30cbb6be25 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:45.617329 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b0688-2473-477c-b83b-71b75a2341c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:45.625668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b0688-2473-477c-b83b-71b75a2341c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:45.625668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b0688-2473-477c-b83b-71b75a2341c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:45.625668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b0688-2473-477c-b83b-71b75a2341c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:45.625668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b0688-2473-477c-b83b-71b75a2341c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82236) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:59:45.625668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b0688-2473-477c-b83b-71b75a2341c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:45.625668 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b0688-2473-477c-b83b-71b75a2341c7 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:45.633025 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1441/2885] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:59:45.638133 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2386b81-5603-4088-8c33-a354c2836189 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:45.647396 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2386b81-5603-4088-8c33-a354c2836189 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:45.653400 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971e0bc-5e4f-4884-8648-b1f74a249330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:45.653548 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971e0bc-5e4f-4884-8648-b1f74a249330 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:45.653871 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971e0bc-5e4f-4884-8648-b1f74a249330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:45.654136 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971e0bc-5e4f-4884-8648-b1f74a249330 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:45.654779 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971e0bc-5e4f-4884-8648-b1f74a249330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:45.656830 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971e0bc-5e4f-4884-8648-b1f74a249330 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:45.731019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1445/2886] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:45 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:45.735155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b0688-2473-477c-b83b-71b75a2341c7 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:45.745234 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b0688-2473-477c-b83b-71b75a2341c7 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:45.802058 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb557627-b202-4681-a73e-b6c0cf9c9616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:45.802661 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb557627-b202-4681-a73e-b6c0cf9c9616 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:45.802941 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb557627-b202-4681-a73e-b6c0cf9c9616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:45.803210 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb557627-b202-4681-a73e-b6c0cf9c9616 admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:45.803845 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb557627-b202-4681-a73e-b6c0cf9c9616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:45.805767 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb557627-b202-4681-a73e-b6c0cf9c9616 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:45.878546 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1442/2887] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:45 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:45.882870 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971e0bc-5e4f-4884-8648-b1f74a249330 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:45.894066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971e0bc-5e4f-4884-8648-b1f74a249330 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:45.898718 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997545c1-4f08-457b-8354-61cb9176b0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:45.899355 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997545c1-4f08-457b-8354-61cb9176b0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:45.899638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997545c1-4f08-457b-8354-61cb9176b0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:45.899914 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997545c1-4f08-457b-8354-61cb9176b0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:45.900622 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997545c1-4f08-457b-8354-61cb9176b0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:45.902240 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997545c1-4f08-457b-8354-61cb9176b0e8 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:45.912427 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1446/2888] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:45.916458 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb557627-b202-4681-a73e-b6c0cf9c9616 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:45.926618 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb557627-b202-4681-a73e-b6c0cf9c9616 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:45.932610 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a235c59-3887-4af0-ae05-3cc40eb60b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:45.933729 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a235c59-3887-4af0-ae05-3cc40eb60b2e admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:45.934005 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a235c59-3887-4af0-ae05-3cc40eb60b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:45.934280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a235c59-3887-4af0-ae05-3cc40eb60b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:45.934921 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a235c59-3887-4af0-ae05-3cc40eb60b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:45.936549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a235c59-3887-4af0-ae05-3cc40eb60b2e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:45.947376 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1443/2889] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:45.952261 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997545c1-4f08-457b-8354-61cb9176b0e8 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:45.962712 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997545c1-4f08-457b-8354-61cb9176b0e8 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:45.967954 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f8f0f-ef38-4a0c-87eb-e3c85baae815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:45.968637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f8f0f-ef38-4a0c-87eb-e3c85baae815 admin admin] REQUEST_METHOD: `PUT` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:45.968922 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f8f0f-ef38-4a0c-87eb-e3c85baae815 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:45.969199 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f8f0f-ef38-4a0c-87eb-e3c85baae815 admin admin] PATH_INFO: `/v3/projects/469517dc3d7c4f05b85c42580932a8b0/users/1a5893e2e9434237a727b31f5564fad0/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:45.984713 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f8f0f-ef38-4a0c-87eb-e3c85baae815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469517dc3d7c4f05b85c42580932a8b0, user_id=1a5893e2e9434237a727b31f5564fad0, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:45.987305 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f8f0f-ef38-4a0c-87eb-e3c85baae815 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:46.061106 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1447/2890] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:45 2022] PUT /identity/v3/projects/469517dc3d7c4f05b85c42580932a8b0/users/1a5893e2e9434237a727b31f5564fad0/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:46.072400 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64eba1-8982-408a-95be-20c29a04896a None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:46.072840 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64eba1-8982-408a-95be-20c29a04896a None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:46.073135 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64eba1-8982-408a-95be-20c29a04896a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:46.101633 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-3e64eba1-8982-408a-95be-20c29a04896a None None] MFA Rules not processed for user `1a5893e2e9434237a727b31f5564fad0`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:46.102865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-3e64eba1-8982-408a-95be-20c29a04896a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:46.169503 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1444/2891] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:46.174048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f8f0f-ef38-4a0c-87eb-e3c85baae815 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:46.238277 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f8f0f-ef38-4a0c-87eb-e3c85baae815 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:46.242916 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdb0a1-d9b4-40f9-a2a3-1e3a961db842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:46.243516 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdb0a1-d9b4-40f9-a2a3-1e3a961db842 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:46.243799 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdb0a1-d9b4-40f9-a2a3-1e3a961db842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:46.244076 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdb0a1-d9b4-40f9-a2a3-1e3a961db842 admin admin] PATH_INFO: `/v3/projects` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:46.244756 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdb0a1-d9b4-40f9-a2a3-1e3a961db842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:46.246797 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdb0a1-d9b4-40f9-a2a3-1e3a961db842 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:46.336373 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1448/2892] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:46 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:46.341170 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64eba1-8982-408a-95be-20c29a04896a None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:46.351925 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64eba1-8982-408a-95be-20c29a04896a None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:46.371409 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:46.407492 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7e381-4871-448c-8f50-820903ada25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:46.408170 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7e381-4871-448c-8f50-820903ada25c admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:46.408659 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7e381-4871-448c-8f50-820903ada25c admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:46.409108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7e381-4871-448c-8f50-820903ada25c admin admin] PATH_INFO: `/v3/users` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:46.410099 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7e381-4871-448c-8f50-820903ada25c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:46.412056 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7e381-4871-448c-8f50-820903ada25c admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:46.523749 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1445/2893] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:46 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:46.527763 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdb0a1-d9b4-40f9-a2a3-1e3a961db842 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:46.538263 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdb0a1-d9b4-40f9-a2a3-1e3a961db842 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:46.542981 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80b333-b897-4338-aa3f-05f7e35cd587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:46.543594 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80b333-b897-4338-aa3f-05f7e35cd587 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:46.543872 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80b333-b897-4338-aa3f-05f7e35cd587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:46.544183 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80b333-b897-4338-aa3f-05f7e35cd587 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:46.544826 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80b333-b897-4338-aa3f-05f7e35cd587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:46.546548 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80b333-b897-4338-aa3f-05f7e35cd587 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:46.557501 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1449/2894] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:46.562068 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7e381-4871-448c-8f50-820903ada25c admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:46.572039 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7e381-4871-448c-8f50-820903ada25c admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:46.577918 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3386f-3f2d-41a2-a9d1-4cd11b1acb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:46.584187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3386f-3f2d-41a2-a9d1-4cd11b1acb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:46.584187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3386f-3f2d-41a2-a9d1-4cd11b1acb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:46.584187 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3386f-3f2d-41a2-a9d1-4cd11b1acb1b admin admin] PATH_INFO: `/v3/projects/d54b47377f554c63865bc303cc35c255/users/4efdd586272847e0b30e8128e245e352/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:46.594359 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3386f-3f2d-41a2-a9d1-4cd11b1acb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54b47377f554c63865bc303cc35c255, user_id=4efdd586272847e0b30e8128e245e352, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:46.597074 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3386f-3f2d-41a2-a9d1-4cd11b1acb1b admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:46.678788 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1446/2895] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:46 2022] PUT /identity/v3/projects/d54b47377f554c63865bc303cc35c255/users/4efdd586272847e0b30e8128e245e352/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:59:46.682977 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80b333-b897-4338-aa3f-05f7e35cd587 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:46.694073 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80b333-b897-4338-aa3f-05f7e35cd587 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:46.752769 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119740fb-067a-495c-872c-d79f2526f776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:46.753371 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119740fb-067a-495c-872c-d79f2526f776 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:46.753650 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119740fb-067a-495c-872c-d79f2526f776 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:46.753922 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119740fb-067a-495c-872c-d79f2526f776 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:46.754555 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119740fb-067a-495c-872c-d79f2526f776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:46.756178 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119740fb-067a-495c-872c-d79f2526f776 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:46.761190 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:46.766723 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1450/2896] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:46.770865 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3386f-3f2d-41a2-a9d1-4cd11b1acb1b admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:46.781133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3386f-3f2d-41a2-a9d1-4cd11b1acb1b admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:46.785617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bee30d-c275-4766-ba61-98b07c5ded1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:46.786274 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bee30d-c275-4766-ba61-98b07c5ded1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:46.786549 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bee30d-c275-4766-ba61-98b07c5ded1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:46.786820 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bee30d-c275-4766-ba61-98b07c5ded1e admin admin] PATH_INFO: `/v3/projects/d54b47377f554c63865bc303cc35c255/users/4efdd586272847e0b30e8128e245e352/roles/a7d59d2982de4bfeb758dce70808029f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:46.788718 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bee30d-c275-4766-ba61-98b07c5ded1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54b47377f554c63865bc303cc35c255, user_id=4efdd586272847e0b30e8128e245e352, role_id=a7d59d2982de4bfeb758dce70808029f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:46.791382 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bee30d-c275-4766-ba61-98b07c5ded1e admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:46.805152 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1447/2897] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:46 2022] PUT /identity/v3/projects/d54b47377f554c63865bc303cc35c255/users/4efdd586272847e0b30e8128e245e352/roles/a7d59d2982de4bfeb758dce70808029f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:46.815999 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e5b15-d7c7-4222-9eb1-a4b8b1603075 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:46.816351 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e5b15-d7c7-4222-9eb1-a4b8b1603075 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:46.816637 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e5b15-d7c7-4222-9eb1-a4b8b1603075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:46.846238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-880e5b15-d7c7-4222-9eb1-a4b8b1603075 None None] MFA Rules not processed for user `4efdd586272847e0b30e8128e245e352`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:46.847456 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-880e5b15-d7c7-4222-9eb1-a4b8b1603075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:46.914687 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1451/2898] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:46.926212 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bee30d-c275-4766-ba61-98b07c5ded1e admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:46.927884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-26bee30d-c275-4766-ba61-98b07c5ded1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:46.984031 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bee30d-c275-4766-ba61-98b07c5ded1e admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:46.987594 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd68a5-1732-49f6-9db7-085b268a3f49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:46.988215 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd68a5-1732-49f6-9db7-085b268a3f49 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:46.988494 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd68a5-1732-49f6-9db7-085b268a3f49 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:46.988765 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd68a5-1732-49f6-9db7-085b268a3f49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:46.998203 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd68a5-1732-49f6-9db7-085b268a3f49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:46.999632 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd68a5-1732-49f6-9db7-085b268a3f49 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:47.009063 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1448/2899] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:48.081294 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e5b15-d7c7-4222-9eb1-a4b8b1603075 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:48.149008 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e5b15-d7c7-4222-9eb1-a4b8b1603075 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:48.154380 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c66db8-8a48-43b8-9368-9a71cb448d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:48.155089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c66db8-8a48-43b8-9368-9a71cb448d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:48.155319 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c66db8-8a48-43b8-9368-9a71cb448d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:48.155596 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c66db8-8a48-43b8-9368-9a71cb448d07 admin admin] PATH_INFO: `/v3/users/1a5893e2e9434237a727b31f5564fad0` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:48.156748 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c66db8-8a48-43b8-9368-9a71cb448d07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5893e2e9434237a727b31f5564fad0)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:48.158702 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c66db8-8a48-43b8-9368-9a71cb448d07 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:48.318938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-46c66db8-8a48-43b8-9368-9a71cb448d07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5893e2e9434237a727b31f5564fad0'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:48.319591 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-46c66db8-8a48-43b8-9368-9a71cb448d07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5893e2e9434237a727b31f5564fad0'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:48.385489 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-46c66db8-8a48-43b8-9368-9a71cb448d07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5893e2e9434237a727b31f5564fad0'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:48.386116 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-46c66db8-8a48-43b8-9368-9a71cb448d07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5893e2e9434237a727b31f5564fad0'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:48.398886 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-46c66db8-8a48-43b8-9368-9a71cb448d07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5893e2e9434237a727b31f5564fad0'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:48.413003 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1452/2900] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:48 2022] DELETE /identity/v3/users/1a5893e2e9434237a727b31f5564fad0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:48.417480 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c1b22-e4c9-46e3-97c1-eba25d415d2d None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:48.417964 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c1b22-e4c9-46e3-97c1-eba25d415d2d None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:48.418081 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c1b22-e4c9-46e3-97c1-eba25d415d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:48.437084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-430c1b22-e4c9-46e3-97c1-eba25d415d2d None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:48.438286 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-430c1b22-e4c9-46e3-97c1-eba25d415d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:48.500893 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1449/2901] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:48.510562 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c66db8-8a48-43b8-9368-9a71cb448d07 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:48.512565 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-46c66db8-8a48-43b8-9368-9a71cb448d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:48.519032 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:48.572173 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c66db8-8a48-43b8-9368-9a71cb448d07 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:48.576615 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c44f-db6c-4abe-bb51-57fc892f3714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:48.577227 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c44f-db6c-4abe-bb51-57fc892f3714 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:48.577508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c44f-db6c-4abe-bb51-57fc892f3714 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:48.577787 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c44f-db6c-4abe-bb51-57fc892f3714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:48.587356 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66c44f-db6c-4abe-bb51-57fc892f3714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:48.590491 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66c44f-db6c-4abe-bb51-57fc892f3714 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:48.600466 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1453/2902] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:49.039815 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c1b22-e4c9-46e3-97c1-eba25d415d2d None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:49.044259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-430c1b22-e4c9-46e3-97c1-eba25d415d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:49.054299 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c1b22-e4c9-46e3-97c1-eba25d415d2d None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:49.058965 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6ab75-437a-4b4d-a592-328d277bcf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:49.060033 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6ab75-437a-4b4d-a592-328d277bcf23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:49.060482 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6ab75-437a-4b4d-a592-328d277bcf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:49.060882 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6ab75-437a-4b4d-a592-328d277bcf23 admin admin] PATH_INFO: `/v3/projects/469517dc3d7c4f05b85c42580932a8b0` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:49.062041 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6ab75-437a-4b4d-a592-328d277bcf23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=469517dc3d7c4f05b85c42580932a8b0)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:49.063932 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6ab75-437a-4b4d-a592-328d277bcf23 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:49.080872 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:49.164427 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-86a6ab75-437a-4b4d-a592-328d277bcf23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469517dc3d7c4f05b85c42580932a8b0', 'request_id': 'req-86a6ab75-437a-4b4d-a592-328d277bcf23'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:49.232378 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-86a6ab75-437a-4b4d-a592-328d277bcf23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469517dc3d7c4f05b85c42580932a8b0', 'request_id': 'req-86a6ab75-437a-4b4d-a592-328d277bcf23'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:49.237976 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-86a6ab75-437a-4b4d-a592-328d277bcf23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469517dc3d7c4f05b85c42580932a8b0', 'request_id': 'req-86a6ab75-437a-4b4d-a592-328d277bcf23'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:49.249251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-86a6ab75-437a-4b4d-a592-328d277bcf23 admin admin] The token cache is being invalidate because project 469517dc3d7c4f05b85c42580932a8b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:49.249540 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-86a6ab75-437a-4b4d-a592-328d277bcf23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:49.250210 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-86a6ab75-437a-4b4d-a592-328d277bcf23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:49.251717 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1450/2903] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:49 2022] DELETE /identity/v3/projects/469517dc3d7c4f05b85c42580932a8b0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:49.255718 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c44f-db6c-4abe-bb51-57fc892f3714 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:49.265879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c44f-db6c-4abe-bb51-57fc892f3714 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:49.322300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6c870-e564-4962-b64d-3002d12eefd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:49.322933 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6c870-e564-4962-b64d-3002d12eefd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:49.323221 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6c870-e564-4962-b64d-3002d12eefd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:49.323497 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6c870-e564-4962-b64d-3002d12eefd1 admin admin] PATH_INFO: `/v3/users/4efdd586272847e0b30e8128e245e352` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:49.325324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6c870-e564-4962-b64d-3002d12eefd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4efdd586272847e0b30e8128e245e352)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:49.327331 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6c870-e564-4962-b64d-3002d12eefd1 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:49.457837 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a2d6c870-e564-4962-b64d-3002d12eefd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4efdd586272847e0b30e8128e245e352'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:49.458494 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a2d6c870-e564-4962-b64d-3002d12eefd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4efdd586272847e0b30e8128e245e352'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:49.500888 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a2d6c870-e564-4962-b64d-3002d12eefd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4efdd586272847e0b30e8128e245e352'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:49.501441 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a2d6c870-e564-4962-b64d-3002d12eefd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4efdd586272847e0b30e8128e245e352'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:49.514025 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-a2d6c870-e564-4962-b64d-3002d12eefd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4efdd586272847e0b30e8128e245e352'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:49.526315 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1454/2904] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:49 2022] DELETE /identity/v3/users/4efdd586272847e0b30e8128e245e352 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:50.136269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6ab75-437a-4b4d-a592-328d277bcf23 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:50.138308 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-86a6ab75-437a-4b4d-a592-328d277bcf23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:50.152343 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6ab75-437a-4b4d-a592-328d277bcf23 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:50.209387 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b0a10-4f73-4a62-9ad1-dd7e48e7b2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:50.210021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b0a10-4f73-4a62-9ad1-dd7e48e7b2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:50.210300 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b0a10-4f73-4a62-9ad1-dd7e48e7b2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:50.210573 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b0a10-4f73-4a62-9ad1-dd7e48e7b2e7 admin admin] PATH_INFO: `/v3/projects/d54b47377f554c63865bc303cc35c255` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:50.211692 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b0a10-4f73-4a62-9ad1-dd7e48e7b2e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54b47377f554c63865bc303cc35c255)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:50.213619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b0a10-4f73-4a62-9ad1-dd7e48e7b2e7 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:50.312040 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ee0b0a10-4f73-4a62-9ad1-dd7e48e7b2e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54b47377f554c63865bc303cc35c255', 'request_id': 'req-ee0b0a10-4f73-4a62-9ad1-dd7e48e7b2e7'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:50.363462 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ee0b0a10-4f73-4a62-9ad1-dd7e48e7b2e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54b47377f554c63865bc303cc35c255', 'request_id': 'req-ee0b0a10-4f73-4a62-9ad1-dd7e48e7b2e7'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:50.369550 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ee0b0a10-4f73-4a62-9ad1-dd7e48e7b2e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54b47377f554c63865bc303cc35c255', 'request_id': 'req-ee0b0a10-4f73-4a62-9ad1-dd7e48e7b2e7'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:50.380765 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ee0b0a10-4f73-4a62-9ad1-dd7e48e7b2e7 admin admin] The token cache is being invalidate because project d54b47377f554c63865bc303cc35c255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:50.381049 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ee0b0a10-4f73-4a62-9ad1-dd7e48e7b2e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:50.381685 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-ee0b0a10-4f73-4a62-9ad1-dd7e48e7b2e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:50.383181 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1451/2905] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:50 2022] DELETE /identity/v3/projects/d54b47377f554c63865bc303cc35c255 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:50.388036 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7216a-14e0-4819-8472-54bb58912fea None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:50.388566 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7216a-14e0-4819-8472-54bb58912fea None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:50.388669 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7216a-14e0-4819-8472-54bb58912fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:50.409061 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-e9e7216a-14e0-4819-8472-54bb58912fea None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:50.410378 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-e9e7216a-14e0-4819-8472-54bb58912fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:50.431549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:50.470120 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1455/2906] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:50.477806 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b08fe1-e5b5-40ad-a104-a24d419e9af2 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:50.478132 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b08fe1-e5b5-40ad-a104-a24d419e9af2 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:50.478355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b08fe1-e5b5-40ad-a104-a24d419e9af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:50.498776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-65b08fe1-e5b5-40ad-a104-a24d419e9af2 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:50.499965 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-65b08fe1-e5b5-40ad-a104-a24d419e9af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:50.507803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1452/2907] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:59:50.511872 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7216a-14e0-4819-8472-54bb58912fea None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:50.521531 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7216a-14e0-4819-8472-54bb58912fea None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:50.526095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da6d91-eb19-488b-b570-d30afc09ce77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:50.526688 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da6d91-eb19-488b-b570-d30afc09ce77 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:50.527770 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da6d91-eb19-488b-b570-d30afc09ce77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:50.528044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da6d91-eb19-488b-b570-d30afc09ce77 admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:50.528720 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da6d91-eb19-488b-b570-d30afc09ce77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:59:50.529019 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da6d91-eb19-488b-b570-d30afc09ce77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:50.530613 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da6d91-eb19-488b-b570-d30afc09ce77 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:50.543843 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1456/2908] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:59:50.548114 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b08fe1-e5b5-40ad-a104-a24d419e9af2 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:50.558145 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b08fe1-e5b5-40ad-a104-a24d419e9af2 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:50.563084 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84a0eb-6804-4858-8608-a99f6d1c3cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:50.563617 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84a0eb-6804-4858-8608-a99f6d1c3cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:50.563892 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84a0eb-6804-4858-8608-a99f6d1c3cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:50.564192 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84a0eb-6804-4858-8608-a99f6d1c3cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:50.564822 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84a0eb-6804-4858-8608-a99f6d1c3cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:50.566927 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84a0eb-6804-4858-8608-a99f6d1c3cc6 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:50.708399 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1453/2909] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:50 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:59:50.712829 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da6d91-eb19-488b-b570-d30afc09ce77 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:50.723591 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da6d91-eb19-488b-b570-d30afc09ce77 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:50.784363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5050b-60be-4288-959f-21c537d7d44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:50.784972 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5050b-60be-4288-959f-21c537d7d44c admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:50.785254 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5050b-60be-4288-959f-21c537d7d44c admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:50.785529 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5050b-60be-4288-959f-21c537d7d44c admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:50.786238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5050b-60be-4288-959f-21c537d7d44c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:50.788192 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5050b-60be-4288-959f-21c537d7d44c admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:50.872241 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1457/2910] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:50 2022] POST /identity/v3/users => generated 281 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:50.877421 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84a0eb-6804-4858-8608-a99f6d1c3cc6 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:50.884051 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:50.889363 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84a0eb-6804-4858-8608-a99f6d1c3cc6 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:50.893155 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b26f59-0fa3-41fa-83ef-bf166cad34ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:50.893777 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b26f59-0fa3-41fa-83ef-bf166cad34ed admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:50.894125 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b26f59-0fa3-41fa-83ef-bf166cad34ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:50.894400 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b26f59-0fa3-41fa-83ef-bf166cad34ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:50.895041 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b26f59-0fa3-41fa-83ef-bf166cad34ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:50.896648 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b26f59-0fa3-41fa-83ef-bf166cad34ed admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:50.907142 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1454/2911] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:50.911229 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5050b-60be-4288-959f-21c537d7d44c admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:50.921299 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5050b-60be-4288-959f-21c537d7d44c admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:50.926418 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c3bcf-2bc6-40dd-8342-07d04a02e29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:50.927006 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c3bcf-2bc6-40dd-8342-07d04a02e29f admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:50.927291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c3bcf-2bc6-40dd-8342-07d04a02e29f admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:50.927569 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c3bcf-2bc6-40dd-8342-07d04a02e29f admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:50.928360 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c3bcf-2bc6-40dd-8342-07d04a02e29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:50.929976 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c3bcf-2bc6-40dd-8342-07d04a02e29f admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:50.941047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1458/2912] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:50.945131 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b26f59-0fa3-41fa-83ef-bf166cad34ed admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:50.955264 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b26f59-0fa3-41fa-83ef-bf166cad34ed admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:50.960035 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e26078-085f-4fc8-973c-44baa362cf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:50.960705 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e26078-085f-4fc8-973c-44baa362cf20 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:50.961593 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e26078-085f-4fc8-973c-44baa362cf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:50.961890 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e26078-085f-4fc8-973c-44baa362cf20 admin admin] PATH_INFO: `/v3/projects/c760b1af3ae242d698f3c0976ad34451/users/0a730713211b44359387254425952faa/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:50.977413 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e26078-085f-4fc8-973c-44baa362cf20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c760b1af3ae242d698f3c0976ad34451, user_id=0a730713211b44359387254425952faa, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:50.980061 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e26078-085f-4fc8-973c-44baa362cf20 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:51.066831 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1455/2913] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:50 2022] PUT /identity/v3/projects/c760b1af3ae242d698f3c0976ad34451/users/0a730713211b44359387254425952faa/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:51.131635 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc10ab-423a-46ff-86d4-ab9e437d8f51 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:51.131876 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc10ab-423a-46ff-86d4-ab9e437d8f51 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:51.132106 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc10ab-423a-46ff-86d4-ab9e437d8f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:51.159762 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-60bc10ab-423a-46ff-86d4-ab9e437d8f51 None None] MFA Rules not processed for user `0a730713211b44359387254425952faa`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:51.160989 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-60bc10ab-423a-46ff-86d4-ab9e437d8f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:51.223680 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1459/2914] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:51.256251 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e26078-085f-4fc8-973c-44baa362cf20 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:51.258007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-b7e26078-085f-4fc8-973c-44baa362cf20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:51.314826 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e26078-085f-4fc8-973c-44baa362cf20 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:51.318457 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f836b-520a-4a58-b8e6-a09b5f6ee484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:51.319059 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f836b-520a-4a58-b8e6-a09b5f6ee484 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:51.319353 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f836b-520a-4a58-b8e6-a09b5f6ee484 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:51.319772 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f836b-520a-4a58-b8e6-a09b5f6ee484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:51.328669 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f836b-520a-4a58-b8e6-a09b5f6ee484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:51.330090 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f836b-520a-4a58-b8e6-a09b5f6ee484 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:51.338778 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1456/2915] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:51.355382 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc10ab-423a-46ff-86d4-ab9e437d8f51 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:51.381368 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:51.418746 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc10ab-423a-46ff-86d4-ab9e437d8f51 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:51.423508 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b518c8-75ec-44c7-b94b-9cf6e6195080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:51.424167 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b518c8-75ec-44c7-b94b-9cf6e6195080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:51.424451 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b518c8-75ec-44c7-b94b-9cf6e6195080 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:51.424729 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b518c8-75ec-44c7-b94b-9cf6e6195080 admin admin] PATH_INFO: `/v3/users/0a730713211b44359387254425952faa` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:51.426129 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b518c8-75ec-44c7-b94b-9cf6e6195080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a730713211b44359387254425952faa)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:51.428050 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b518c8-75ec-44c7-b94b-9cf6e6195080 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:51.595866 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-20b518c8-75ec-44c7-b94b-9cf6e6195080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a730713211b44359387254425952faa'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:51.596677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-20b518c8-75ec-44c7-b94b-9cf6e6195080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a730713211b44359387254425952faa'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:51.672044 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-20b518c8-75ec-44c7-b94b-9cf6e6195080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a730713211b44359387254425952faa'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:51.672717 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-20b518c8-75ec-44c7-b94b-9cf6e6195080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a730713211b44359387254425952faa'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:51.685850 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-20b518c8-75ec-44c7-b94b-9cf6e6195080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a730713211b44359387254425952faa'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:51.697983 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1460/2916] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:51 2022] DELETE /identity/v3/users/0a730713211b44359387254425952faa => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:51.702881 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ebf8f-1474-4ded-985a-4177e7384565 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:51.703163 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ebf8f-1474-4ded-985a-4177e7384565 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:51.703434 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ebf8f-1474-4ded-985a-4177e7384565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:51.722606 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-101ebf8f-1474-4ded-985a-4177e7384565 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:51.723801 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-101ebf8f-1474-4ded-985a-4177e7384565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:51.781466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1457/2917] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:51.791095 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b518c8-75ec-44c7-b94b-9cf6e6195080 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:51.792525 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-20b518c8-75ec-44c7-b94b-9cf6e6195080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:51.849576 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b518c8-75ec-44c7-b94b-9cf6e6195080 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:51.853203 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee1f73-6ca9-4b52-bf88-76f1a0772887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:51.853807 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee1f73-6ca9-4b52-bf88-76f1a0772887 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:51.854087 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee1f73-6ca9-4b52-bf88-76f1a0772887 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:51.854362 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee1f73-6ca9-4b52-bf88-76f1a0772887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:51.863236 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee1f73-6ca9-4b52-bf88-76f1a0772887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:51.864704 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee1f73-6ca9-4b52-bf88-76f1a0772887 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:51.874618 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1461/2918] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:52.280029 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ebf8f-1474-4ded-985a-4177e7384565 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:52.281931 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-101ebf8f-1474-4ded-985a-4177e7384565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:52.294393 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ebf8f-1474-4ded-985a-4177e7384565 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:52.299280 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd81f-54d1-4f76-bef4-19a8ad7bfac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:52.299915 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd81f-54d1-4f76-bef4-19a8ad7bfac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:52.300227 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd81f-54d1-4f76-bef4-19a8ad7bfac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:52.300501 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd81f-54d1-4f76-bef4-19a8ad7bfac0 admin admin] PATH_INFO: `/v3/projects/c760b1af3ae242d698f3c0976ad34451` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:52.301920 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dd81f-54d1-4f76-bef4-19a8ad7bfac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c760b1af3ae242d698f3c0976ad34451)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:52.303807 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dd81f-54d1-4f76-bef4-19a8ad7bfac0 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:52.404053 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-269dd81f-54d1-4f76-bef4-19a8ad7bfac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c760b1af3ae242d698f3c0976ad34451', 'request_id': 'req-269dd81f-54d1-4f76-bef4-19a8ad7bfac0'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:52.466898 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-269dd81f-54d1-4f76-bef4-19a8ad7bfac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c760b1af3ae242d698f3c0976ad34451', 'request_id': 'req-269dd81f-54d1-4f76-bef4-19a8ad7bfac0'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:52.476135 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-269dd81f-54d1-4f76-bef4-19a8ad7bfac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c760b1af3ae242d698f3c0976ad34451', 'request_id': 'req-269dd81f-54d1-4f76-bef4-19a8ad7bfac0'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:52.476135 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:52.485677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-269dd81f-54d1-4f76-bef4-19a8ad7bfac0 admin admin] The token cache is being invalidate because project c760b1af3ae242d698f3c0976ad34451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:52.485970 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-269dd81f-54d1-4f76-bef4-19a8ad7bfac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:52.486616 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-269dd81f-54d1-4f76-bef4-19a8ad7bfac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:52.488110 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1458/2919] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:52 2022] DELETE /identity/v3/projects/c760b1af3ae242d698f3c0976ad34451 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:52.493250 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5730467-18f9-4f1d-ab50-d10c0159e49a None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:52.493760 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5730467-18f9-4f1d-ab50-d10c0159e49a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:52.493760 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5730467-18f9-4f1d-ab50-d10c0159e49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:52.515789 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-f5730467-18f9-4f1d-ab50-d10c0159e49a None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:52.517105 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f5730467-18f9-4f1d-ab50-d10c0159e49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:52.556794 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:52.576080 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1462/2920] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:52.583677 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a13c8-714f-4f47-bcfe-84278967c53c None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:52.583975 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a13c8-714f-4f47-bcfe-84278967c53c None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:52.584281 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a13c8-714f-4f47-bcfe-84278967c53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:52.604776 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-7e0a13c8-714f-4f47-bcfe-84278967c53c None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:52.605978 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-7e0a13c8-714f-4f47-bcfe-84278967c53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:52.614355 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1459/2921] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:52.618695 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5730467-18f9-4f1d-ab50-d10c0159e49a None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:52.629377 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5730467-18f9-4f1d-ab50-d10c0159e49a None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:52.634200 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fd72d-c256-466d-8827-198daf727bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:52.634796 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fd72d-c256-466d-8827-198daf727bfd admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:52.635081 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fd72d-c256-466d-8827-198daf727bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:52.636881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fd72d-c256-466d-8827-198daf727bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:52.636881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fd72d-c256-466d-8827-198daf727bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82237) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:59:52.636881 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fd72d-c256-466d-8827-198daf727bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:52.638604 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fd72d-c256-466d-8827-198daf727bfd admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:52.650102 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1463/2922] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 29 22:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:59:52.654328 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a13c8-714f-4f47-bcfe-84278967c53c None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:52.663515 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a13c8-714f-4f47-bcfe-84278967c53c None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:52.668121 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d0796-5dd2-4b89-9816-96122e6cc098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:52.668711 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d0796-5dd2-4b89-9816-96122e6cc098 admin admin] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:52.668989 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d0796-5dd2-4b89-9816-96122e6cc098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:52.669259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d0796-5dd2-4b89-9816-96122e6cc098 admin admin] PATH_INFO: `/v3/projects` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:52.669889 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d0796-5dd2-4b89-9816-96122e6cc098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:52.671763 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d0796-5dd2-4b89-9816-96122e6cc098 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:52.765714 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1460/2923] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 29 22:59:52 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:59:52.769817 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fd72d-c256-466d-8827-198daf727bfd admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:52.779932 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fd72d-c256-466d-8827-198daf727bfd admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:52.836142 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f813a4-cc5a-40bc-9a2a-2c0aebe3f9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:52.836750 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f813a4-cc5a-40bc-9a2a-2c0aebe3f9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:52.837031 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f813a4-cc5a-40bc-9a2a-2c0aebe3f9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:52.837330 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f813a4-cc5a-40bc-9a2a-2c0aebe3f9b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:52.837966 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f813a4-cc5a-40bc-9a2a-2c0aebe3f9b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:52.839909 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f813a4-cc5a-40bc-9a2a-2c0aebe3f9b3 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:52.910619 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1464/2924] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 29 22:59:52 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:59:52.915007 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d0796-5dd2-4b89-9816-96122e6cc098 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:52.926408 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d0796-5dd2-4b89-9816-96122e6cc098 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:52.931208 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a6936-577a-45fb-a037-263f7070dee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:52.931804 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6936-577a-45fb-a037-263f7070dee1 admin admin] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:52.932110 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6936-577a-45fb-a037-263f7070dee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:52.932387 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6936-577a-45fb-a037-263f7070dee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:52.933755 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a6936-577a-45fb-a037-263f7070dee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:52.935290 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a6936-577a-45fb-a037-263f7070dee1 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:52.945253 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1461/2925] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:59:52.949238 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f813a4-cc5a-40bc-9a2a-2c0aebe3f9b3 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:52.959405 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f813a4-cc5a-40bc-9a2a-2c0aebe3f9b3 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:52.963969 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0f81b-2934-49f1-9d88-11967d653686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:52.964627 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0f81b-2934-49f1-9d88-11967d653686 admin admin] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:52.964938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0f81b-2934-49f1-9d88-11967d653686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:52.965211 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0f81b-2934-49f1-9d88-11967d653686 admin admin] PATH_INFO: `/v3/roles` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:52.965853 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0f81b-2934-49f1-9d88-11967d653686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:52.967437 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0f81b-2934-49f1-9d88-11967d653686 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:52.977860 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1465/2926] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 22:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:59:52.982466 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a6936-577a-45fb-a037-263f7070dee1 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:52.992601 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a6936-577a-45fb-a037-263f7070dee1 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:52.997884 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05185be7-3ffc-4cc9-af26-275ac5b5dc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:52.998525 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05185be7-3ffc-4cc9-af26-275ac5b5dc80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:52.998807 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05185be7-3ffc-4cc9-af26-275ac5b5dc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:52.999093 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05185be7-3ffc-4cc9-af26-275ac5b5dc80 admin admin] PATH_INFO: `/v3/projects/c4a9049ff36a421f9c560c8b5363740f/users/e4562336e6374868b060901714187ca3/roles/7cca4e8860b3437e801ffbf8429da7dd` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:53.013289 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05185be7-3ffc-4cc9-af26-275ac5b5dc80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a9049ff36a421f9c560c8b5363740f, user_id=e4562336e6374868b060901714187ca3, role_id=7cca4e8860b3437e801ffbf8429da7dd)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:53.015969 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05185be7-3ffc-4cc9-af26-275ac5b5dc80 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:53.083080 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1462/2927] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 29 22:59:52 2022] PUT /identity/v3/projects/c4a9049ff36a421f9c560c8b5363740f/users/e4562336e6374868b060901714187ca3/roles/7cca4e8860b3437e801ffbf8429da7dd => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:53.094490 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32de9f6-2367-4bc9-950c-f5d56849e04a None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:53.094783 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32de9f6-2367-4bc9-950c-f5d56849e04a None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:53.096275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32de9f6-2367-4bc9-950c-f5d56849e04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:53.123823 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-f32de9f6-2367-4bc9-950c-f5d56849e04a None None] MFA Rules not processed for user `e4562336e6374868b060901714187ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:53.125089 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f32de9f6-2367-4bc9-950c-f5d56849e04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:53.187648 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1466/2928] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:53.198802 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05185be7-3ffc-4cc9-af26-275ac5b5dc80 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:53.201311 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-05185be7-3ffc-4cc9-af26-275ac5b5dc80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:53.257516 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05185be7-3ffc-4cc9-af26-275ac5b5dc80 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:53.261121 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8fcea-f09b-465d-8f25-ffc24af61ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b630aac21b405eb114f5f1fd1294ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:53.261716 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8fcea-f09b-465d-8f25-ffc24af61ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:53.261993 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8fcea-f09b-465d-8f25-ffc24af61ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:53.262270 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8fcea-f09b-465d-8f25-ffc24af61ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:53.270426 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b8fcea-f09b-465d-8f25-ffc24af61ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:53.271747 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b8fcea-f09b-465d-8f25-ffc24af61ee2 service cinder] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:53.280897 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1463/2929] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:54.027127 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32de9f6-2367-4bc9-950c-f5d56849e04a None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:54.029971 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-f32de9f6-2367-4bc9-950c-f5d56849e04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:54.076778 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:54.094875 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32de9f6-2367-4bc9-950c-f5d56849e04a None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:54.100142 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5532c-5af2-4aed-9579-e51e74ebef6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:54.101124 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5532c-5af2-4aed-9579-e51e74ebef6e service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:54.101608 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5532c-5af2-4aed-9579-e51e74ebef6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:54.102010 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5532c-5af2-4aed-9579-e51e74ebef6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:54.104063 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-ddc5532c-5af2-4aed-9579-e51e74ebef6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:54.177477 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5532c-5af2-4aed-9579-e51e74ebef6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:54.178918 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5532c-5af2-4aed-9579-e51e74ebef6e service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:54.190776 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1467/2930] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:55.467594 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8fcea-f09b-465d-8f25-ffc24af61ee2 service cinder] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:55.469133 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d8b8fcea-f09b-465d-8f25-ffc24af61ee2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:55.482821 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8fcea-f09b-465d-8f25-ffc24af61ee2 service cinder] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:55.486590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907b5e9-ae4d-4658-8566-95973e154cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:55.487239 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907b5e9-ae4d-4658-8566-95973e154cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:55.487543 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907b5e9-ae4d-4658-8566-95973e154cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:55.487832 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907b5e9-ae4d-4658-8566-95973e154cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:55.490403 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-d907b5e9-ae4d-4658-8566-95973e154cf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:55.504577 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907b5e9-ae4d-4658-8566-95973e154cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:55.506230 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907b5e9-ae4d-4658-8566-95973e154cf8 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:55.518388 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1464/2931] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:56.451275 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5532c-5af2-4aed-9579-e51e74ebef6e service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:56.512457 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5532c-5af2-4aed-9579-e51e74ebef6e service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:56.517040 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fbf85-7159-4149-baa6-d769b2d6e422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:56.517659 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fbf85-7159-4149-baa6-d769b2d6e422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:56.517934 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fbf85-7159-4149-baa6-d769b2d6e422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:56.518202 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fbf85-7159-4149-baa6-d769b2d6e422 admin admin] PATH_INFO: `/v3/users/e4562336e6374868b060901714187ca3` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:56.519303 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fbf85-7159-4149-baa6-d769b2d6e422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4562336e6374868b060901714187ca3)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:56.521269 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fbf85-7159-4149-baa6-d769b2d6e422 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:56.695609 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9e4fbf85-7159-4149-baa6-d769b2d6e422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4562336e6374868b060901714187ca3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:56.696363 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9e4fbf85-7159-4149-baa6-d769b2d6e422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4562336e6374868b060901714187ca3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:56.764047 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9e4fbf85-7159-4149-baa6-d769b2d6e422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4562336e6374868b060901714187ca3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:56.764628 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9e4fbf85-7159-4149-baa6-d769b2d6e422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4562336e6374868b060901714187ca3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:56.778663 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-9e4fbf85-7159-4149-baa6-d769b2d6e422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4562336e6374868b060901714187ca3'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:56.787334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:56.791638 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1468/2932] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:56 2022] DELETE /identity/v3/users/e4562336e6374868b060901714187ca3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:56.796351 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f53dd2-0944-4724-bcd0-d9f83f360485 None None] REQUEST_METHOD: `POST` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:56.796834 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f53dd2-0944-4724-bcd0-d9f83f360485 None None] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:56.797139 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f53dd2-0944-4724-bcd0-d9f83f360485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:56.817775 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.auth.core [None req-65f53dd2-0944-4724-bcd0-d9f83f360485 None None] MFA Rules not processed for user `2047940dbd8547dfbf3a3e01e9cedc83`. Rule list: `[]` (Enabled: `True`). {{(pid=82236) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:59:56.819006 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-65f53dd2-0944-4724-bcd0-d9f83f360485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:56.881261 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1465/2933] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 29 22:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:59:56.891309 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fbf85-7159-4149-baa6-d769b2d6e422 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:56.892808 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-9e4fbf85-7159-4149-baa6-d769b2d6e422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:56.955728 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fbf85-7159-4149-baa6-d769b2d6e422 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:56.959283 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd0a69-2036-45bb-bb83-7e84101af6f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:56.959879 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd0a69-2036-45bb-bb83-7e84101af6f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:56.960181 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd0a69-2036-45bb-bb83-7e84101af6f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:56.960454 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd0a69-2036-45bb-bb83-7e84101af6f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:56.970481 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd0a69-2036-45bb-bb83-7e84101af6f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:56.971931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd0a69-2036-45bb-bb83-7e84101af6f1 service neutron] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:56.981835 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1469/2934] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:57.405279 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f53dd2-0944-4724-bcd0-d9f83f360485 None None] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:57.406707 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-65f53dd2-0944-4724-bcd0-d9f83f360485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:57.420189 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f53dd2-0944-4724-bcd0-d9f83f360485 None None] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:57.425117 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:57.426722 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:57.427010 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:57.427383 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9 admin admin] PATH_INFO: `/v3/projects/c4a9049ff36a421f9c560c8b5363740f` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:57.428556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a9049ff36a421f9c560c8b5363740f)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:57.430647 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:57.448304 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:57.575725 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a9049ff36a421f9c560c8b5363740f', 'request_id': 'req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:57.672430 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a9049ff36a421f9c560c8b5363740f', 'request_id': 'req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:57.678639 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a9049ff36a421f9c560c8b5363740f', 'request_id': 'req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:57.690552 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9 admin admin] The token cache is being invalidate because project c4a9049ff36a421f9c560c8b5363740f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:57.693708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:57.693708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:57.693708 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1466/2935] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:57 2022] DELETE /identity/v3/projects/c4a9049ff36a421f9c560c8b5363740f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:00:06.977537 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=26 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:07.687586 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=17,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:45.792430 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd0a69-2036-45bb-bb83-7e84101af6f1 service neutron] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:45.794931 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-b3fd0a69-2036-45bb-bb83-7e84101af6f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:45.898287 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd0a69-2036-45bb-bb83-7e84101af6f1 service neutron] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:45.973598 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef1696-c869-4e61-b891-6c3040b0dbf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06d910badb84c6aa6b48f3b56b91f82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:45.974130 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef1696-c869-4e61-b891-6c3040b0dbf2 service nova] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:45.974408 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef1696-c869-4e61-b891-6c3040b0dbf2 service nova] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:45.974677 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef1696-c869-4e61-b891-6c3040b0dbf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:45.976472 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-23ef1696-c869-4e61-b891-6c3040b0dbf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:45.989291 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef1696-c869-4e61-b891-6c3040b0dbf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:45.990988 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef1696-c869-4e61-b891-6c3040b0dbf2 service nova] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:46.002709 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1470/2936] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:00:46.078791 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:46.080412 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:46.145968 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc9993-7d0e-42f5-8a40-d3856cc6faf9 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:46.149979 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe16e0b-b71e-4d8a-b3b7-a581b2c1ef40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8794e99a0024672974412ca4c045b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:46.150619 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe16e0b-b71e-4d8a-b3b7-a581b2c1ef40 service neutron] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:46.150883 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe16e0b-b71e-4d8a-b3b7-a581b2c1ef40 service neutron] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:46.151159 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe16e0b-b71e-4d8a-b3b7-a581b2c1ef40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:46.153590 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-dfe16e0b-b71e-4d8a-b3b7-a581b2c1ef40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:46.164259 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe16e0b-b71e-4d8a-b3b7-a581b2c1ef40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:46.165681 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe16e0b-b71e-4d8a-b3b7-a581b2c1ef40 service neutron] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:46.174106 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1467/2937] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 23:00:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:00:54.230527 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54219f-3f2b-430c-a7dd-4a050a9a0546 None None] REQUEST_METHOD: `POST` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:54.231104 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54219f-3f2b-430c-a7dd-4a050a9a0546 None None] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:54.231104 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54219f-3f2b-430c-a7dd-4a050a9a0546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:54.286286 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.auth.core [None req-6a54219f-3f2b-430c-a7dd-4a050a9a0546 None None] MFA Rules not processed for user `7506b634db8843d3b0651b1f4fbc4498`. Rule list: `[]` (Enabled: `True`). {{(pid=82237) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:00:54.287574 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-6a54219f-3f2b-430c-a7dd-4a050a9a0546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:54.345249 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=100 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:54.353827 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1471/2938] 10.222.0.62 () {58 vars in 967 bytes} [Mon Aug 29 23:00:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:00:54.393803 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe16e0b-b71e-4d8a-b3b7-a581b2c1ef40 service neutron] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:00:54.395229 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-dfe16e0b-b71e-4d8a-b3b7-a581b2c1ef40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:00:54.484055 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe16e0b-b71e-4d8a-b3b7-a581b2c1ef40 service neutron] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:00:54.489021 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6028e9-3b10-4e7f-8d95-e5317611aceb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8cccf561d484373a7cb24c5f111900c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:00:54.489622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6028e9-3b10-4e7f-8d95-e5317611aceb service swift] REQUEST_METHOD: `GET` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:00:54.489895 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6028e9-3b10-4e7f-8d95-e5317611aceb service swift] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:00:54.490164 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6028e9-3b10-4e7f-8d95-e5317611aceb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:00:54.497955 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6028e9-3b10-4e7f-8d95-e5317611aceb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:00:54.499491 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6028e9-3b10-4e7f-8d95-e5317611aceb service swift] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:00:54.507241 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1468/2939] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 29 23:00:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:01:02.466748 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54219f-3f2b-430c-a7dd-4a050a9a0546 None None] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:01:02.468334 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-6a54219f-3f2b-430c-a7dd-4a050a9a0546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:01:02.534521 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54219f-3f2b-430c-a7dd-4a050a9a0546 None None] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:01:02.539111 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcb842-1cfd-4204-a4a6-cf6ba31874ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:01:02.539732 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcb842-1cfd-4204-a4a6-cf6ba31874ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:01:02.540015 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcb842-1cfd-4204-a4a6-cf6ba31874ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:01:02.540324 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcb842-1cfd-4204-a4a6-cf6ba31874ee admin admin] PATH_INFO: `/v3/users/3f9f59a9d513466cade5740873df518e` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:01:02.541449 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcb842-1cfd-4204-a4a6-cf6ba31874ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9f59a9d513466cade5740873df518e)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:01:02.544038 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcb842-1cfd-4204-a4a6-cf6ba31874ee admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:01:02.748017 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-17dcb842-1cfd-4204-a4a6-cf6ba31874ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9f59a9d513466cade5740873df518e'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:02.748729 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-17dcb842-1cfd-4204-a4a6-cf6ba31874ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9f59a9d513466cade5740873df518e'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:02.831066 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-17dcb842-1cfd-4204-a4a6-cf6ba31874ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9f59a9d513466cade5740873df518e'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:02.831689 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-17dcb842-1cfd-4204-a4a6-cf6ba31874ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9f59a9d513466cade5740873df518e'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:02.843960 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-17dcb842-1cfd-4204-a4a6-cf6ba31874ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9f59a9d513466cade5740873df518e'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:02.856596 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1472/2940] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 23:01:02 2022] DELETE /identity/v3/users/3f9f59a9d513466cade5740873df518e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:01:03.084078 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6028e9-3b10-4e7f-8d95-e5317611aceb service swift] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:01:03.095485 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6028e9-3b10-4e7f-8d95-e5317611aceb service swift] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:01:03.153995 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda69c8a-67b1-4e6d-9188-d17d23fec600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:01:03.154636 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda69c8a-67b1-4e6d-9188-d17d23fec600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:01:03.154926 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda69c8a-67b1-4e6d-9188-d17d23fec600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:01:03.155201 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda69c8a-67b1-4e6d-9188-d17d23fec600 admin admin] PATH_INFO: `/v3/projects/9f25fbce60b747c0824e2dd27e28c319` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:01:03.156374 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda69c8a-67b1-4e6d-9188-d17d23fec600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f25fbce60b747c0824e2dd27e28c319)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:01:03.158269 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda69c8a-67b1-4e6d-9188-d17d23fec600 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:01:03.174791 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=100 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:03.272449 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-eda69c8a-67b1-4e6d-9188-d17d23fec600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f25fbce60b747c0824e2dd27e28c319', 'request_id': 'req-eda69c8a-67b1-4e6d-9188-d17d23fec600'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:03.351103 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-eda69c8a-67b1-4e6d-9188-d17d23fec600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f25fbce60b747c0824e2dd27e28c319', 'request_id': 'req-eda69c8a-67b1-4e6d-9188-d17d23fec600'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:03.357665 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-eda69c8a-67b1-4e6d-9188-d17d23fec600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f25fbce60b747c0824e2dd27e28c319', 'request_id': 'req-eda69c8a-67b1-4e6d-9188-d17d23fec600'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:03.368641 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-eda69c8a-67b1-4e6d-9188-d17d23fec600 admin admin] The token cache is being invalidate because project 9f25fbce60b747c0824e2dd27e28c319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:01:03.368930 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-eda69c8a-67b1-4e6d-9188-d17d23fec600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:03.369557 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-eda69c8a-67b1-4e6d-9188-d17d23fec600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:03.371622 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1469/2941] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 23:01:03 2022] DELETE /identity/v3/projects/9f25fbce60b747c0824e2dd27e28c319 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:01:03.375695 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcb842-1cfd-4204-a4a6-cf6ba31874ee admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:01:03.377167 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-17dcb842-1cfd-4204-a4a6-cf6ba31874ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:01:03.390300 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcb842-1cfd-4204-a4a6-cf6ba31874ee admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:01:03.450810 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3b5ad-8900-4657-a672-76d368ef8818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:01:03.451504 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3b5ad-8900-4657-a672-76d368ef8818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:01:03.451786 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3b5ad-8900-4657-a672-76d368ef8818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:01:03.452110 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3b5ad-8900-4657-a672-76d368ef8818 admin admin] PATH_INFO: `/v3/users/c8de3650e0d449ec9369d5299e613dd2` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:01:03.453389 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3b5ad-8900-4657-a672-76d368ef8818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8de3650e0d449ec9369d5299e613dd2)` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:01:03.455582 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3b5ad-8900-4657-a672-76d368ef8818 admin admin] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:01:03.473216 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:03.628630 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d4e3b5ad-8900-4657-a672-76d368ef8818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8de3650e0d449ec9369d5299e613dd2'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:03.629223 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d4e3b5ad-8900-4657-a672-76d368ef8818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8de3650e0d449ec9369d5299e613dd2'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:03.716838 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d4e3b5ad-8900-4657-a672-76d368ef8818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8de3650e0d449ec9369d5299e613dd2'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:03.717703 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d4e3b5ad-8900-4657-a672-76d368ef8818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8de3650e0d449ec9369d5299e613dd2'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:03.731561 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.notifications [None req-d4e3b5ad-8900-4657-a672-76d368ef8818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8de3650e0d449ec9369d5299e613dd2'} {{(pid=82237) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:03.744780 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1473/2942] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 23:01:03 2022] DELETE /identity/v3/users/c8de3650e0d449ec9369d5299e613dd2 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:01:03.988023 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda69c8a-67b1-4e6d-9188-d17d23fec600 admin admin] Authenticating user token {{(pid=82236) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:01:03.989690 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.fernet_utils [None req-eda69c8a-67b1-4e6d-9188-d17d23fec600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82236) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:01:04.005499 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda69c8a-67b1-4e6d-9188-d17d23fec600 admin admin] Validating token access rules against request {{(pid=82236) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:01:04.067842 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a92ac8-00c2-44ea-9dc7-45e378162154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2047940dbd8547dfbf3a3e01e9cedc83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acc9b26755b04e9387ec6536e491c79d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82236) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:01:04.069149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a92ac8-00c2-44ea-9dc7-45e378162154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:01:04.069149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a92ac8-00c2-44ea-9dc7-45e378162154 admin admin] SCRIPT_NAME: `/identity` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:01:04.069149 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a92ac8-00c2-44ea-9dc7-45e378162154 admin admin] PATH_INFO: `/v3/projects/82015855261144c8aa428dafc1f8ad8a` {{(pid=82236) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:01:04.070180 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a92ac8-00c2-44ea-9dc7-45e378162154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82015855261144c8aa428dafc1f8ad8a)` {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:01:04.072108 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a92ac8-00c2-44ea-9dc7-45e378162154 admin admin] RBAC: Authorization granted {{(pid=82236) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:01:04.216298 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c3a92ac8-00c2-44ea-9dc7-45e378162154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82015855261144c8aa428dafc1f8ad8a', 'request_id': 'req-c3a92ac8-00c2-44ea-9dc7-45e378162154'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:04.288545 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c3a92ac8-00c2-44ea-9dc7-45e378162154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82015855261144c8aa428dafc1f8ad8a', 'request_id': 'req-c3a92ac8-00c2-44ea-9dc7-45e378162154'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:04.294556 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c3a92ac8-00c2-44ea-9dc7-45e378162154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82015855261144c8aa428dafc1f8ad8a', 'request_id': 'req-c3a92ac8-00c2-44ea-9dc7-45e378162154'} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:04.305799 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c3a92ac8-00c2-44ea-9dc7-45e378162154 admin admin] The token cache is being invalidate because project 82015855261144c8aa428dafc1f8ad8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82236) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:01:04.306092 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c3a92ac8-00c2-44ea-9dc7-45e378162154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:04.309835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG keystone.notifications [None req-c3a92ac8-00c2-44ea-9dc7-45e378162154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82236) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:01:04.309835 dv-cinder-854269-4-smb devstack@keystone.service[82236]: [pid: 82236|app: 0|req: 1470/2943] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 23:01:03 2022] DELETE /identity/v3/projects/82015855261144c8aa428dafc1f8ad8a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:01:13.740950 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:DELETE=9,keystone:SELECT=20,keystone:INSERT=1 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:14.302791 dv-cinder-854269-4-smb devstack@keystone.service[82236]: DEBUG dbcounter [-] [82236] Writing DB stats keystone:SELECT=69,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:58.837048 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3b5ad-8900-4657-a672-76d368ef8818 admin admin] Authenticating user token {{(pid=82237) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:02:58.838549 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-d4e3b5ad-8900-4657-a672-76d368ef8818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:02:58.906647 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3b5ad-8900-4657-a672-76d368ef8818 admin admin] Validating token access rules against request {{(pid=82237) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:02:58.965176 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ecb08-14b2-45f2-b2be-7d3bbd01c43e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2991c613878e4993901199434f384f49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdd2d14c7e884b8b8f340183a79fd481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82237) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:02:58.965779 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ecb08-14b2-45f2-b2be-7d3bbd01c43e service placement] REQUEST_METHOD: `GET` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:02:58.966061 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ecb08-14b2-45f2-b2be-7d3bbd01c43e service placement] SCRIPT_NAME: `/identity` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:02:58.966338 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ecb08-14b2-45f2-b2be-7d3bbd01c43e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82237) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:02:58.968733 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.fernet_utils [None req-788ecb08-14b2-45f2-b2be-7d3bbd01c43e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82237) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:02:58.979938 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ecb08-14b2-45f2-b2be-7d3bbd01c43e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:02:58.981543 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ecb08-14b2-45f2-b2be-7d3bbd01c43e service placement] RBAC: Authorization granted {{(pid=82237) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:02:58.992005 dv-cinder-854269-4-smb devstack@keystone.service[82237]: [pid: 82237|app: 0|req: 1474/2944] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 29 23:02:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:03:08.987859 dv-cinder-854269-4-smb devstack@keystone.service[82237]: DEBUG dbcounter [-] [82237] Writing DB stats keystone:SELECT=58 {{(pid=82237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}